May 27 22:57:41.162657 np0000001565 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 27 22:57:42.829073 np0000001565 nova-compute[98289]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98289) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 27 22:57:42.829863 np0000001565 nova-compute[98289]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98289) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 27 22:57:42.829863 np0000001565 nova-compute[98289]: INFO os_vif [-] Loaded VIF plugins: noop, ovs
May 27 22:57:42.954842 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 22:57:42.965480 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.011s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 22:57:43.123882 np0000001565 nova-compute[98289]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 27 22:57:43.902688 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 27 22:57:43.903039 np0000001565 nova-compute[98289]: INFO nova.utils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] The long task thread pool MainProcess.long_task is initialized
May 27 22:57:43.903286 np0000001565 nova-compute[98289]: INFO nova.virt.driver [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Loading compute driver 'libvirt.LibvirtDriver'
May 27 22:57:43.994914 np0000001565 nova-compute[98289]: INFO nova.compute.provider_config [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 27 22:57:44.497146 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Acquiring lock "singleton_lock" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 22:57:44.497377 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Acquired lock "singleton_lock" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 22:57:44.497447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Releasing lock "singleton_lock" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 22:57:44.497658 np0000001565 nova-compute[98289]: WARNING oslo_service.backend._threading.service [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] no_fork=True: running service in main process
May 27 22:57:44.497928 np0000001565 nova-compute[98289]: INFO nova.service [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Starting compute node (version 33.1.0)
May 27 22:57:45.001039 np0000001565 nova-compute[98289]: INFO nova.utils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] The default thread pool MainProcess.default is initialized
May 27 22:57:45.001577 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 22:57:45.001792 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Starting event thread {{(pid=98289) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 27 22:57:45.002191 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Starting connection event dispatch thread {{(pid=98289) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 27 22:57:45.002860 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Connecting to libvirt: qemu:///system {{(pid=98289) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 27 22:57:45.485462 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x726e697a8350> {{(pid=98289) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 27 22:57:45.486424 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x726e697a8350> {{(pid=98289) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 27 22:57:45.488886 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Connection event '1' reason 'None'
May 27 22:57:45.992672 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Cannot update service status on host "np0000001565" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001565 could not be found.
May 27 22:57:45.992672 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.mount [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Initialising _HostMountState generation 0 {{(pid=98289) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 27 22:57:55.751097 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host capabilities <capabilities>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:   <host>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:     <uuid>cd4be76f-9bad-49c5-829d-97d4598e8023</uuid>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:     <cpu>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <arch>x86_64</arch>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <model>EPYC-Milan</model>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <vendor>AMD</vendor>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <microcode version='16777317'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <signature family='25' model='1' stepping='1'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <maxphysaddr mode='emulate' bits='40'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='x2apic'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='tsc-deadline'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='osxsave'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='hypervisor'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='tsc_adjust'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='ospke'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='vaes'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='vpclmulqdq'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='spec-ctrl'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='stibp'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='arch-capabilities'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='ssbd'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='cmp_legacy'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='topoext'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='stibp-always-on'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='virt-ssbd'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='amd-psfd'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='lbrv'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='tsc-scale'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='vmcb-clean'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='flushbyasid'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='pause-filter'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='pfthreshold'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='v-vmsave-vmload'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='vgif'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='no-nested-data-bp'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='lfence-always-serializing'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='null-sel-clr-base'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='rdctl-no'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='skip-l1dfl-vmentry'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='mds-no'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='pschange-mc-no'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <feature name='gds-no'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <pages unit='KiB' size='4'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <pages unit='KiB' size='2048'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <pages unit='KiB' size='1048576'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:     </cpu>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:     <power_management/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:     <iommu support='no'/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:     <migration_features>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <live/>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       <uri_transports>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:         <uri_transport>tcp</uri_transport>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:         <uri_transport>rdma</uri_transport>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:       </uri_transports>
May 27 22:57:55.751097 np0000001565 nova-compute[98289]:     </migration_features>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:     <topology>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:       <cells num='1'>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:         <cell id='0'>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:           <memory unit='KiB'>24607192</memory>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:           <pages unit='KiB' size='4'>6151798</pages>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:           <pages unit='KiB' size='2048'>0</pages>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:           <pages unit='KiB' size='1048576'>0</pages>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:           <distances>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <sibling id='0' value='10'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:           </distances>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:           <cpus num='12'>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:           </cpus>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:         </cell>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:       </cells>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:     </topology>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:     <cache>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 27 22:57:55.752708 np0000001565 nova-compute[98289]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     </cache>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     <secmodel>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <model>apparmor</model>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <doi>0</doi>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     </secmodel>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     <secmodel>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <model>dac</model>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <doi>0</doi>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     </secmodel>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:   </host>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     <arch name='alpha'>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <wordsize>64</wordsize>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>clipper</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:     <arch name='armv6l'>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-8.2</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mori-bmc</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>ast2600-evb</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>borzoi</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>spitz</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.7</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>nuri</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>romulus-bmc</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-3.0</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-5.0</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>npcm750-evb</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.10</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>rainier-bmc</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps3-an547</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>musca-b1</machine>
May 27 22:57:55.753416 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>versatileab</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>kzm</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.8</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>fby35-bmc</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>musca-a</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-3.1</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-5.1</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>smdkc210</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sx1</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.11</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>imx25-pdk</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.9</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>orangepi-pc</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>z2</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-5.2</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>tosa</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an500</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.12</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mps2-an521</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>sabrelite</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an511</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>canon-a1100</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>realview-eb</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-7.0</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-4.0</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>raspi1ap</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sx1-v1</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>n810</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>g220a-bmc</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>n800</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-7.1</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 27 22:57:55.754395 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-4.1</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>quanta-gsj</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>versatilepb</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>terrier</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mainstone</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>integratorcp</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-7.2</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-4.2</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mps3-an524</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>kudo-bmc</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>vexpress-a9</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>midway</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>musicpal</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>lm3s811evb</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>microbit</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='3'>fby35</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an505</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an385</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-6.0</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-8.0</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>cubieboard</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>ast1030-evb</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>verdex</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>bpim2u</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>netduino2</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an386</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-6.1</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-8.1</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>raspi2b</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>vexpress-a15</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>fuji-bmc</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-6.2</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>cheetah</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.6</machine>
May 27 22:57:55.755131 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>ast2500-evb</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>highbank</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>akita</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>connex</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>netduinoplus2</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>collie</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>raspi0</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:     <arch name='armv7l'>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-8.2</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mori-bmc</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>ast2600-evb</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>borzoi</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>spitz</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.7</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>nuri</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>romulus-bmc</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-3.0</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-5.0</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>npcm750-evb</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.10</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>rainier-bmc</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps3-an547</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>musca-b1</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>versatileab</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>kzm</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.8</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>fby35-bmc</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>musca-a</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-3.1</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 27 22:57:55.755912 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-5.1</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>smdkc210</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sx1</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.11</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>imx25-pdk</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.9</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>orangepi-pc</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>z2</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-5.2</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>tosa</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an500</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.12</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mps2-an521</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>sabrelite</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an511</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>canon-a1100</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>realview-eb</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-7.0</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-4.0</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>raspi1ap</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sx1-v1</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>n810</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>g220a-bmc</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>n800</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-7.1</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-4.1</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>quanta-gsj</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>versatilepb</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>terrier</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mainstone</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>integratorcp</machine>
May 27 22:57:55.756740 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-7.2</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-4.2</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mps3-an524</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>kudo-bmc</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>vexpress-a9</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>midway</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>musicpal</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>lm3s811evb</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>microbit</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='3'>fby35</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an505</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an385</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-6.0</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-8.0</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>cubieboard</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>ast1030-evb</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>verdex</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>bpim2u</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>netduino2</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an386</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-6.1</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-8.1</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>raspi2b</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>vexpress-a15</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>fuji-bmc</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-6.2</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>cheetah</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.6</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>ast2500-evb</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>highbank</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>akita</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>connex</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>netduinoplus2</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>collie</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>raspi0</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 27 22:57:55.757445 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:     <arch name='aarch64'>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <wordsize>64</wordsize>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-8.2</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mori-bmc</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>ast2600-evb</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>borzoi</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>spitz</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.7</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>nuri</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>romulus-bmc</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-3.0</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-5.0</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>npcm750-evb</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.10</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>rainier-bmc</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps3-an547</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.8</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>musca-b1</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>versatileab</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>kzm</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>fby35-bmc</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>musca-a</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-3.1</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-5.1</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>smdkc210</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sx1</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.11</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>imx25-pdk</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.9</machine>
May 27 22:57:55.758279 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>orangepi-pc</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>z2</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-5.2</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>tosa</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an500</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.12</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mps2-an521</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>sabrelite</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an511</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>canon-a1100</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>realview-eb</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>sbsa-ref</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-7.0</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-4.0</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>raspi1ap</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sx1-v1</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>n810</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>g220a-bmc</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>n800</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-7.1</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-4.1</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>quanta-gsj</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>versatilepb</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>terrier</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mainstone</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>integratorcp</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-7.2</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-4.2</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 27 22:57:55.759187 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>mps3-an524</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>kudo-bmc</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>vexpress-a9</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>midway</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>musicpal</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>lm3s811evb</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>microbit</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='3'>fby35</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an505</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an385</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-6.0</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-8.0</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>raspi3ap</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>cubieboard</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>ast1030-evb</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>verdex</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>bpim2u</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>netduino2</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mps2-an386</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-6.1</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-8.1</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>raspi3b</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>raspi2b</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>vexpress-a15</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='2'>fuji-bmc</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt-6.2</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>cheetah</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>virt-2.6</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>ast2500-evb</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>highbank</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>akita</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>connex</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>netduinoplus2</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>collie</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>raspi0</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <acpi default='on' toggle='yes'/>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.759895 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:     <arch name='cris'>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>axis-dev88</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:     <arch name='i686'>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 27 22:57:55.760704 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>x-remote</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 27 22:57:55.761561 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>isapc</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 27 22:57:55.762231 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>microvm</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 27 22:57:55.762905 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <domain type='kvm'/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <pae/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <nonpae/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <acpi default='on' toggle='yes'/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <apic default='on' toggle='no'/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     <arch name='m68k'>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mcf5208evb</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virt-7.0</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>an5206</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virt-6.0</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>q800</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virt-8.1</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virt-7.2</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virt-6.2</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virt-8.0</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>next-cube</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virt-7.1</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virt-6.1</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virt-8.2</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     <arch name='microblaze'>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:     <arch name='microblazeel'>
May 27 22:57:55.763530 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <arch name='mips'>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='16'>malta</machine>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mipssim</machine>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <arch name='mipsel'>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='16'>malta</machine>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mipssim</machine>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <arch name='mips64'>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <wordsize>64</wordsize>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='16'>malta</machine>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mipssim</machine>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>pica61</machine>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>magnum</machine>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:     <arch name='mips64el'>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <wordsize>64</wordsize>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 27 22:57:55.764629 np0000001565 nova-compute[98289]:       <machine maxCpus='16'>malta</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='16'>loongson3-virt</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mipssim</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>pica61</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>magnum</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='16'>boston</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>fuloong2e</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:     <arch name='ppc'>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>g3beige</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>amigaone</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virtex-ml507</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mac99</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>ppce500</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sam460ex</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>pegasos2</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>bamboo</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>40p</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>ref405ep</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='15'>mpc8544ds</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:     <arch name='ppc64'>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <wordsize>64</wordsize>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-noble</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>amigaone</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='2048'>powernv9</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='15'>mpc8544ds</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 27 22:57:55.765870 np0000001565 nova-compute[98289]:       <machine maxCpus='2048'>powernv10</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>ppce500</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>40p</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>pegasos2</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>bamboo</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-focal</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>g3beige</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-disco</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virtex-ml507</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 27 22:57:55.767050 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mac99</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-impish</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-artful</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sam460ex</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>ref405ep</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='2048'>powernv8</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:     <arch name='ppc64le'>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <wordsize>64</wordsize>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-noble</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>amigaone</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='2048'>powernv9</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='15'>mpc8544ds</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='2048'>powernv10</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>ppce500</machine>
May 27 22:57:55.768165 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>40p</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>pegasos2</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>bamboo</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-focal</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>g3beige</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-disco</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>virtex-ml507</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>mac99</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-impish</machine>
May 27 22:57:55.769021 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-artful</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sam460ex</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>ref405ep</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='2048'>powernv8</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     <arch name='riscv32'>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='8'>spike</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>opentitan</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='5'>sifive_u</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sifive_e</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     <arch name='riscv64'>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <wordsize>64</wordsize>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='512'>virt</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='8'>spike</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='5'>sifive_u</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>shakti_c</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sifive_e</machine>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:     <arch name='s390x'>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <wordsize>64</wordsize>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 27 22:57:55.769639 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 27 22:57:55.770706 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     <arch name='sh4'>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>shix</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>r2d</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     <arch name='sh4eb'>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <wordsize>64</wordsize>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>shix</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>r2d</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:     <arch name='sparc'>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>SS-5</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>SS-20</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>LX</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>SPARCClassic</machine>
May 27 22:57:55.771621 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>leon3_generic</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>SPARCbook</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>SS-4</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>SS-600MP</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>SS-10</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>Voyager</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:     <arch name='sparc64'>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <wordsize>64</wordsize>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sun4u</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>niagara</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>sun4v</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:     <arch name='x86_64'>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <wordsize>64</wordsize>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 27 22:57:55.772627 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>x-remote</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 27 22:57:55.773537 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='1'>isapc</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 27 22:57:55.774641 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>microvm</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 27 22:57:55.775233 np0000001565 nova-compute[98289]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <domain type='kvm'/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <acpi default='on' toggle='yes'/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <apic default='on' toggle='no'/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:     <arch name='xtensa'>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>sim</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>kc705</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>ml605</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>ml605-nommu</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>virt</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>lx60-nommu</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>lx200</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>lx200-nommu</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>lx60</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>kc705-nommu</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:   <guest>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:     <os_type>hvm</os_type>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:     <arch name='xtensaeb'>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <wordsize>32</wordsize>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='4'>sim</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>kc705</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>ml605</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>ml605-nommu</machine>
May 27 22:57:55.775846 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>virt</machine>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>lx60-nommu</machine>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>lx200</machine>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>lx200-nommu</machine>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>lx60</machine>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <machine maxCpus='32'>kc705-nommu</machine>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <domain type='qemu'/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     </arch>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     <features>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <cpuselection/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <deviceboot/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <disksnapshot default='on' toggle='no'/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <externalSnapshot/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     </features>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   </guest>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]: </capabilities>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]: 
May 27 22:57:55.776803 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.776803 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 27 22:57:55.776803 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-alpha</path>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   <machine>clipper</machine>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   <arch>alpha</arch>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   <vcpu max='4'/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.776803 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.777984 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.779263 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.779263 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 27 22:57:55.779263 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-arm</path>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   <machine>virt-8.2</machine>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   <arch>armv6l</arch>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   <vcpu max='512'/>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.779263 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>max</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 27 22:57:55.780343 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.781102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <gic supported='yes'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       <enum name='version'>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>2</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:         <value>3</value>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     </gic>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.782194 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.783547 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 27 22:57:55.783547 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-arm</path>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:   <machine>virt-8.2</machine>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:   <arch>armv6l</arch>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:   <vcpu max='512'/>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 27 22:57:55.783547 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>max</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.784411 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.785133 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <gic supported='yes'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       <enum name='version'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>2</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>3</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     </gic>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.786397 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.786397 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 27 22:57:55.786397 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-arm</path>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:   <machine>virt-8.2</machine>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:   <arch>armv7l</arch>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:   <vcpu max='512'/>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <enum name='firmware'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       <value>efi</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.786397 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 27 22:57:55.787399 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>max</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.788063 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     <gic supported='yes'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       <enum name='version'>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>2</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:         <value>3</value>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.789065 np0000001565 nova-compute[98289]:     </gic>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.790345 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.790345 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 27 22:57:55.790345 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-aarch64</path>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:   <machine>virt-8.2</machine>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:   <arch>aarch64</arch>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:   <vcpu max='512'/>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <enum name='firmware'>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       <value>efi</value>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 27 22:57:55.790345 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>max</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 27 22:57:55.791149 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.791651 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:     <gic supported='yes'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:       <enum name='version'>
May 27 22:57:55.792723 np0000001565 nova-compute[98289]:         <value>2</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:         <value>3</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     </gic>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.793974 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.793974 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 27 22:57:55.793974 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-cris</path>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   <machine>axis-dev88</machine>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   <arch>cris</arch>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   <vcpu max='1'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.793974 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='model'/>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <redirdev supported='no'/>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='model'/>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.794920 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.796544 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.796544 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 27 22:57:55.796544 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-i386</path>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:   <machine>pc-q35-noble-v2</machine>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:   <arch>i686</arch>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:   <vcpu max='1024'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='yes'>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <model fallback='forbid'>EPYC</model>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <vendor>AMD</vendor>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <feature policy='require' name='acpi'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <feature policy='require' name='ss'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <feature policy='require' name='monitor'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <feature policy='require' name='hypervisor'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <feature policy='require' name='erms'/>
May 27 22:57:55.796544 np0000001565 nova-compute[98289]:       <feature policy='require' name='mpx'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='pcommit'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='clwb'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='umip'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='pku'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='vaes'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='la57'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='rdpid'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='pks'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrm'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='fzrm'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrs'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrc'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnowext'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnow'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='xsaveerptr'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='wbnoinvd'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='npt'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='vgif'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='require' name='svme-addr-chk'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='disable' name='vme'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='disable' name='xsavec'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='disable' name='fxsr_opt'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='disable' name='lm'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='disable' name='misalignsse'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='disable' name='osvw'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='disable' name='topoext'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <feature policy='disable' name='nrip-save'/>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='no' vendor='unknown'>qemu64</model>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='no' vendor='unknown'>kvm64</model>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>core2duo</model>
May 27 22:57:55.797562 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Penryn</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 22:57:55.798257 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Conroe</model>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>486</model>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>qxl</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.798899 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>tpm-crb</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <genid supported='yes'/>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.800004 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:     <hyperv supported='yes'>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <enum name='features'>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>relaxed</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>vapic</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>spinlocks</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>vpindex</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>runtime</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>synic</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>stimer</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>reset</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>vendor_id</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>frequencies</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>reenlightenment</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>tlbflush</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>ipi</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>avic</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:     </hyperv>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.801323 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 27 22:57:55.801323 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-i386</path>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:   <machine>pc-q35-noble</machine>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:   <arch>i686</arch>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:   <vcpu max='1024'/>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='yes'>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <model fallback='forbid'>EPYC</model>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <vendor>AMD</vendor>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <feature policy='require' name='acpi'/>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <feature policy='require' name='ss'/>
May 27 22:57:55.801323 np0000001565 nova-compute[98289]:       <feature policy='require' name='monitor'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='hypervisor'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='erms'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='mpx'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='pcommit'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='clwb'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='umip'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='pku'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='vaes'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='la57'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='rdpid'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='pks'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrm'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='fzrm'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrs'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrc'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnowext'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnow'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='xsaveerptr'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='wbnoinvd'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='npt'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='vgif'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='require' name='svme-addr-chk'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='disable' name='vme'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='disable' name='xsavec'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='disable' name='fxsr_opt'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='disable' name='lm'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='disable' name='misalignsse'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='disable' name='osvw'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='disable' name='topoext'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <feature policy='disable' name='nrip-save'/>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <model usable='no' vendor='unknown'>qemu64</model>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <model usable='no' vendor='unknown'>kvm64</model>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 22:57:55.802356 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>core2duo</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Penryn</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 22:57:55.803020 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Conroe</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>486</model>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>qxl</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.803536 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>tpm-crb</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.804542 np0000001565 nova-compute[98289]:     <genid supported='yes'/>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     <hyperv supported='yes'>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       <enum name='features'>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>relaxed</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>vapic</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>spinlocks</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>vpindex</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>runtime</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>synic</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>stimer</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>reset</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>vendor_id</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>frequencies</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>reenlightenment</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>tlbflush</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>ipi</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>avic</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     </hyperv>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.805951 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 27 22:57:55.805951 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-i386</path>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:   <machine>pc-i440fx-noble-v2</machine>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:   <arch>i686</arch>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:   <vcpu max='255'/>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='yes'>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       <model fallback='forbid'>EPYC</model>
May 27 22:57:55.805951 np0000001565 nova-compute[98289]:       <vendor>AMD</vendor>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='acpi'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='ss'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='monitor'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='hypervisor'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='erms'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='mpx'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='pcommit'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='clwb'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='umip'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='pku'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='vaes'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='la57'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='rdpid'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='pks'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrm'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='fzrm'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrs'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrc'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnowext'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnow'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='xsaveerptr'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='wbnoinvd'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='npt'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='vgif'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='require' name='svme-addr-chk'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='disable' name='vme'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='disable' name='xsavec'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='disable' name='fxsr_opt'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='disable' name='lm'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='disable' name='misalignsse'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='disable' name='osvw'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='disable' name='topoext'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <feature policy='disable' name='nrip-save'/>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <model usable='no' vendor='unknown'>qemu64</model>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 22:57:55.807095 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='unknown'>kvm64</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>core2duo</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Penryn</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 22:57:55.808065 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Conroe</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>486</model>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>ide</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.808645 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>qxl</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>tpm-crb</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.809696 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <genid supported='yes'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <hyperv supported='yes'>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       <enum name='features'>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>relaxed</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>vapic</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>spinlocks</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>vpindex</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>runtime</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>synic</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>stimer</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>reset</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>vendor_id</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>frequencies</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>reenlightenment</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>tlbflush</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>ipi</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>avic</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     </hyperv>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.811199 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 27 22:57:55.811199 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-i386</path>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   <machine>pc-i440fx-noble</machine>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   <arch>i686</arch>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   <vcpu max='255'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.811199 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='yes'>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <model fallback='forbid'>EPYC</model>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <vendor>AMD</vendor>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='acpi'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='ss'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='monitor'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='hypervisor'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='erms'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='mpx'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='pcommit'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='clwb'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='umip'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='pku'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='vaes'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='la57'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='rdpid'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='pks'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrm'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='fzrm'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrs'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrc'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnowext'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnow'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='xsaveerptr'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='wbnoinvd'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='npt'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='vgif'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='require' name='svme-addr-chk'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='disable' name='vme'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='disable' name='xsavec'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='disable' name='fxsr_opt'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='disable' name='lm'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='disable' name='misalignsse'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='disable' name='osvw'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='disable' name='topoext'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <feature policy='disable' name='nrip-save'/>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <model usable='no' vendor='unknown'>qemu64</model>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 22:57:55.812398 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='unknown'>kvm64</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>core2duo</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Penryn</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 22:57:55.813113 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Conroe</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>486</model>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>ide</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.813934 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>qxl</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>tpm-crb</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.815082 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     <genid supported='yes'/>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     <hyperv supported='yes'>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:       <enum name='features'>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>relaxed</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>vapic</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>spinlocks</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>vpindex</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>runtime</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>synic</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>stimer</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>reset</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>vendor_id</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>frequencies</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>reenlightenment</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>tlbflush</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>ipi</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>avic</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     </hyperv>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.816454 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.816454 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 27 22:57:55.816454 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-m68k</path>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:   <machine>mcf5208evb</machine>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:   <arch>m68k</arch>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:   <vcpu max='1'/>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.816454 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.817485 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <redirdev supported='no'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.818852 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 27 22:57:55.818852 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-m68k</path>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   <machine>virt-8.2</machine>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   <arch>m68k</arch>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   <vcpu max='1'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.818852 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <redirdev supported='no'/>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.820051 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.821415 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.821415 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 27 22:57:55.821415 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-microblaze</path>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   <machine>petalogix-s3adsp1800</machine>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   <arch>microblaze</arch>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   <vcpu max='1'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.821415 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='model'/>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <redirdev supported='no'/>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.822561 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       <enum name='model'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.824023 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.824023 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 27 22:57:55.824023 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   <machine>petalogix-s3adsp1800</machine>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   <arch>microblazeel</arch>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   <vcpu max='1'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.824023 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='model'/>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     <redirdev supported='no'/>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='model'/>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.825102 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.826620 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.826620 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 27 22:57:55.826620 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-mips</path>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   <machine>malta</machine>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   <arch>mips</arch>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   <vcpu max='16'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.826620 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>ide</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.828053 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.829670 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.829670 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 27 22:57:55.829670 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-mipsel</path>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:   <machine>malta</machine>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:   <arch>mipsel</arch>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:   <vcpu max='16'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.829670 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>ide</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.831114 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.832581 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.832581 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 27 22:57:55.832581 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-mips64</path>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:   <machine>malta</machine>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:   <arch>mips64</arch>
May 27 22:57:55.832581 np0000001565 nova-compute[98289]:   <vcpu max='16'/>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>ide</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.833797 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.835235 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.836554 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.836554 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 27 22:57:55.836554 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-mips64el</path>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   <machine>malta</machine>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   <arch>mips64el</arch>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   <vcpu max='16'/>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>ide</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.836554 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.837814 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.839408 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.839408 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 27 22:57:55.839408 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-ppc</path>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   <machine>g3beige</machine>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   <arch>ppc</arch>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   <vcpu max='1'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.839408 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>ide</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.840702 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.842410 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.842410 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 27 22:57:55.842410 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-ppc64</path>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   <machine>pseries-noble</machine>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   <arch>ppc64</arch>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   <vcpu max='4096'/>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.842410 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.843739 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>tpm-spapr</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>spapr-tpm-proxy</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.845294 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.846947 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 27 22:57:55.846947 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-ppc64</path>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   <machine>powernv9</machine>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   <arch>ppc64</arch>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   <vcpu max='2048'/>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.846947 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>tpm-spapr</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>spapr-tpm-proxy</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.848624 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.850166 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 27 22:57:55.850166 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-ppc64</path>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   <machine>pseries-noble</machine>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   <arch>ppc64</arch>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   <vcpu max='4096'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.850166 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.851513 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>tpm-spapr</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>spapr-tpm-proxy</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.853723 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.853723 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 27 22:57:55.853723 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.853723 np0000001565 nova-compute[98289]:   <machine>powernv9</machine>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:   <arch>ppc64le</arch>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:   <vcpu max='2048'/>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.855321 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>tpm-spapr</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>spapr-tpm-proxy</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.857306 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.859458 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 27 22:57:55.859458 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   <machine>pseries-noble</machine>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   <arch>ppc64le</arch>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   <vcpu max='4096'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.859458 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>tpm-spapr</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:         <value>spapr-tpm-proxy</value>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.861413 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.862691 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.862691 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 27 22:57:55.862691 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-riscv32</path>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:   <machine>virt</machine>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:   <arch>riscv32</arch>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:   <vcpu max='512'/>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.862691 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.863725 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.865556 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.866817 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.866817 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 27 22:57:55.866817 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-riscv64</path>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:   <machine>virt</machine>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:   <arch>riscv64</arch>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:   <vcpu max='512'/>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>any</model>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>max</model>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.866817 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.867788 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.869490 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.869490 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 27 22:57:55.869490 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-s390x</path>
May 27 22:57:55.869490 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:   <machine>s390-ccw-virtio-noble</machine>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:   <arch>s390x</arch>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:   <vcpu max='248'/>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z13</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z990.3</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z13-base</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z990.2</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z14</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z990.4</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z196</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z114-base</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>gen16b</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>gen16a</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z990.5</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z196.2</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>zEC12</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z9BC</model>
May 27 22:57:55.870623 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z890</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z13.2</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z14.2</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z196-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z990</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z14-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='IBM'>z800</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z10EC</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='IBM'>z900</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>max</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>gen15b</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>gen15a</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z114</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z13s</model>
May 27 22:57:55.871819 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z890.3</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z890.2</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z890-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z10BC</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z9EC</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>zBC12</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z990-base</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.872926 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <s390-pv supported='no'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.873896 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.875616 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.875616 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 27 22:57:55.875616 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-sh4</path>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   <machine>shix</machine>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   <arch>sh4</arch>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   <vcpu max='1'/>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.875616 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.877113 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.878687 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.878687 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 27 22:57:55.878687 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   <machine>shix</machine>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   <arch>sh4eb</arch>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   <vcpu max='1'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.878687 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.879680 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.881037 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.881037 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 27 22:57:55.881037 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-sparc</path>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   <machine>SS-5</machine>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   <arch>sparc</arch>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   <vcpu max='1'/>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.881037 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='model'/>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <redirdev supported='no'/>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.882362 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       <enum name='model'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.883607 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.883607 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 27 22:57:55.883607 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-sparc64</path>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   <machine>sun4u</machine>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   <arch>sparc64</arch>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   <vcpu max='1'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.883607 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>ide</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.884607 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.885878 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.885878 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 27 22:57:55.885878 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-x86_64</path>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:   <machine>pc-q35-noble-v2</machine>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:   <arch>x86_64</arch>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:   <vcpu max='1024'/>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <enum name='firmware'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       <value>efi</value>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.885878 np0000001565 nova-compute[98289]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='yes'>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <model fallback='forbid'>EPYC</model>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <vendor>AMD</vendor>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='acpi'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='ss'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='monitor'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='hypervisor'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='erms'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='mpx'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='pcommit'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='clwb'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='umip'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='pku'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='vaes'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='la57'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='rdpid'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='pks'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrm'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='fzrm'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrs'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrc'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnowext'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnow'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='xsaveerptr'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='wbnoinvd'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='npt'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='vgif'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='require' name='svme-addr-chk'/>
May 27 22:57:55.887186 np0000001565 nova-compute[98289]:       <feature policy='disable' name='vme'/>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <feature policy='disable' name='xsavec'/>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <feature policy='disable' name='fxsr_opt'/>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <feature policy='disable' name='misalignsse'/>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <feature policy='disable' name='osvw'/>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <feature policy='disable' name='topoext'/>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <feature policy='disable' name='nrip-save'/>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 22:57:55.888631 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>486</model>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889233 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>qxl</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:         <value>tpm-crb</value>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.889997 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <genid supported='yes'/>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     <hyperv supported='yes'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       <enum name='features'>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>relaxed</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>vapic</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>spinlocks</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>vpindex</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>runtime</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>synic</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>stimer</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>reset</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>vendor_id</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>frequencies</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>reenlightenment</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>tlbflush</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>ipi</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:         <value>avic</value>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:     </hyperv>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.891190 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 27 22:57:55.891190 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-x86_64</path>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:   <machine>pc-q35-noble</machine>
May 27 22:57:55.891190 np0000001565 nova-compute[98289]:   <arch>x86_64</arch>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:   <vcpu max='1024'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:     <enum name='firmware'>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <value>efi</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='yes'>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <model fallback='forbid'>EPYC</model>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <vendor>AMD</vendor>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='acpi'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='ss'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='monitor'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='hypervisor'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='erms'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='mpx'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='pcommit'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='clwb'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='umip'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='pku'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='vaes'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='la57'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='rdpid'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='pks'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrm'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='fzrm'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrs'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrc'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnowext'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnow'/>
May 27 22:57:55.892620 np0000001565 nova-compute[98289]:       <feature policy='require' name='xsaveerptr'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <feature policy='require' name='wbnoinvd'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <feature policy='require' name='npt'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <feature policy='require' name='vgif'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <feature policy='require' name='svme-addr-chk'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <feature policy='disable' name='vme'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <feature policy='disable' name='xsavec'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <feature policy='disable' name='fxsr_opt'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <feature policy='disable' name='misalignsse'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <feature policy='disable' name='osvw'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <feature policy='disable' name='topoext'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <feature policy='disable' name='nrip-save'/>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 22:57:55.893730 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>486</model>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.894297 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>qxl</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.895047 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>tpm-crb</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <genid supported='yes'/>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     <hyperv supported='yes'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       <enum name='features'>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>relaxed</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>vapic</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>spinlocks</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>vpindex</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>runtime</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>synic</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>stimer</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>reset</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>vendor_id</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>frequencies</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>reenlightenment</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>tlbflush</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>ipi</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:         <value>avic</value>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:     </hyperv>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.896318 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.897655 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 27 22:57:55.897655 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-x86_64</path>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:   <machine>pc-i440fx-noble-v2</machine>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:   <arch>x86_64</arch>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:   <vcpu max='255'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:     <enum name='firmware'>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <value>efi</value>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='yes'>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <model fallback='forbid'>EPYC</model>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <vendor>AMD</vendor>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='acpi'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='ss'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='monitor'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='hypervisor'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='erms'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='mpx'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='pcommit'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='clwb'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='umip'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='pku'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='vaes'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='la57'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='rdpid'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='pks'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrm'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='fzrm'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrs'/>
May 27 22:57:55.897655 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrc'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnowext'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnow'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='require' name='xsaveerptr'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='require' name='wbnoinvd'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='require' name='npt'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='require' name='vgif'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='require' name='svme-addr-chk'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='disable' name='vme'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='disable' name='xsavec'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='disable' name='fxsr_opt'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='disable' name='misalignsse'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='disable' name='osvw'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='disable' name='topoext'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <feature policy='disable' name='nrip-save'/>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 22:57:55.898706 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 22:57:55.899342 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>486</model>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>ide</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>qxl</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.899894 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>tpm-crb</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <genid supported='yes'/>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     <hyperv supported='yes'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       <enum name='features'>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>relaxed</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>vapic</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>spinlocks</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>vpindex</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>runtime</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>synic</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>stimer</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>reset</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>vendor_id</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>frequencies</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>reenlightenment</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>tlbflush</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>ipi</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:         <value>avic</value>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:     </hyperv>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.901166 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.902580 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 27 22:57:55.902580 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-x86_64</path>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:   <machine>pc-i440fx-noble</machine>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:   <arch>x86_64</arch>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:   <vcpu max='255'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:     <enum name='firmware'>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <value>efi</value>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='yes'>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <enum name='maximumMigratable'>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:         <value>on</value>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:         <value>off</value>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='yes'>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <model fallback='forbid'>EPYC</model>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <vendor>AMD</vendor>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='acpi'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='ss'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='monitor'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='hypervisor'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='erms'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='mpx'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='pcommit'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='clwb'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='umip'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='pku'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='vaes'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='la57'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='rdpid'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='pks'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrm'/>
May 27 22:57:55.902580 np0000001565 nova-compute[98289]:       <feature policy='require' name='fzrm'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrs'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='require' name='fsrc'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnowext'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='require' name='3dnow'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='require' name='xsaveerptr'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='require' name='wbnoinvd'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='require' name='npt'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='require' name='vgif'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='require' name='svme-addr-chk'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='disable' name='vme'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='disable' name='xsavec'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='disable' name='fxsr_opt'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='disable' name='misalignsse'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='disable' name='osvw'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='disable' name='topoext'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <feature policy='disable' name='nrip-save'/>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:     <mode name='custom' supported='yes'>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 22:57:55.903692 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 22:57:55.904389 np0000001565 nova-compute[98289]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <model usable='yes' vendor='unknown'>486</model>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     </mode>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>ide</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>vmvga</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>qxl</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>ramfb</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.905056 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <tpm supported='yes'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>tpm-tis</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>tpm-crb</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>passthrough</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>emulator</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>external</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       <enum name='backendVersion'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>1.2</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>2.0</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     </tpm>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='yes'/>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <genid supported='yes'/>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:     <hyperv supported='yes'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       <enum name='features'>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>relaxed</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>vapic</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>spinlocks</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>vpindex</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>runtime</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>synic</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>stimer</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>reset</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>vendor_id</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>frequencies</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>reenlightenment</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>tlbflush</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>ipi</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:         <value>avic</value>
May 27 22:57:55.906492 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:     </hyperv>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.907776 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.907776 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 27 22:57:55.907776 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-xtensa</path>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   <machine>sim</machine>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   <arch>xtensa</arch>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   <vcpu max='4'/>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.907776 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.908876 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.910135 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98289) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 22:57:55.910135 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 27 22:57:55.910135 np0000001565 nova-compute[98289]: <domainCapabilities>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   <domain>qemu</domain>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   <machine>sim</machine>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   <arch>xtensaeb</arch>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   <vcpu max='4'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   <iothreads supported='yes'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   <os supported='yes'>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <enum name='firmware'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <loader supported='yes'>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:         <value>rom</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:         <value>pflash</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       <enum name='readonly'>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:         <value>yes</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       <enum name='secure'>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:         <value>no</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     </loader>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   </os>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   <cpu>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <mode name='host-passthrough' supported='no'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <mode name='maximum' supported='no'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <mode name='host-model' supported='no'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <mode name='custom' supported='no'/>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   </cpu>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   <memoryBacking supported='yes'>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     <enum name='sourceType'>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       <value>file</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       <value>anonymous</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:       <value>memfd</value>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:     </enum>
May 27 22:57:55.910135 np0000001565 nova-compute[98289]:   </memoryBacking>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:   <devices>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     <disk supported='yes'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='diskDevice'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>disk</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>cdrom</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>floppy</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>lun</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>fdc</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>sata</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     </disk>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     <graphics supported='yes'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>sdl</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>vnc</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>spice</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>egl-headless</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>dbus</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     </graphics>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     <video supported='yes'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='modelType'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>vga</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>cirrus</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>none</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>bochs</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     </video>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     <hostdev supported='yes'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='mode'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>subsystem</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='startupPolicy'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>default</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>mandatory</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>requisite</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>optional</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='subsysType'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>pci</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>scsi</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='capsType'/>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='pciBackend'/>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     </hostdev>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     <rng supported='yes'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>virtio-transitional</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>virtio-non-transitional</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>random</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>egd</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     </rng>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     <filesystem supported='yes'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       <enum name='driverType'>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>path</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>handle</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:         <value>virtiofs</value>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     </filesystem>
May 27 22:57:55.911167 np0000001565 nova-compute[98289]:     <tpm supported='no'/>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     <redirdev supported='yes'>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:       <enum name='bus'>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:         <value>usb</value>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     </redirdev>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     <channel supported='yes'>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:         <value>pty</value>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:         <value>unix</value>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:         <value>spicevmc</value>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     </channel>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     <crypto supported='yes'>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:       <enum name='model'>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:         <value>virtio</value>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:       <enum name='type'>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:         <value>qemu</value>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:       <enum name='backendModel'>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:         <value>builtin</value>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:       </enum>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     </crypto>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:   </devices>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:   <features>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     <gic supported='no'/>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     <vmcoreinfo supported='no'/>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     <genid supported='no'/>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     <backingStoreInput supported='yes'/>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     <backup supported='yes'/>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     <async-teardown supported='yes'/>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     <sev supported='no'/>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:     <sgx supported='no'/>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:   </features>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]: </domainCapabilities>
May 27 22:57:55.912488 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 22:57:55.912488 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Checking secure boot support for host arch (x86_64) {{(pid=98289) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 27 22:57:55.912488 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Secure Boot support detected
May 27 22:57:56.362808 np0000001565 nova-compute[98289]: INFO nova.virt.node [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Generated node identity 6afc4609-00ff-4946-93f6-3f759c4c1e43
May 27 22:57:56.363095 np0000001565 nova-compute[98289]: INFO nova.virt.node [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Wrote node identity 6afc4609-00ff-4946-93f6-3f759c4c1e43 to /opt/stack/data/nova/compute_id
May 27 22:57:56.865627 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Compute nodes ['6afc4609-00ff-4946-93f6-3f759c4c1e43'] for host np0000001565 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 27 22:57:57.870279 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 27 22:57:58.874575 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] No compute node record found for host np0000001565. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001565 could not be found.
May 27 22:57:58.875015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 22:57:58.875015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 22:57:58.875015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 22:57:58.875106 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 22:57:58.930639 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 22:57:58.931342 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 22:57:58.948483 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] CMD "env LANG=C uptime" returned: 0 in 0.017s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 22:57:58.948843 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Hypervisor/Node resource view: name=np0000001565 free_ram=16531MB free_disk=75.22636795043945GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 22:57:58.948972 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 22:57:58.949193 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 22:57:59.451702 np0000001565 nova-compute[98289]: WARNING nova.compute.resource_tracker [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] No compute node record for np0000001565:6afc4609-00ff-4946-93f6-3f759c4c1e43: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6afc4609-00ff-4946-93f6-3f759c4c1e43 could not be found.
May 27 22:57:59.955711 np0000001565 nova-compute[98289]: INFO nova.compute.resource_tracker [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Compute node record created for np0000001565:np0000001565 with uuid: 6afc4609-00ff-4946-93f6-3f759c4c1e43
May 27 22:58:01.462706 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 22:58:01.463111 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 22:57:58 up 26 min,  2 users,  load average: 2.53, 1.54, 0.77\n'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 22:58:01.919697 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] [req-d8f538ba-9408-4fe0-9953-d0683bde2638] Created resource provider record via placement API for resource provider with UUID 6afc4609-00ff-4946-93f6-3f759c4c1e43 and name np0000001565.
May 27 22:58:01.974933 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] /sys/module/kvm_amd/parameters/sev contains [N
May 27 22:58:01.974933 np0000001565 nova-compute[98289]: ] {{(pid=98289) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 27 22:58:01.975120 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.host [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] kernel doesn't support AMD SEV
May 27 22:58:01.975316 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 22:58:01.975542 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Updating inventory in ProviderTree for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 22:58:01.975882 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 22:58:01.979849 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Libvirt baseline CPU <cpu>
May 27 22:58:01.979849 np0000001565 nova-compute[98289]:   <arch>x86_64</arch>
May 27 22:58:01.979849 np0000001565 nova-compute[98289]:   <model>Nehalem</model>
May 27 22:58:01.979849 np0000001565 nova-compute[98289]:   <vendor>AMD</vendor>
May 27 22:58:01.979849 np0000001565 nova-compute[98289]:   <topology sockets="12" cores="1" threads="1"/>
May 27 22:58:01.979849 np0000001565 nova-compute[98289]:   <maxphysaddr mode="emulate" bits="40"/>
May 27 22:58:01.979849 np0000001565 nova-compute[98289]: </cpu>
May 27 22:58:01.979849 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 27 22:58:02.551363 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Updated inventory for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 27 22:58:02.551363 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Updating resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 generation from 0 to 1 during operation: update_inventory {{(pid=98289) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 27 22:58:02.551363 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Updating inventory in ProviderTree for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 22:58:02.692417 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Updating resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 generation from 1 to 2 during operation: update_traits {{(pid=98289) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 27 22:58:03.199093 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 22:58:03.199267 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.250s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 22:58:03.199490 np0000001565 nova-compute[98289]: DEBUG nova.service [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98289) start /opt/stack/nova/nova/service.py:195}}
May 27 22:58:03.215600 np0000001565 nova-compute[98289]: DEBUG nova.service [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98289) start /opt/stack/nova/nova/service.py:211}}
May 27 22:58:03.227937 np0000001565 nova-compute[98289]: DEBUG nova.service [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] Join ServiceGroup membership for this service compute {{(pid=98289) start /opt/stack/nova/nova/service.py:221}}
May 27 22:58:03.228159 np0000001565 nova-compute[98289]: DEBUG nova.servicegroup.drivers.db [None req-cb77248a-f51f-4224-aa45-83512ba3557f None None] DB_Driver: join new ServiceGroup member np0000001565 to the compute group, service = <Service: host=np0000001565, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98289) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 27 22:58:08.731625 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 22:58:54.229759 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:58:54.230371 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:58:54.230371 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:58:54.230547 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:58:54.230742 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:58:54.230927 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:58:54.231112 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:58:54.734674 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:58:54.734886 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 22:58:54.735060 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:58:55.238172 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 22:58:55.238629 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 22:58:55.238629 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 22:58:55.238629 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 22:58:55.245895 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 22:58:55.246656 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 22:58:55.260673 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 22:58:55.261145 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=16254MB free_disk=75.07406234741211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 22:58:55.261309 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 22:58:55.261602 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 22:58:56.316208 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 22:58:56.316664 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 22:58:55 up 27 min,  2 users,  load average: 1.57, 1.43, 0.78\n'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 22:58:56.357412 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 22:58:56.357679 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 22:58:56.860280 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 22:58:57.366238 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 22:58:57.366755 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.105s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 22:58:57.366755 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:58:57.367596 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.89 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 22:59:46.254950 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:59:46.255426 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:59:46.255426 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:59:46.255426 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:59:46.255590 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:59:46.255730 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:59:46.255879 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:59:46.256063 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:59:46.256171 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 22:59:46.256348 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 22:59:46.759468 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 22:59:46.759685 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 22:59:46.759853 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 22:59:46.760020 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 22:59:46.767061 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 22:59:46.767821 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 22:59:46.782056 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 22:59:46.782453 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=16283MB free_disk=74.95204162597656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 22:59:46.782615 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 22:59:46.782895 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 22:59:47.832010 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 22:59:47.832558 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 22:59:46 up 28 min,  2 users,  load average: 1.19, 1.35, 0.79\n'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 22:59:47.872302 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 22:59:47.872604 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 22:59:48.375732 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 22:59:48.881658 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 22:59:48.882141 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.099s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 22:59:48.882810 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:00:08.733978 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:00:15.773577 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:15.773577 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:16.274922 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:00:16.867884 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:16.868352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:16.870421 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:00:16.870592 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Claim successful on node np0000001565
May 27 23:00:17.996253 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:00:17.996253 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:00:18.495044 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:00:19.002114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.134s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:19.002835 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:00:19.510590 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:00:19.512346 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:00:19.512346 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:19.514111 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:20.016572 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:00:20.520170 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:00:20.690119 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d33b630152d4b96949f3afbb65d7115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe372c67374c55bd40d7757474f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:00:21.526357 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:00:21.527685 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:00:21.527812 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Creating image(s)
May 27 23:00:21.528537 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:21.528718 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:21.529644 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:21.530109 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:21.530962 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:21.812664 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:21.814994 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:21.815299 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d.part --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:21.881868 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d.part --force-share --output=json" returned: 0 in 0.066s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:21.882529 np0000001565 nova-compute[98289]: DEBUG nova.virt.images [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] 6300a9f9-2b54-4283-b976-5a0c9409f522 was qcow2, converting to raw {{(pid=98289) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 23:00:21.883309 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:00:21.883716 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d.part /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d.converted {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:22.006812 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d.part /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d.converted" returned: 0 in 0.123s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:22.013448 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d.converted --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:22.091083 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d.converted --force-share --output=json" returned: 0 in 0.077s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:22.092187 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.560s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:22.092187 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:22.095661 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:22.096544 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy4j1bvvk/privsep.sock']
May 27 23:00:22.103428 np0000001565 sudo[109507]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy4j1bvvk/privsep.sock
May 27 23:00:22.104071 np0000001565 sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 27 23:00:22.334785 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 27 23:00:22.334930 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 23:00:22.334930 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 23:00:22.335056 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:00:22.335100 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 23:00:22.335159 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 23:00:22.335208 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 23:00:22.335283 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:00:22.335348 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 27 23:00:22.633296 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 27 23:00:22.633296 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 23:00:22.633296 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 23:00:22.633296 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:00:22.633296 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 23:00:22.633296 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 23:00:22.633296 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 23:00:22.633296 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:00:22.633296 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 27 23:00:22.860394 np0000001565 sudo[109507]: pam_unix(sudo:session): session closed for user root
May 27 23:00:22.861738 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Spawned new privsep daemon via rootwrap
May 27 23:00:22.863039 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 27 23:00:22.863174 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 27 23:00:22.863276 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 27 23:00:22.863395 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109511
May 27 23:00:22.922126 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:22.988839 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.066s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:22.989476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:22.989531 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:22.989940 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:22.992281 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:22.992784 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:23.063745 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.071s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:23.064302 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:23.093831 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk 1073741824" returned: 0 in 0.029s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:23.094266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.105s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:23.094580 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:23.155516 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.061s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:23.155961 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:00:23.156178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:23.213105 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json" returned: 0 in 0.057s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:23.213497 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Cannot resize image /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:00:23.214039 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:00:23.214195 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Ensure instance console log exists: /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:00:23.214463 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:23.214683 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:23.214794 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:23.970605 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Successfully created port: c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:00:25.305321 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Successfully updated port: c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:00:25.807788 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:25.807996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquired lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:25.808131 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:00:26.046398 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:26.046398 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:26.546610 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7dad446e-2102-4483-a75c-6300bc23dbb2 req-04d7ffd1-1a0a-4b24-bb0d-618b3bd74139 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-changed-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:26.547047 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7dad446e-2102-4483-a75c-6300bc23dbb2 req-04d7ffd1-1a0a-4b24-bb0d-618b3bd74139 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Refreshing instance network info cache due to event network-changed-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:26.547047 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7dad446e-2102-4483-a75c-6300bc23dbb2 req-04d7ffd1-1a0a-4b24-bb0d-618b3bd74139 service nova] Acquiring lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:26.548722 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:00:26.617472 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:27.099984 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:27.100163 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:27.102833 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:00:27.102989 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Claim successful on node np0000001565
May 27 23:00:27.640415 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:27.640960 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:27.880584 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:28.142329 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:00:28.297307 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:00:28.297762 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:00:28.404874 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Updating instance_info_cache with network_info: [{"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:28.688656 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:28.801171 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:00:28.906912 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Releasing lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:28.907134 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Instance network_info: |[{"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:00:28.907375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7dad446e-2102-4483-a75c-6300bc23dbb2 req-04d7ffd1-1a0a-4b24-bb0d-618b3bd74139 service nova] Acquired lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:28.907498 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7dad446e-2102-4483-a75c-6300bc23dbb2 req-04d7ffd1-1a0a-4b24-bb0d-618b3bd74139 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Refreshing network info cache for port c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:28.909972 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Start _get_guest_xml network_info=[{"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:00:28.915825 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:00:28.915825 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2120896372', uuid='119d02f0-0974-4fa4-9d6a-ecfefe01e029'), owner=OwnerMeta(userid='8d33b630152d4b96949f3afbb65d7115', username='tempest-ServerRescueNegativeTestJSON-550001831-project-member', projectid='7efe372c67374c55bd40d7757474f80a', projectname='tempest-ServerRescueNegativeTestJSON-550001831'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922828.9143183) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:00:28.917545 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:00:28.917545 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:00:28.918787 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:00:28.919009 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:00:28.920713 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:00:28.920713 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:00:28.920852 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:00:28.920852 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:00:28.920995 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:00:28.921129 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:00:28.921240 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:00:28.921446 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:00:28.921552 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:00:28.922118 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:00:28.922211 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:00:28.922349 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:00:28.936220 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:00:28.938157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2120896372',display_name='tempest-ServerRescueNegativeTestJSON-server-2120896372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-2120896372',id=1,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-8c5lw0uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:21Z,user_data=None,user_id='8d33b630152d4b96949f3afbb65d7115',uuid=119d02f0-0974-4fa4-9d6a-ecfefe01e029,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:00:28.938157 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:28.939399 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b7:7a,bridge_name='br-int',has_traffic_filtering=True,id=c2e9f6b2-ff45-449c-89c3-b661ae2ee33a,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e9f6b2-ff') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:28.940582 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'pci_devices' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:00:29.053935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "a0070282-e138-405c-b6c8-3478991d03f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:29.054141 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:29.307663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.207s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:29.308372 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.620s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:29.308548 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:00:29.313548 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:00:29.313715 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Claim successful on node np0000001565
May 27 23:00:29.412053 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7dad446e-2102-4483-a75c-6300bc23dbb2 req-04d7ffd1-1a0a-4b24-bb0d-618b3bd74139 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:29.447589 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] End _get_guest_xml xml=<domain type="qemu">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <uuid>119d02f0-0974-4fa4-9d6a-ecfefe01e029</uuid>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <name>instance-00000001</name>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2120896372</nova:name>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:00:28</nova:creationTime>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:user uuid="8d33b630152d4b96949f3afbb65d7115">tempest-ServerRescueNegativeTestJSON-550001831-project-member</nova:user>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:project uuid="7efe372c67374c55bd40d7757474f80a">tempest-ServerRescueNegativeTestJSON-550001831</nova:project>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         <nova:port uuid="c2e9f6b2-ff45-449c-89c3-b661ae2ee33a">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <system>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <entry name="serial">119d02f0-0974-4fa4-9d6a-ecfefe01e029</entry>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <entry name="uuid">119d02f0-0974-4fa4-9d6a-ecfefe01e029</entry>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     </system>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <os>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   </os>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <features>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   </features>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   <devices>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.config"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:9e:b7:7a"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <target dev="tapc2e9f6b2-ff"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     </interface>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/console.log" append="off"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     </serial>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <video>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     </video>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     </rng>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:   </devices>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]: </domain>
May 27 23:00:29.447589 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:00:29.449779 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Preparing to wait for external event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:00:29.449779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:29.449779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:29.449779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:29.449779 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2120896372',display_name='tempest-ServerRescueNegativeTestJSON-server-2120896372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-2120896372',id=1,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-8c5lw0uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:21Z,user_data=None,user_id='8d33b630152d4b96949f3afbb65d7115',uuid=119d02f0-0974-4fa4-9d6a-ecfefe01e029,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:00:29.450310 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:29.450310 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b7:7a,bridge_name='br-int',has_traffic_filtering=True,id=c2e9f6b2-ff45-449c-89c3-b661ae2ee33a,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e9f6b2-ff') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:29.450310 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b7:7a,bridge_name='br-int',has_traffic_filtering=True,id=c2e9f6b2-ff45-449c-89c3-b661ae2ee33a,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e9f6b2-ff') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:00:29.490365 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Created schema index Interface.name {{(pid=98289) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 27 23:00:29.490502 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Created schema index Port.name {{(pid=98289) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 27 23:00:29.490587 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Created schema index Bridge.name {{(pid=98289) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 27 23:00:29.490925 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:00:29.491080 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [POLLOUT] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:29.491148 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:00:29.491763 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:29.492878 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:29.510607 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:29.544975 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:29.544975 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:29.544975 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:00:29.545832 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:29.546041 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff3813db-4e34-5c66-ba84-574b63f8a155', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:29.548088 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:29.548727 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:29.551170 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpeaioyvyk/privsep.sock']
May 27 23:00:29.557480 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:00:29.558100 np0000001565 sudo[109632]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpeaioyvyk/privsep.sock
May 27 23:00:29.558728 np0000001565 sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 27 23:00:29.797171 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 27 23:00:29.797583 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 23:00:29.797583 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 23:00:29.797583 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:00:29.797583 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 23:00:29.797583 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 23:00:29.797583 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 23:00:29.797792 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:00:29.797792 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 27 23:00:29.821495 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:00:29.821495 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:00:29.821495 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:29.821620 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:30.013204 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Acquiring lock "3438591d-5ed5-45ed-8875-256372fc8333" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:30.013411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "3438591d-5ed5-45ed-8875-256372fc8333" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:30.112220 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:30.132141 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 27 23:00:30.132214 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 23:00:30.132214 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 23:00:30.132262 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:00:30.132294 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 23:00:30.132378 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 23:00:30.132455 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 23:00:30.132514 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:00:30.132549 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 27 23:00:30.281313 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d33b630152d4b96949f3afbb65d7115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe372c67374c55bd40d7757474f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:00:30.312471 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7dad446e-2102-4483-a75c-6300bc23dbb2 req-04d7ffd1-1a0a-4b24-bb0d-618b3bd74139 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:30.323917 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:00:30.349870 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Spawned new privsep daemon via rootwrap
May 27 23:00:30.347966 np0000001565 sudo[109632]: pam_unix(sudo:session): session closed for user root
May 27 23:00:30.351611 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 27 23:00:30.352223 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 27 23:00:30.352223 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 27 23:00:30.352223 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109643
May 27 23:00:30.515436 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:00:30.615942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:30.615942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2e9f6b2-ff, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:30.615942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2e9f6b2-ff, col_values=(('qos', UUID('b77c1a3e-75a5-40e5-8866-7759ca0eae2d')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:30.615942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2e9f6b2-ff, col_values=(('external_ids', {'iface-id': 'c2e9f6b2-ff45-449c-89c3-b661ae2ee33a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:b7:7a', 'vm-uuid': '119d02f0-0974-4fa4-9d6a-ecfefe01e029'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:30.617876 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:30.619693 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:30.623207 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:30.623840 np0000001565 nova-compute[98289]: INFO os_vif [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b7:7a,bridge_name='br-int',has_traffic_filtering=True,id=c2e9f6b2-ff45-449c-89c3-b661ae2ee33a,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e9f6b2-ff')
May 27 23:00:30.651498 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:00:30.651698 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:00:30.784480 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Successfully created port: 4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:00:30.829317 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:00:30.929914 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7dad446e-2102-4483-a75c-6300bc23dbb2 req-04d7ffd1-1a0a-4b24-bb0d-618b3bd74139 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Updated VIF entry in instance network info cache for port c2e9f6b2-ff45-449c-89c3-b661ae2ee33a. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:00:30.929914 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7dad446e-2102-4483-a75c-6300bc23dbb2 req-04d7ffd1-1a0a-4b24-bb0d-618b3bd74139 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Updating instance_info_cache with network_info: [{"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:31.072184 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:31.153984 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:00:31.432681 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7dad446e-2102-4483-a75c-6300bc23dbb2 req-04d7ffd1-1a0a-4b24-bb0d-618b3bd74139 service nova] Releasing lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:31.520322 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.357s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.555s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Claim successful on node np0000001565
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Creating image(s)
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:31.989728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:31.991258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:31.991258 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:31.991258 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:31.991258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:31.991258 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Successfully updated port: 4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:00:31.991258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.073s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:31.991258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:31.991258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:31.991258 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:31.991258 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:31.991258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:32.011001 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:32.011419 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:32.037857 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:00:32.046141 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-53d61662-5e19-4dd9-93a2-2962f5d4c758 req-a2b34803-b492-4da2-81a0-07c3fdc9b0e8 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-changed-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:32.046602 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-53d61662-5e19-4dd9-93a2-2962f5d4c758 req-a2b34803-b492-4da2-81a0-07c3fdc9b0e8 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Refreshing instance network info cache due to event network-changed-4dc65314-8dc9-4ca6-a74b-2cb818efd866. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:32.046833 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-53d61662-5e19-4dd9-93a2-2962f5d4c758 req-a2b34803-b492-4da2-81a0-07c3fdc9b0e8 service nova] Acquiring lock "refresh_cache-489adb12-811c-408c-af3f-24edcfc9d4bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:32.046921 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-53d61662-5e19-4dd9-93a2-2962f5d4c758 req-a2b34803-b492-4da2-81a0-07c3fdc9b0e8 service nova] Acquired lock "refresh_cache-489adb12-811c-408c-af3f-24edcfc9d4bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:32.047037 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-53d61662-5e19-4dd9-93a2-2962f5d4c758 req-a2b34803-b492-4da2-81a0-07c3fdc9b0e8 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Refreshing network info cache for port 4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:32.052927 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk 1073741824" returned: 0 in 0.041s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:32.054291 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.131s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:32.054652 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:32.097088 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:00:32.133438 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:32.133983 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:00:32.134298 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:32.151158 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:32.151306 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:32.151479 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No VIF found with MAC fa:16:3e:9e:b7:7a, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:00:32.152225 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Using config drive
May 27 23:00:32.172465 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:00:32.172465 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:00:32.172728 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:32.172961 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:32.210434 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:32.210852 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Cannot resize image /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:00:32.211235 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:00:32.211449 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Ensure instance console log exists: /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:00:32.211787 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:32.212064 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:32.212269 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:32.242490 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7581bdc53e7e463a8b5951ed443d106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3864f7301d84dbdbbb57d5a3ff0d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:00:32.414847 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "refresh_cache-489adb12-811c-408c-af3f-24edcfc9d4bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:32.549654 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-53d61662-5e19-4dd9-93a2-2962f5d4c758 req-a2b34803-b492-4da2-81a0-07c3fdc9b0e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:32.623528 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:32.659982 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:32.667009 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:32.679448 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:00:32.723107 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-53d61662-5e19-4dd9-93a2-2962f5d4c758 req-a2b34803-b492-4da2-81a0-07c3fdc9b0e8 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:32.805885 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Successfully created port: 7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:00:32.881092 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:33.102819 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Creating config drive at /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.config
May 27 23:00:33.105907 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:00:33.106153 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:00:33.111354 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpde8fe0hh {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:33.142531 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpde8fe0hh" returned: 0 in 0.034s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:33.181168 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:00:33.205272 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-53d61662-5e19-4dd9-93a2-2962f5d4c758 req-a2b34803-b492-4da2-81a0-07c3fdc9b0e8 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:33.354758 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Successfully updated port: 7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:00:33.582661 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:33.606429 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:33.611067 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:00:33.688555 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:33.692902 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:33.709031 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-53d61662-5e19-4dd9-93a2-2962f5d4c758 req-a2b34803-b492-4da2-81a0-07c3fdc9b0e8 service nova] Releasing lock "refresh_cache-489adb12-811c-408c-af3f-24edcfc9d4bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:33.709031 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquired lock "refresh_cache-489adb12-811c-408c-af3f-24edcfc9d4bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:33.709031 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:00:33.856654 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:33.856756 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquired lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:33.856880 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:00:33.899929 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dd2bd199-2c80-4f5b-a12e-92042cfbd9fa req-c3728beb-8265-4ace-ac8b-82858bac6fbe service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-changed-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:33.900048 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dd2bd199-2c80-4f5b-a12e-92042cfbd9fa req-c3728beb-8265-4ace-ac8b-82858bac6fbe service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Refreshing instance network info cache due to event network-changed-7faf9be9-b21d-441b-9e09-9c236e1f9fb5. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:33.900178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd2bd199-2c80-4f5b-a12e-92042cfbd9fa req-c3728beb-8265-4ace-ac8b-82858bac6fbe service nova] Acquiring lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:33.926643 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:34.117283 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.450s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:34.117733 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:00:34.120793 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.049s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:34.126284 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:00:34.129357 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Claim successful on node np0000001565
May 27 23:00:34.194265 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:00:34.195459 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:00:34.195674 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Creating image(s)
May 27 23:00:34.196126 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:34.196288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:34.197359 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:34.198156 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:34.200662 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:34.201622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:34.269062 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.067s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:34.270417 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:34.270865 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:34.271258 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:34.273816 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:34.274187 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:34.320873 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:34.347462 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.073s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:34.347999 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:34.385265 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk 1073741824" returned: 0 in 0.037s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:34.386297 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.115s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:34.386785 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:34.435967 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779922834.4353826, 119d02f0-0974-4fa4-9d6a-ecfefe01e029 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:34.436567 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] VM Started (Lifecycle Event)
May 27 23:00:34.469024 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:34.469925 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:00:34.469925 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:34.488178 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:34.542733 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:34.545254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:34.546679 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Cannot resize image /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:00:34.546956 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:00:34.547116 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Ensure instance console log exists: /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:00:34.547365 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:34.547605 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:34.547733 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:34.626164 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:00:34.626430 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:00:34.628830 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:34.628830 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:34.709113 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Updating instance_info_cache with network_info: [{"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:34.724795 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:34.740921 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d2e5dcd70eb4347bb621fac87c3c384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e563b54a24044564bd9f42d080e21b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:00:34.876628 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Updating instance_info_cache with network_info: [{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:34.942624 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:34.945004 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922834.9447, 119d02f0-0974-4fa4-9d6a-ecfefe01e029 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:34.945121 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] VM Paused (Lifecycle Event)
May 27 23:00:35.131029 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 27 23:00:35.211917 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Releasing lock "refresh_cache-489adb12-811c-408c-af3f-24edcfc9d4bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:35.211917 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Instance network_info: |[{"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:00:35.213596 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Start _get_guest_xml network_info=[{"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:00:35.216457 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:00:35.217592 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-602165631', uuid='489adb12-811c-408c-af3f-24edcfc9d4bb'), owner=OwnerMeta(userid='8d33b630152d4b96949f3afbb65d7115', username='tempest-ServerRescueNegativeTestJSON-550001831-project-member', projectid='7efe372c67374c55bd40d7757474f80a', projectname='tempest-ServerRescueNegativeTestJSON-550001831'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922835.2172108) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:00:35.218292 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:00:35.218614 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:00:35.219560 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:00:35.219728 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:00:35.220610 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:00:35.220907 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:00:35.221310 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:00:35.221428 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:00:35.221569 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:00:35.221653 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:00:35.221742 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:00:35.221885 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:00:35.221990 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:00:35.222455 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:00:35.222611 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:00:35.222736 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:00:35.232947 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-602165631',display_name='tempest-ServerRescueNegativeTestJSON-server-602165631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-602165631',id=2,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-0koevn0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:31Z,user_data=None,user_id='8d33b630152d4b96949f3afbb65d7115',uuid=489adb12-811c-408c-af3f-24edcfc9d4bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:00:35.233238 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:35.233893 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=4dc65314-8dc9-4ca6-a74b-2cb818efd866,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc65314-8d') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:35.234530 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'pci_devices' on Instance uuid 489adb12-811c-408c-af3f-24edcfc9d4bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:00:35.379318 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Releasing lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:35.379551 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Instance network_info: |[{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:00:35.381378 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Start _get_guest_xml network_info=[{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:00:35.381634 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd2bd199-2c80-4f5b-a12e-92042cfbd9fa req-c3728beb-8265-4ace-ac8b-82858bac6fbe service nova] Acquired lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:35.381802 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dd2bd199-2c80-4f5b-a12e-92042cfbd9fa req-c3728beb-8265-4ace-ac8b-82858bac6fbe service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Refreshing network info cache for port 7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:35.386610 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:00:35.387581 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1581082659', uuid='13686e4c-ae8e-4837-a71f-2d710575ab33'), owner=OwnerMeta(userid='7581bdc53e7e463a8b5951ed443d106a', username='tempest-TaggedAttachmentsTest-637545634-project-member', projectid='a3864f7301d84dbdbbb57d5a3ff0d764', projectname='tempest-TaggedAttachmentsTest-637545634'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922835.387284) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:00:35.389122 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:00:35.389466 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:00:35.390500 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:00:35.390754 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:00:35.391618 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:00:35.391914 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:00:35.392067 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:00:35.392193 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:00:35.392323 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:00:35.397373 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:00:35.397516 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:00:35.397710 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:00:35.399057 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:00:35.399206 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:00:35.399368 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:00:35.399935 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:00:35.407652 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Successfully created port: 3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:00:35.414014 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1581082659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1581082659',id=3,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbXJ25uvRq+YEKR1kzxedf9FvXb2eZ7io19cQ3tAnPpWU1tiaY+f+xttFfQpCrSUW1ryPIO60u8KO1pLzAlayI1KKlUoQpfHOPvHJtzvGfeubKnVhz74qMUmiGcKUUEGw==',key_name='tempest-keypair-853654392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3864f7301d84dbdbbb57d5a3ff0d764',ramdisk_id='',reservation_id='r-2wuc69yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-637545634',owner_user_name='tempest-TaggedAttachmentsTest-637545634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7581bdc53e7e463a8b5951ed443d106a',uuid=13686e4c-ae8e-4837-a71f-2d710575ab33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:00:35.414229 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converting VIF {"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:35.414910 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:c5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7faf9be9-b21d-441b-9e09-9c236e1f9fb5,network=Network(63487ad6-2950-4acd-82d9-2e79cefe2d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7faf9be9-b2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:35.415732 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lazy-loading 'pci_devices' on Instance uuid 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:00:35.449122 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:35.453543 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:35.584013 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:00:35.584226 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:00:35.617349 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.637466 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:00:35.738723 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] End _get_guest_xml xml=<domain type="qemu">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <uuid>489adb12-811c-408c-af3f-24edcfc9d4bb</uuid>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <name>instance-00000002</name>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-602165631</nova:name>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:00:35</nova:creationTime>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:user uuid="8d33b630152d4b96949f3afbb65d7115">tempest-ServerRescueNegativeTestJSON-550001831-project-member</nova:user>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:project uuid="7efe372c67374c55bd40d7757474f80a">tempest-ServerRescueNegativeTestJSON-550001831</nova:project>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         <nova:port uuid="4dc65314-8dc9-4ca6-a74b-2cb818efd866">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <system>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <entry name="serial">489adb12-811c-408c-af3f-24edcfc9d4bb</entry>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <entry name="uuid">489adb12-811c-408c-af3f-24edcfc9d4bb</entry>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     </system>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <os>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   </os>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <features>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   </features>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   <devices>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.config"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:67:1b:a1"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <target dev="tap4dc65314-8d"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     </interface>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/console.log" append="off"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     </serial>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <video>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     </video>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     </rng>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:   </devices>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]: </domain>
May 27 23:00:35.738723 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:00:35.738723 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Preparing to wait for external event network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:00:35.738723 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:35.738723 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:35.740533 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:35.740584 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-602165631',display_name='tempest-ServerRescueNegativeTestJSON-server-602165631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-602165631',id=2,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-0koevn0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:31Z,user_data=None,user_id='8d33b630152d4b96949f3afbb65d7115',uuid=489adb12-811c-408c-af3f-24edcfc9d4bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:00:35.741352 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:35.741713 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=4dc65314-8dc9-4ca6-a74b-2cb818efd866,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc65314-8d') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:35.742100 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=4dc65314-8dc9-4ca6-a74b-2cb818efd866,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc65314-8d') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:00:35.743293 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.743293 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:35.743293 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:00:35.744360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.747742 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '007dc2b7-9a94-5731-a1a5-0b814f8f2c4b', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:35.748929 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.749413 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:35.755619 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.755619 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dc65314-8d, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:35.755619 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dc65314-8d, col_values=(('qos', UUID('792c39c2-d0ee-4176-971d-ab3c038b3610')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:35.755619 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dc65314-8d, col_values=(('external_ids', {'iface-id': '4dc65314-8dc9-4ca6-a74b-2cb818efd866', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:1b:a1', 'vm-uuid': '489adb12-811c-408c-af3f-24edcfc9d4bb'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:35.757168 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.758217 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:35.765588 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.767258 np0000001565 nova-compute[98289]: INFO os_vif [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=4dc65314-8dc9-4ca6-a74b-2cb818efd866,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc65314-8d')
May 27 23:00:35.888954 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-dd2bd199-2c80-4f5b-a12e-92042cfbd9fa req-c3728beb-8265-4ace-ac8b-82858bac6fbe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:35.918708 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] End _get_guest_xml xml=<domain type="qemu">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <uuid>13686e4c-ae8e-4837-a71f-2d710575ab33</uuid>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <name>instance-00000003</name>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <nova:name>tempest-device-tagging-server-1581082659</nova:name>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:00:35</nova:creationTime>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:user uuid="7581bdc53e7e463a8b5951ed443d106a">tempest-TaggedAttachmentsTest-637545634-project-member</nova:user>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:project uuid="a3864f7301d84dbdbbb57d5a3ff0d764">tempest-TaggedAttachmentsTest-637545634</nova:project>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         <nova:port uuid="7faf9be9-b21d-441b-9e09-9c236e1f9fb5">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <system>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <entry name="serial">13686e4c-ae8e-4837-a71f-2d710575ab33</entry>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <entry name="uuid">13686e4c-ae8e-4837-a71f-2d710575ab33</entry>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     </system>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <os>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   </os>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <features>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   </features>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   <devices>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk.config"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:38:c5:3a"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <target dev="tap7faf9be9-b2"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     </interface>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/console.log" append="off"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     </serial>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <video>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     </video>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     </rng>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:   </devices>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]: </domain>
May 27 23:00:35.918708 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:00:35.920534 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Preparing to wait for external event network-vif-plugged-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:00:35.920534 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:35.920534 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:35.920534 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:35.920534 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1581082659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1581082659',id=3,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbXJ25uvRq+YEKR1kzxedf9FvXb2eZ7io19cQ3tAnPpWU1tiaY+f+xttFfQpCrSUW1ryPIO60u8KO1pLzAlayI1KKlUoQpfHOPvHJtzvGfeubKnVhz74qMUmiGcKUUEGw==',key_name='tempest-keypair-853654392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3864f7301d84dbdbbb57d5a3ff0d764',ramdisk_id='',reservation_id='r-2wuc69yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-637545634',owner_user_name='tempest-TaggedAttachmentsTest-637545634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7581bdc53e7e463a8b5951ed443d106a',uuid=13686e4c-ae8e-4837-a71f-2d710575ab33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:00:35.920725 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converting VIF {"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:35.920725 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:c5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7faf9be9-b21d-441b-9e09-9c236e1f9fb5,network=Network(63487ad6-2950-4acd-82d9-2e79cefe2d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7faf9be9-b2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:35.921821 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:c5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7faf9be9-b21d-441b-9e09-9c236e1f9fb5,network=Network(63487ad6-2950-4acd-82d9-2e79cefe2d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7faf9be9-b2') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:00:35.921821 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.921920 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:35.923686 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:00:35.923686 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.923970 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9833e1fa-94c7-5428-a504-5a35a2305db8', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:35.925109 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:35.933145 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.936176 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.936380 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7faf9be9-b2, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:35.936709 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7faf9be9-b2, col_values=(('qos', UUID('c653b299-f4d9-49bc-b9c5-cd651c863221')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:35.936859 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7faf9be9-b2, col_values=(('external_ids', {'iface-id': '7faf9be9-b21d-441b-9e09-9c236e1f9fb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:c5:3a', 'vm-uuid': '13686e4c-ae8e-4837-a71f-2d710575ab33'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:35.939402 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.943357 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:35.953043 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:35.954125 np0000001565 nova-compute[98289]: INFO os_vif [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:c5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7faf9be9-b21d-441b-9e09-9c236e1f9fb5,network=Network(63487ad6-2950-4acd-82d9-2e79cefe2d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7faf9be9-b2')
May 27 23:00:35.957446 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:00:36.017085 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Successfully updated port: 3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:00:36.084180 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f6e176b9-d51e-4aa6-81ee-c4c369e40bbe req-faea2a65-4ac2-4abc-87e0-eb5ebb9ec6b9 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Received event network-changed-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:36.084390 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f6e176b9-d51e-4aa6-81ee-c4c369e40bbe req-faea2a65-4ac2-4abc-87e0-eb5ebb9ec6b9 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Refreshing instance network info cache due to event network-changed-3d3cda67-acda-4008-ad58-dc64f4eb2c8b. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:36.084671 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f6e176b9-d51e-4aa6-81ee-c4c369e40bbe req-faea2a65-4ac2-4abc-87e0-eb5ebb9ec6b9 service nova] Acquiring lock "refresh_cache-a0070282-e138-405c-b6c8-3478991d03f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:36.084808 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f6e176b9-d51e-4aa6-81ee-c4c369e40bbe req-faea2a65-4ac2-4abc-87e0-eb5ebb9ec6b9 service nova] Acquired lock "refresh_cache-a0070282-e138-405c-b6c8-3478991d03f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:36.085191 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f6e176b9-d51e-4aa6-81ee-c4c369e40bbe req-faea2a65-4ac2-4abc-87e0-eb5ebb9ec6b9 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Refreshing network info cache for port 3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:36.087047 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:00:36.301467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:36.310674 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:36.314619 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:36.338495 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-dd2bd199-2c80-4f5b-a12e-92042cfbd9fa req-c3728beb-8265-4ace-ac8b-82858bac6fbe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:36.341695 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:36.351682 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:36.492201 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dd2bd199-2c80-4f5b-a12e-92042cfbd9fa req-c3728beb-8265-4ace-ac8b-82858bac6fbe service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Updated VIF entry in instance network info cache for port 7faf9be9-b21d-441b-9e09-9c236e1f9fb5. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:00:36.492515 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dd2bd199-2c80-4f5b-a12e-92042cfbd9fa req-c3728beb-8265-4ace-ac8b-82858bac6fbe service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Updating instance_info_cache with network_info: [{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:36.518956 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "refresh_cache-a0070282-e138-405c-b6c8-3478991d03f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:36.600824 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f6e176b9-d51e-4aa6-81ee-c4c369e40bbe req-faea2a65-4ac2-4abc-87e0-eb5ebb9ec6b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:36.604095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.484s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:36.604457 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:00:36.607241 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.984s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:36.611263 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:00:36.611606 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Claim successful on node np0000001565
May 27 23:00:36.648676 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:00:36.649559 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:00:36.649798 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Creating image(s)
May 27 23:00:36.650213 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:36.650417 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "/opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:36.651381 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "/opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:36.651497 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "7dfc4347f9d1d5788a7eb45332b5599c94d05f74" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:36.651834 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "7dfc4347f9d1d5788a7eb45332b5599c94d05f74" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:36.675419 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f6e176b9-d51e-4aa6-81ee-c4c369e40bbe req-faea2a65-4ac2-4abc-87e0-eb5ebb9ec6b9 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:36.873755 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f6e176b9-d51e-4aa6-81ee-c4c369e40bbe req-faea2a65-4ac2-4abc-87e0-eb5ebb9ec6b9 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:36.994347 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd2bd199-2c80-4f5b-a12e-92042cfbd9fa req-c3728beb-8265-4ace-ac8b-82858bac6fbe service nova] Releasing lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:37.111766 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:00:37.111766 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:00:37.112066 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:37.116900 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:37.225729 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84fd5efd52f1407cbb4aafaba4744bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17fb0c9be4c4d30bd907eb08e2c5e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:00:37.285428 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:37.285428 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:37.285428 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No VIF found with MAC fa:16:3e:67:1b:a1, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:00:37.285951 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Using config drive
May 27 23:00:37.375874 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f6e176b9-d51e-4aa6-81ee-c4c369e40bbe req-faea2a65-4ac2-4abc-87e0-eb5ebb9ec6b9 service nova] Releasing lock "refresh_cache-a0070282-e138-405c-b6c8-3478991d03f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:37.376421 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquired lock "refresh_cache-a0070282-e138-405c-b6c8-3478991d03f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:37.376635 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:00:37.468260 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:37.470744 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:37.471082 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74.part --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:37.482022 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:37.482256 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:37.482502 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] No VIF found with MAC fa:16:3e:38:c5:3a, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:00:37.483646 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Using config drive
May 27 23:00:37.552919 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74.part --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:37.553397 np0000001565 nova-compute[98289]: DEBUG nova.virt.images [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] cb03b116-09bf-4cbd-b55b-28b84e40d106 was qcow2, converting to raw {{(pid=98289) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 23:00:37.554121 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:00:37.554499 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74.part /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74.converted {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:37.619317 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:00:37.691253 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74.part /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74.converted" returned: 0 in 0.137s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:37.700130 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74.converted --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:37.780142 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74.converted --force-share --output=json" returned: 0 in 0.080s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:37.780802 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "7dfc4347f9d1d5788a7eb45332b5599c94d05f74" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.129s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:37.781387 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:37.788381 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:37.789890 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:37.793982 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:37.811871 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Successfully created port: c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:00:37.869053 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74 --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:37.873973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "7dfc4347f9d1d5788a7eb45332b5599c94d05f74" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:37.875224 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "7dfc4347f9d1d5788a7eb45332b5599c94d05f74" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:37.875699 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:37.878277 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:37.878610 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:37.889470 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:37.957305 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74 --force-share --output=json" returned: 0 in 0.078s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:37.959914 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74,backing_fmt=raw /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:37.994072 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:38.001647 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74,backing_fmt=raw /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk 1073741824" returned: 0 in 0.042s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:38.002089 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "7dfc4347f9d1d5788a7eb45332b5599c94d05f74" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.127s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:38.002316 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:38.083997 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7dfc4347f9d1d5788a7eb45332b5599c94d05f74 --force-share --output=json" returned: 0 in 0.081s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:38.086797 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:00:38.087019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:38.125289 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:00:38.142124 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:00:38.142458 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:00:38.174490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:38.175162 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Cannot resize image /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:00:38.175564 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:00:38.175746 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Ensure instance console log exists: /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:00:38.176008 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:38.176188 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:38.176342 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:38.506532 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:38.532475 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Creating config drive at /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.config
May 27 23:00:38.535973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6g8r2uqc {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:38.567712 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6g8r2uqc" returned: 0 in 0.031s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:38.647390 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:00:38.663068 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Successfully updated port: c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:00:38.704415 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Creating config drive at /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk.config
May 27 23:00:38.708203 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpalvwqy3b {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:38.735863 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpalvwqy3b" returned: 0 in 0.027s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:38.850818 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:38.983031 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Updating instance_info_cache with network_info: [{"id": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "address": "fa:16:3e:f7:29:8e", "network": {"id": "dc1c8145-c753-4e29-8f29-a3eb6dad6e3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-218840385-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e563b54a24044564bd9f42d080e21b90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3cda67-ac", "ovs_interfaceid": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:39.079227 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.108359 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.137070 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:00:39.141455 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:00:39.141829 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Creating image(s)
May 27 23:00:39.142567 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Acquiring lock "/opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:39.146136 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "/opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:39.146136 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "/opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:39.147086 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:39.150082 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:39.151643 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:39.163006 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.555s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:39.163979 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:00:39.168894 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.502s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:39.170066 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Acquiring lock "refresh_cache-3438591d-5ed5-45ed-8875-256372fc8333" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:39.170244 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Acquired lock "refresh_cache-3438591d-5ed5-45ed-8875-256372fc8333" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:39.170571 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:00:39.177152 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:00:39.179279 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Claim successful on node np0000001565
May 27 23:00:39.244839 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:39.245257 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:39.246944 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:39.246944 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:39.248963 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:39.251761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:39.272024 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.277937 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3346cddd-101f-491d-9439-bdcf8c008b3a req-9dc3ba51-36e6-4e4b-ab3d-67793a6d429e service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Received event network-changed-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:39.277937 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3346cddd-101f-491d-9439-bdcf8c008b3a req-9dc3ba51-36e6-4e4b-ab3d-67793a6d429e service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Refreshing instance network info cache due to event network-changed-c75229d6-c711-4185-80fd-07e0cc9702c0. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:39.278125 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3346cddd-101f-491d-9439-bdcf8c008b3a req-9dc3ba51-36e6-4e4b-ab3d-67793a6d429e service nova] Acquiring lock "refresh_cache-3438591d-5ed5-45ed-8875-256372fc8333" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:39.279161 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.325798 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.075s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:39.326212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:39.359117 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk 1073741824" returned: 0 in 0.033s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:39.359667 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.114s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:39.360816 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:39.376486 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.392126 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-427840ad-34e0-4c4c-a5a6-4e386d6f9e28 req-d6778a84-0dd8-4ffb-8898-d84640e47a8f service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-vif-unplugged-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:39.392364 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-427840ad-34e0-4c4c-a5a6-4e386d6f9e28 req-d6778a84-0dd8-4ffb-8898-d84640e47a8f service nova] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:39.392544 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-427840ad-34e0-4c4c-a5a6-4e386d6f9e28 req-d6778a84-0dd8-4ffb-8898-d84640e47a8f service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:39.392668 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-427840ad-34e0-4c4c-a5a6-4e386d6f9e28 req-d6778a84-0dd8-4ffb-8898-d84640e47a8f service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:39.392795 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-427840ad-34e0-4c4c-a5a6-4e386d6f9e28 req-d6778a84-0dd8-4ffb-8898-d84640e47a8f service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] No event matching network-vif-unplugged-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 in dict_keys([('network-vif-plugged', '7faf9be9-b21d-441b-9e09-9c236e1f9fb5')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:00:39.392963 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-427840ad-34e0-4c4c-a5a6-4e386d6f9e28 req-d6778a84-0dd8-4ffb-8898-d84640e47a8f service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received unexpected event network-vif-unplugged-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 for instance with vm_state building and task_state spawning.
May 27 23:00:39.401839 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.434099 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.073s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:39.434573 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:00:39.434916 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:39.487036 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Releasing lock "refresh_cache-a0070282-e138-405c-b6c8-3478991d03f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:39.487508 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Instance network_info: |[{"id": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "address": "fa:16:3e:f7:29:8e", "network": {"id": "dc1c8145-c753-4e29-8f29-a3eb6dad6e3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-218840385-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e563b54a24044564bd9f42d080e21b90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3cda67-ac", "ovs_interfaceid": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:00:39.489178 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Start _get_guest_xml network_info=[{"id": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "address": "fa:16:3e:f7:29:8e", "network": {"id": "dc1c8145-c753-4e29-8f29-a3eb6dad6e3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-218840385-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e563b54a24044564bd9f42d080e21b90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3cda67-ac", "ovs_interfaceid": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T23:00:19Z,direct_url=<?>,disk_format='qcow2',id=cb03b116-09bf-4cbd-b55b-28b84e40d106,min_disk=0,min_ram=0,name='',owner='9b22699a130041109946e2d37c57afd8',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T23:00:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'scsi', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'image_id': 'cb03b116-09bf-4cbd-b55b-28b84e40d106'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:00:39.496299 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:00:39.497633 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='cb03b116-09bf-4cbd-b55b-28b84e40d106', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-1003707978', uuid='a0070282-e138-405c-b6c8-3478991d03f6'), owner=OwnerMeta(userid='1d2e5dcd70eb4347bb621fac87c3c384', username='tempest-AttachSCSIVolumeTestJSON-1209336345-project-member', projectid='e563b54a24044564bd9f42d080e21b90', projectname='tempest-AttachSCSIVolumeTestJSON-1209336345'), image=ImageMeta(id='cb03b116-09bf-4cbd-b55b-28b84e40d106', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "address": "fa:16:3e:f7:29:8e", "network": {"id": "dc1c8145-c753-4e29-8f29-a3eb6dad6e3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-218840385-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e563b54a24044564bd9f42d080e21b90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3cda67-ac", "ovs_interfaceid": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922839.4972517) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:00:39.498545 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk --force-share --output=json" returned: 0 in 0.063s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:39.498597 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Cannot resize image /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:00:39.498872 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:00:39.499035 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Ensure instance console log exists: /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:00:39.499323 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:39.499567 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:39.499741 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:39.501362 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:00:39.501662 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:00:39.503819 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:00:39.503862 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:00:39.504784 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:00:39.505089 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T23:00:19Z,direct_url=<?>,disk_format='qcow2',id=cb03b116-09bf-4cbd-b55b-28b84e40d106,min_disk=0,min_ram=0,name='',owner='9b22699a130041109946e2d37c57afd8',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T23:00:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:00:39.505206 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:00:39.505285 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:00:39.505485 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:00:39.505521 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:00:39.506112 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:00:39.506640 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:00:39.506640 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:00:39.506640 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:00:39.506640 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:00:39.507102 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:00:39.514529 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.520026 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1003707978',display_name='tempest-AttachSCSIVolumeTestJSON-server-1003707978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachscsivolumetestjson-server-1003707978',id=4,image_ref='cb03b116-09bf-4cbd-b55b-28b84e40d106',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMyf/XkZMCQHyXHzKyP4pq68sVrNxZvaLjJ5gGwn+Tjm2XE1xRp5nXR8DeEnP6sYCfWRmSG8PEgcxYSDkqiRAHb3SomPF1/kwFWLGmRzWmdljCM7zHld5hmPZTcvO8U7Q==',key_name='tempest-keypair-1982468598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e563b54a24044564bd9f42d080e21b90',ramdisk_id='',reservation_id='r-g6rvsvrt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cb03b116-09bf-4cbd-b55b-28b84e40d106',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1209336345',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1209336345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d2e5dcd70eb4347bb621fac87c3c384',uuid=a0070282-e138-405c-b6c8-3478991d03f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "address": "fa:16:3e:f7:29:8e", "network": {"id": "dc1c8145-c753-4e29-8f29-a3eb6dad6e3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-218840385-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e563b54a24044564bd9f42d080e21b90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3cda67-ac", "ovs_interfaceid": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:00:39.520026 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Converting VIF {"id": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "address": "fa:16:3e:f7:29:8e", "network": {"id": "dc1c8145-c753-4e29-8f29-a3eb6dad6e3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-218840385-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e563b54a24044564bd9f42d080e21b90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3cda67-ac", "ovs_interfaceid": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:39.520823 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:29:8e,bridge_name='br-int',has_traffic_filtering=True,id=3d3cda67-acda-4008-ad58-dc64f4eb2c8b,network=Network(dc1c8145-c753-4e29-8f29-a3eb6dad6e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3cda67-ac') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:39.521553 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lazy-loading 'pci_devices' on Instance uuid a0070282-e138-405c-b6c8-3478991d03f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:00:39.529443 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.635002 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.681599 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:00:39.681599 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:00:39.681599 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:39.681854 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:39.836699 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6f43a4e43324b67b74b5a65d12cbcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e334950e7c432ca356cbe67e72c44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:00:39.846326 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.847985 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.850047 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.869071 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:39.897544 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:40.026038 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] End _get_guest_xml xml=<domain type="qemu">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <uuid>a0070282-e138-405c-b6c8-3478991d03f6</uuid>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <name>instance-00000004</name>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1003707978</nova:name>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:00:39</nova:creationTime>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <nova:image uuid="cb03b116-09bf-4cbd-b55b-28b84e40d106">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:user uuid="1d2e5dcd70eb4347bb621fac87c3c384">tempest-AttachSCSIVolumeTestJSON-1209336345-project-member</nova:user>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:project uuid="e563b54a24044564bd9f42d080e21b90">tempest-AttachSCSIVolumeTestJSON-1209336345</nova:project>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="cb03b116-09bf-4cbd-b55b-28b84e40d106"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         <nova:port uuid="3d3cda67-acda-4008-ad58-dc64f4eb2c8b">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <system>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <entry name="serial">a0070282-e138-405c-b6c8-3478991d03f6</entry>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <entry name="uuid">a0070282-e138-405c-b6c8-3478991d03f6</entry>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     </system>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <os>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   </os>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <features>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   </features>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   <devices>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <target dev="sda" bus="scsi"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <address type="drive" controller="0" unit="0"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk.config"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <target dev="sdb" bus="scsi"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <address type="drive" controller="0" unit="1"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:f7:29:8e"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <target dev="tap3d3cda67-ac"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     </interface>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/console.log" append="off"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     </serial>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <video>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     </video>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     </rng>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:   </devices>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]: </domain>
May 27 23:00:40.026038 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:00:40.026038 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Preparing to wait for external event network-vif-plugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:00:40.026038 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "a0070282-e138-405c-b6c8-3478991d03f6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:40.026038 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:40.028946 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:40.028946 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1003707978',display_name='tempest-AttachSCSIVolumeTestJSON-server-1003707978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachscsivolumetestjson-server-1003707978',id=4,image_ref='cb03b116-09bf-4cbd-b55b-28b84e40d106',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMyf/XkZMCQHyXHzKyP4pq68sVrNxZvaLjJ5gGwn+Tjm2XE1xRp5nXR8DeEnP6sYCfWRmSG8PEgcxYSDkqiRAHb3SomPF1/kwFWLGmRzWmdljCM7zHld5hmPZTcvO8U7Q==',key_name='tempest-keypair-1982468598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e563b54a24044564bd9f42d080e21b90',ramdisk_id='',reservation_id='r-g6rvsvrt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cb03b116-09bf-4cbd-b55b-28b84e40d106',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1209336345',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1209336345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d2e5dcd70eb4347bb621fac87c3c384',uuid=a0070282-e138-405c-b6c8-3478991d03f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "address": "fa:16:3e:f7:29:8e", "network": {"id": "dc1c8145-c753-4e29-8f29-a3eb6dad6e3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-218840385-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e563b54a24044564bd9f42d080e21b90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3cda67-ac", "ovs_interfaceid": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:00:40.028946 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Converting VIF {"id": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "address": "fa:16:3e:f7:29:8e", "network": {"id": "dc1c8145-c753-4e29-8f29-a3eb6dad6e3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-218840385-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e563b54a24044564bd9f42d080e21b90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3cda67-ac", "ovs_interfaceid": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:40.029131 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:29:8e,bridge_name='br-int',has_traffic_filtering=True,id=3d3cda67-acda-4008-ad58-dc64f4eb2c8b,network=Network(dc1c8145-c753-4e29-8f29-a3eb6dad6e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3cda67-ac') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:40.029131 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:29:8e,bridge_name='br-int',has_traffic_filtering=True,id=3d3cda67-acda-4008-ad58-dc64f4eb2c8b,network=Network(dc1c8145-c753-4e29-8f29-a3eb6dad6e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3cda67-ac') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:00:40.030378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:40.030378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:40.030378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:00:40.032930 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:40.032930 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91f07538-5e0f-5759-b527-23725550dfcb', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:40.033665 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:40.034994 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:40.037388 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:40.039653 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:40.040139 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d3cda67-ac, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:40.040260 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d3cda67-ac, col_values=(('qos', UUID('c0098dfc-0ae7-4a46-bfe2-e381846cab3e')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:40.041541 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d3cda67-ac, col_values=(('external_ids', {'iface-id': '3d3cda67-acda-4008-ad58-dc64f4eb2c8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:29:8e', 'vm-uuid': 'a0070282-e138-405c-b6c8-3478991d03f6'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:40.043009 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:40.044352 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:40.048565 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:40.049368 np0000001565 nova-compute[98289]: INFO os_vif [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:29:8e,bridge_name='br-int',has_traffic_filtering=True,id=3d3cda67-acda-4008-ad58-dc64f4eb2c8b,network=Network(dc1c8145-c753-4e29-8f29-a3eb6dad6e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3cda67-ac')
May 27 23:00:40.197611 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:00:40.314275 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922840.313925, 13686e4c-ae8e-4837-a71f-2d710575ab33 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:40.314457 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] VM Started (Lifecycle Event)
May 27 23:00:40.605075 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:00:40.605631 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:00:40.708504 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:00:40.817674 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:40.823418 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922840.8227897, 13686e4c-ae8e-4837-a71f-2d710575ab33 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:40.823418 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] VM Paused (Lifecycle Event)
May 27 23:00:41.028377 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Successfully created port: 1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:00:41.045231 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:41.108019 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:00:41.165916 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:41.298485 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Updating instance_info_cache with network_info: [{"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:41.327379 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:41.328470 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:41.473609 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c1fa5ce6-150a-4759-9740-526b066b5279 req-5e16d4df-c0be-4370-9a63-0e259569643e service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-vif-plugged-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:41.473609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c1fa5ce6-150a-4759-9740-526b066b5279 req-5e16d4df-c0be-4370-9a63-0e259569643e service nova] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:41.473609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c1fa5ce6-150a-4759-9740-526b066b5279 req-5e16d4df-c0be-4370-9a63-0e259569643e service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:41.473609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c1fa5ce6-150a-4759-9740-526b066b5279 req-5e16d4df-c0be-4370-9a63-0e259569643e service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:41.473883 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c1fa5ce6-150a-4759-9740-526b066b5279 req-5e16d4df-c0be-4370-9a63-0e259569643e service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Processing event network-vif-plugged-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:00:41.473883 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c1fa5ce6-150a-4759-9740-526b066b5279 req-5e16d4df-c0be-4370-9a63-0e259569643e service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-vif-plugged-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:41.474001 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c1fa5ce6-150a-4759-9740-526b066b5279 req-5e16d4df-c0be-4370-9a63-0e259569643e service nova] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:41.474154 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c1fa5ce6-150a-4759-9740-526b066b5279 req-5e16d4df-c0be-4370-9a63-0e259569643e service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:41.474296 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c1fa5ce6-150a-4759-9740-526b066b5279 req-5e16d4df-c0be-4370-9a63-0e259569643e service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:41.474467 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c1fa5ce6-150a-4759-9740-526b066b5279 req-5e16d4df-c0be-4370-9a63-0e259569643e service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] No waiting events found dispatching network-vif-plugged-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:00:41.474891 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c1fa5ce6-150a-4759-9740-526b066b5279 req-5e16d4df-c0be-4370-9a63-0e259569643e service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received unexpected event network-vif-plugged-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 for instance with vm_state building and task_state spawning.
May 27 23:00:41.475460 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:00:41.481524 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:00:41.484843 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Instance spawned successfully.
May 27 23:00:41.485559 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:00:41.570683 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] No BDM found with device name sda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:41.570830 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:41.570976 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] No VIF found with MAC fa:16:3e:f7:29:8e, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:00:41.572028 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Using config drive
May 27 23:00:41.615522 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.447s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:41.615992 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:00:41.726571 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:00:41.727686 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:00:41.728023 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Creating image(s)
May 27 23:00:41.728455 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "/opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:41.729865 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "/opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:41.730606 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "/opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:41.731126 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:41.737284 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:41.740788 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:41.802251 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Releasing lock "refresh_cache-3438591d-5ed5-45ed-8875-256372fc8333" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:41.803038 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Instance network_info: |[{"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:00:41.803829 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3346cddd-101f-491d-9439-bdcf8c008b3a req-9dc3ba51-36e6-4e4b-ab3d-67793a6d429e service nova] Acquired lock "refresh_cache-3438591d-5ed5-45ed-8875-256372fc8333" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:41.803908 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3346cddd-101f-491d-9439-bdcf8c008b3a req-9dc3ba51-36e6-4e4b-ab3d-67793a6d429e service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Refreshing network info cache for port c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:41.807826 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Start _get_guest_xml network_info=[{"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:00:41.811917 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:00:41.813184 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-230507400', uuid='3438591d-5ed5-45ed-8875-256372fc8333'), owner=OwnerMeta(userid='84fd5efd52f1407cbb4aafaba4744bc3', username='tempest-VolumesAssistedSnapshotsTest-1424615901-project-member', projectid='b17fb0c9be4c4d30bd907eb08e2c5e3e', projectname='tempest-VolumesAssistedSnapshotsTest-1424615901'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922841.8128195) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:00:41.814089 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:00:41.814533 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:00:41.815636 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:00:41.816107 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:00:41.818728 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:00:41.819599 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:00:41.819783 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:00:41.819924 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:00:41.820148 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:00:41.820977 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:00:41.821406 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:00:41.821676 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:00:41.821826 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:00:41.822095 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:00:41.822095 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:00:41.822291 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:00:41.835938 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:00:41.836965 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.096s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:41.837429 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922841.8370812, 489adb12-811c-408c-af3f-24edcfc9d4bb => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:41.837635 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] VM Started (Lifecycle Event)
May 27 23:00:41.840496 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:41.846664 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:41.847655 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:41.855394 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:41.859668 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-230507400',display_name='tempest-VolumesAssistedSnapshotsTest-server-230507400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesassistedsnapshotstest-server-230507400',id=5,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6W+AHnJCWRdvMI1ffUFfBHWi+NyfDyxNd+AezgFMGg7XpukffnqOMmOjsIbph7uiuYEJ8DjO6wK782PfhaYiTz0uzYdUz+U6qVg7nWKp3j0j4CJYu8AAnMsWcMg/K6tg==',key_name='tempest-keypair-100102408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b17fb0c9be4c4d30bd907eb08e2c5e3e',ramdisk_id='',reservation_id='r-sj4xugnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1424615901',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1424615901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84fd5efd52f1407cbb4aafaba4744bc3',uuid=3438591d-5ed5-45ed-8875-256372fc8333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:00:41.859961 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Converting VIF {"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:41.860859 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:8c,bridge_name='br-int',has_traffic_filtering=True,id=c75229d6-c711-4185-80fd-07e0cc9702c0,network=Network(a9ddb0fe-77be-4735-8de1-47b3726a3696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75229d6-c7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:41.862812 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lazy-loading 'pci_devices' on Instance uuid 3438591d-5ed5-45ed-8875-256372fc8333 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:00:41.869824 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:41.870276 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a4dbb371-52fe-455f-8514-77f1a72266ce req-361517e6-84f1-41ba-977d-13d9ccd61ace service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:41.870893 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a4dbb371-52fe-455f-8514-77f1a72266ce req-361517e6-84f1-41ba-977d-13d9ccd61ace service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:41.871079 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a4dbb371-52fe-455f-8514-77f1a72266ce req-361517e6-84f1-41ba-977d-13d9ccd61ace service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:41.871266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a4dbb371-52fe-455f-8514-77f1a72266ce req-361517e6-84f1-41ba-977d-13d9ccd61ace service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:41.879825 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a4dbb371-52fe-455f-8514-77f1a72266ce req-361517e6-84f1-41ba-977d-13d9ccd61ace service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No event matching network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a in dict_keys([('network-vif-plugged', 'c2e9f6b2-ff45-449c-89c3-b661ae2ee33a')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:00:41.881262 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-a4dbb371-52fe-455f-8514-77f1a72266ce req-361517e6-84f1-41ba-977d-13d9ccd61ace service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received unexpected event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with vm_state building and task_state spawning.
May 27 23:00:41.944968 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Successfully updated port: 1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:00:41.965845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:41.966799 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:41.997881 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:41.998689 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:41.999133 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:41.999543 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:41.999921 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:42.000346 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:42.015378 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk 1073741824" returned: 0 in 0.048s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:42.019654 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:42.019952 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:42.081071 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:42.103677 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:42.104226 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:00:42.104598 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:42.130940 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:00:42.131737 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:00:42.132217 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:42.132551 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:42.203724 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:42.203993 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Cannot resize image /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:00:42.204253 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:00:42.204417 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Ensure instance console log exists: /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:00:42.204609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:42.204775 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:42.204900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:42.276763 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6f43a4e43324b67b74b5a65d12cbcea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e334950e7c432ca356cbe67e72c44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:00:42.297276 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Creating config drive at /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk.config
May 27 23:00:42.301840 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7gvso0cy {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:42.319188 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3346cddd-101f-491d-9439-bdcf8c008b3a req-9dc3ba51-36e6-4e4b-ab3d-67793a6d429e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:42.343893 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7gvso0cy" returned: 0 in 0.042s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:42.347053 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:42.361509 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922842.3604162, 489adb12-811c-408c-af3f-24edcfc9d4bb => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:42.361509 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] VM Paused (Lifecycle Event)
May 27 23:00:42.377031 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] End _get_guest_xml xml=<domain type="qemu">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <uuid>3438591d-5ed5-45ed-8875-256372fc8333</uuid>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <name>instance-00000005</name>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-230507400</nova:name>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:00:41</nova:creationTime>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:user uuid="84fd5efd52f1407cbb4aafaba4744bc3">tempest-VolumesAssistedSnapshotsTest-1424615901-project-member</nova:user>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:project uuid="b17fb0c9be4c4d30bd907eb08e2c5e3e">tempest-VolumesAssistedSnapshotsTest-1424615901</nova:project>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         <nova:port uuid="c75229d6-c711-4185-80fd-07e0cc9702c0">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <system>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <entry name="serial">3438591d-5ed5-45ed-8875-256372fc8333</entry>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <entry name="uuid">3438591d-5ed5-45ed-8875-256372fc8333</entry>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     </system>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <os>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   </os>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <features>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   </features>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   <devices>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk.config"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:2e:13:8c"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <target dev="tapc75229d6-c7"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     </interface>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/console.log" append="off"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     </serial>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <video>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     </video>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     </rng>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:   </devices>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]: </domain>
May 27 23:00:42.377031 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:00:42.379596 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Preparing to wait for external event network-vif-plugged-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:00:42.379596 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Acquiring lock "3438591d-5ed5-45ed-8875-256372fc8333-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:42.379596 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:42.379596 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:42.387533 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-230507400',display_name='tempest-VolumesAssistedSnapshotsTest-server-230507400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesassistedsnapshotstest-server-230507400',id=5,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6W+AHnJCWRdvMI1ffUFfBHWi+NyfDyxNd+AezgFMGg7XpukffnqOMmOjsIbph7uiuYEJ8DjO6wK782PfhaYiTz0uzYdUz+U6qVg7nWKp3j0j4CJYu8AAnMsWcMg/K6tg==',key_name='tempest-keypair-100102408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b17fb0c9be4c4d30bd907eb08e2c5e3e',ramdisk_id='',reservation_id='r-sj4xugnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1424615901',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1424615901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84fd5efd52f1407cbb4aafaba4744bc3',uuid=3438591d-5ed5-45ed-8875-256372fc8333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:00:42.388362 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Converting VIF {"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:42.389480 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:8c,bridge_name='br-int',has_traffic_filtering=True,id=c75229d6-c711-4185-80fd-07e0cc9702c0,network=Network(a9ddb0fe-77be-4735-8de1-47b3726a3696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75229d6-c7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:42.389885 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:8c,bridge_name='br-int',has_traffic_filtering=True,id=c75229d6-c711-4185-80fd-07e0cc9702c0,network=Network(a9ddb0fe-77be-4735-8de1-47b3726a3696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75229d6-c7') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:00:42.391599 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:42.392049 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:42.392641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:00:42.393647 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:42.393820 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8de99d60-e23d-5381-aee3-9caa5e812578', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:42.407143 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:42.409017 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:42.411920 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:42.417865 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:42.418769 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc75229d6-c7, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:42.420665 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc75229d6-c7, col_values=(('qos', UUID('40255c93-7ee8-4f25-b1a6-4c4df190c335')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:42.420665 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc75229d6-c7, col_values=(('external_ids', {'iface-id': 'c75229d6-c711-4185-80fd-07e0cc9702c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:13:8c', 'vm-uuid': '3438591d-5ed5-45ed-8875-256372fc8333'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:42.420665 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:42.422288 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:42.429774 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:42.430756 np0000001565 nova-compute[98289]: INFO os_vif [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:13:8c,bridge_name='br-int',has_traffic_filtering=True,id=c75229d6-c711-4185-80fd-07e0cc9702c0,network=Network(a9ddb0fe-77be-4735-8de1-47b3726a3696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75229d6-c7')
May 27 23:00:42.448046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "refresh_cache-f31ea991-4cf8-43e7-9d65-cfb193c3413a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:42.448211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquired lock "refresh_cache-f31ea991-4cf8-43e7-9d65-cfb193c3413a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:42.448452 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:00:42.508275 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Took 8.31 seconds to spawn the instance on the hypervisor.
May 27 23:00:42.508529 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:42.635437 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:00:42.770016 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Successfully created port: 899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:00:42.840762 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:42.865872 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:42.866763 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:42.872929 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:42.883086 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:42.977279 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:43.027981 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Took 14.38 seconds to build instance.
May 27 23:00:43.082951 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:43.097368 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3346cddd-101f-491d-9439-bdcf8c008b3a req-9dc3ba51-36e6-4e4b-ab3d-67793a6d429e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:43.140353 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:00:43.253090 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:43.258509 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:43.267108 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:43.287361 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:43.296115 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:43.331876 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8af87907-0e11-485c-b8a1-26a33bc37159 req-ab7b1a20-35d6-4df3-81f2-a94e298b0316 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Received event network-vif-plugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:43.332103 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8af87907-0e11-485c-b8a1-26a33bc37159 req-ab7b1a20-35d6-4df3-81f2-a94e298b0316 service nova] Acquiring lock "a0070282-e138-405c-b6c8-3478991d03f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:43.337003 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8af87907-0e11-485c-b8a1-26a33bc37159 req-ab7b1a20-35d6-4df3-81f2-a94e298b0316 service nova] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:43.337003 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8af87907-0e11-485c-b8a1-26a33bc37159 req-ab7b1a20-35d6-4df3-81f2-a94e298b0316 service nova] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:43.337003 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8af87907-0e11-485c-b8a1-26a33bc37159 req-ab7b1a20-35d6-4df3-81f2-a94e298b0316 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Processing event network-vif-plugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:00:43.373602 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:00:43.373851 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922843.37367, 13686e4c-ae8e-4837-a71f-2d710575ab33 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:43.373984 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] VM Resumed (Lifecycle Event)
May 27 23:00:43.448254 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3346cddd-101f-491d-9439-bdcf8c008b3a req-9dc3ba51-36e6-4e4b-ab3d-67793a6d429e service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Updated VIF entry in instance network info cache for port c75229d6-c711-4185-80fd-07e0cc9702c0. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:00:43.448563 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3346cddd-101f-491d-9439-bdcf8c008b3a req-9dc3ba51-36e6-4e4b-ab3d-67793a6d429e service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Updating instance_info_cache with network_info: [{"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:43.530784 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9ac25aae-60d1-464a-bfb2-3032cabbe201 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.890s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:43.667669 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Successfully updated port: 899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:00:43.787730 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:00:43.793480 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:00:43.795405 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Instance spawned successfully.
May 27 23:00:43.795823 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:00:43.799119 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:43.799585 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:43.799585 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:43.799871 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:43.808765 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:43.877558 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:43.879320 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:43.916792 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-493ab578-eb65-489f-907a-2cfa5dc7ad8a req-e2605b9c-53c3-4e71-a5d5-4b49b9b95bfd service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received event network-changed-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:43.917274 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-493ab578-eb65-489f-907a-2cfa5dc7ad8a req-e2605b9c-53c3-4e71-a5d5-4b49b9b95bfd service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Refreshing instance network info cache due to event network-changed-1f508337-775f-4120-a399-7a785fa5a827. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:43.917442 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-493ab578-eb65-489f-907a-2cfa5dc7ad8a req-e2605b9c-53c3-4e71-a5d5-4b49b9b95bfd service nova] Acquiring lock "refresh_cache-f31ea991-4cf8-43e7-9d65-cfb193c3413a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:43.948817 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:43.949022 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:43.949081 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] No VIF found with MAC fa:16:3e:2e:13:8c, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:00:43.950554 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Using config drive
May 27 23:00:43.952385 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3346cddd-101f-491d-9439-bdcf8c008b3a req-9dc3ba51-36e6-4e4b-ab3d-67793a6d429e service nova] Releasing lock "refresh_cache-3438591d-5ed5-45ed-8875-256372fc8333" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:43.973768 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Updating instance_info_cache with network_info: [{"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:44.154280 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:00:44.155450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:00:44.155771 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Creating image(s)
May 27 23:00:44.156298 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "/opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:44.156520 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "/opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:44.157109 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "/opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:44.157774 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:44.162122 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:44.163081 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:44.172943 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:44.173109 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquired lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:44.173547 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:00:44.234608 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.071s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:44.236048 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:44.236497 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:44.236938 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:44.240994 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:44.241363 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:44.315215 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Took 7.67 seconds to spawn the instance on the hypervisor.
May 27 23:00:44.315403 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:44.339678 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:44.340121 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:44.377922 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk 1073741824" returned: 0 in 0.037s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:44.378096 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.141s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:44.379370 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:44.389421 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922844.386564, a0070282-e138-405c-b6c8-3478991d03f6 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:44.389421 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a0070282-e138-405c-b6c8-3478991d03f6] VM Started (Lifecycle Event)
May 27 23:00:44.396853 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:44.457975 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:44.461596 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:44.462847 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:00:44.463135 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:44.482411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Releasing lock "refresh_cache-f31ea991-4cf8-43e7-9d65-cfb193c3413a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:44.482411 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Instance network_info: |[{"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:00:44.482411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-493ab578-eb65-489f-907a-2cfa5dc7ad8a req-e2605b9c-53c3-4e71-a5d5-4b49b9b95bfd service nova] Acquired lock "refresh_cache-f31ea991-4cf8-43e7-9d65-cfb193c3413a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:44.485873 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-493ab578-eb65-489f-907a-2cfa5dc7ad8a req-e2605b9c-53c3-4e71-a5d5-4b49b9b95bfd service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Refreshing network info cache for port 1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:44.493361 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Start _get_guest_xml network_info=[{"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:00:44.493361 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:00:44.493361 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1584029026-1', uuid='f31ea991-4cf8-43e7-9d65-cfb193c3413a'), owner=OwnerMeta(userid='f6f43a4e43324b67b74b5a65d12cbcea', username='tempest-TestMultiAttachVolumeSwap-611409375-project-member', projectid='88e334950e7c432ca356cbe67e72c44d', projectname='tempest-TestMultiAttachVolumeSwap-611409375'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922844.4926078) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:00:44.495216 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:00:44.495216 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:00:44.495216 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:00:44.495477 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:00:44.496282 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:00:44.496593 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:00:44.496772 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:00:44.496865 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:00:44.496976 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:00:44.497072 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:00:44.497178 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:00:44.497380 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:00:44.497495 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:00:44.497615 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:00:44.497727 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:00:44.497847 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:00:44.515355 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1584029026-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testmultiattachvolumeswap-server-1584029026-1',id=6,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcyph/lzlfPzwzF2ik9TBAMRhykzkfSsaBTCiun/k+rxSvdcGAJypfCitS229KGkPzuKR0UrBeAKUFkzl8AnmQHHuOHIPUmIwa8nEyoNXRxQIaqq+TBt0S9ALq+N/gyug==',key_name='tempest-keypair-167177011',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e334950e7c432ca356cbe67e72c44d',ramdisk_id='',reservation_id='r-owzn0iqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-611409375',owner_user_name='tempest-TestMultiAttachVolumeSwap-611409375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6f43a4e43324b67b74b5a65d12cbcea',uuid=f31ea991-4cf8-43e7-9d65-cfb193c3413a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:00:44.515355 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converting VIF {"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:44.515355 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f508337-775f-4120-a399-7a785fa5a827,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f508337-77') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:44.515881 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lazy-loading 'pci_devices' on Instance uuid f31ea991-4cf8-43e7-9d65-cfb193c3413a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:00:44.560642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:44.560642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:44.566223 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:44.566411 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Cannot resize image /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:00:44.568350 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:00:44.568350 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Ensure instance console log exists: /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:00:44.568350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:44.568350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:44.568350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:44.620619 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Creating config drive at /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk.config
May 27 23:00:44.624441 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk1f53qiy {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:44.660530 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk1f53qiy" returned: 0 in 0.036s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:44.777727 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:44.828966 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Took 14.77 seconds to build instance.
May 27 23:00:44.895358 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:44.897924 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:44.992559 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-493ab578-eb65-489f-907a-2cfa5dc7ad8a req-e2605b9c-53c3-4e71-a5d5-4b49b9b95bfd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:45.018351 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:45.026187 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] End _get_guest_xml xml=<domain type="qemu">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <uuid>f31ea991-4cf8-43e7-9d65-cfb193c3413a</uuid>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <name>instance-00000006</name>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1584029026-1</nova:name>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:00:44</nova:creationTime>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:user uuid="f6f43a4e43324b67b74b5a65d12cbcea">tempest-TestMultiAttachVolumeSwap-611409375-project-member</nova:user>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:project uuid="88e334950e7c432ca356cbe67e72c44d">tempest-TestMultiAttachVolumeSwap-611409375</nova:project>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         <nova:port uuid="1f508337-775f-4120-a399-7a785fa5a827">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <system>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <entry name="serial">f31ea991-4cf8-43e7-9d65-cfb193c3413a</entry>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <entry name="uuid">f31ea991-4cf8-43e7-9d65-cfb193c3413a</entry>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     </system>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <os>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   </os>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <features>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   </features>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   <devices>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk.config"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:cb:db:bd"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <target dev="tap1f508337-77"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     </interface>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/console.log" append="off"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     </serial>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <video>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     </video>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     </rng>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:   </devices>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]: </domain>
May 27 23:00:45.026187 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:00:45.028555 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Preparing to wait for external event network-vif-plugged-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:00:45.028555 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:45.028555 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:45.028555 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:45.028555 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1584029026-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testmultiattachvolumeswap-server-1584029026-1',id=6,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcyph/lzlfPzwzF2ik9TBAMRhykzkfSsaBTCiun/k+rxSvdcGAJypfCitS229KGkPzuKR0UrBeAKUFkzl8AnmQHHuOHIPUmIwa8nEyoNXRxQIaqq+TBt0S9ALq+N/gyug==',key_name='tempest-keypair-167177011',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e334950e7c432ca356cbe67e72c44d',ramdisk_id='',reservation_id='r-owzn0iqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-611409375',owner_user_name='tempest-TestMultiAttachVolumeSwap-611409375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6f43a4e43324b67b74b5a65d12cbcea',uuid=f31ea991-4cf8-43e7-9d65-cfb193c3413a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:00:45.028890 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converting VIF {"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:45.028890 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f508337-775f-4120-a399-7a785fa5a827,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f508337-77') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:45.028890 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f508337-775f-4120-a399-7a785fa5a827,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f508337-77') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:00:45.032942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.032942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:45.032942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:00:45.034583 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.034583 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '741d751d-0b1b-5c93-ad44-bce4d1d3dbad', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:45.036296 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.037062 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:45.043058 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.046989 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.047233 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f508337-77, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:45.048629 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f508337-77, col_values=(('qos', UUID('0a1b0001-dd9e-46ac-b59e-5e251c7436ba')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:45.048629 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f508337-77, col_values=(('external_ids', {'iface-id': '1f508337-775f-4120-a399-7a785fa5a827', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:db:bd', 'vm-uuid': 'f31ea991-4cf8-43e7-9d65-cfb193c3413a'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:45.048973 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.051019 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:45.061656 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.063193 np0000001565 nova-compute[98289]: INFO os_vif [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f508337-775f-4120-a399-7a785fa5a827,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f508337-77')
May 27 23:00:45.065289 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:00:45.178120 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.206149 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.283551 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Updating instance_info_cache with network_info: [{"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:45.301651 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.331257 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8bdf9b9d-c4cf-42f7-b1a0-b5803ccef881 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.277s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:45.401388 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922845.4006455, a0070282-e138-405c-b6c8-3478991d03f6 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:45.401388 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a0070282-e138-405c-b6c8-3478991d03f6] VM Paused (Lifecycle Event)
May 27 23:00:45.429426 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Received event network-vif-plugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:45.429426 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] Acquiring lock "a0070282-e138-405c-b6c8-3478991d03f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:45.429426 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:45.429426 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:45.429426 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] No waiting events found dispatching network-vif-plugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:00:45.429426 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Received unexpected event network-vif-plugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b for instance with vm_state active and task_state None.
May 27 23:00:45.429426 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received event network-changed-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:45.429426 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Refreshing instance network info cache due to event network-changed-899734d7-d351-4e8e-9021-71e58ffa2734. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:45.429426 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] Acquiring lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:45.496160 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-493ab578-eb65-489f-907a-2cfa5dc7ad8a req-e2605b9c-53c3-4e71-a5d5-4b49b9b95bfd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:45.532158 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.541362 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.556621 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.562380 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:45.626704 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:45.626971 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:45.630501 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:00:45.630728 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Claim successful on node np0000001565
May 27 23:00:45.696211 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-493ab578-eb65-489f-907a-2cfa5dc7ad8a req-e2605b9c-53c3-4e71-a5d5-4b49b9b95bfd service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Updated VIF entry in instance network info cache for port 1f508337-775f-4120-a399-7a785fa5a827. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:00:45.696810 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-493ab578-eb65-489f-907a-2cfa5dc7ad8a req-e2605b9c-53c3-4e71-a5d5-4b49b9b95bfd service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Updating instance_info_cache with network_info: [{"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:45.783842 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Releasing lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:45.783842 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Instance network_info: |[{"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:00:45.784432 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] Acquired lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:45.784432 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Refreshing network info cache for port 899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:45.787138 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Start _get_guest_xml network_info=[{"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:00:45.789031 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:00:45.790566 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1584029026-2', uuid='aee84b65-41d8-427d-96d0-cd328e4863ba'), owner=OwnerMeta(userid='f6f43a4e43324b67b74b5a65d12cbcea', username='tempest-TestMultiAttachVolumeSwap-611409375-project-member', projectid='88e334950e7c432ca356cbe67e72c44d', projectname='tempest-TestMultiAttachVolumeSwap-611409375'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922845.7901783) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:00:45.792157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:00:45.792821 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:00:45.793632 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:00:45.793923 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:00:45.795194 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:00:45.796980 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:00:45.796980 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:00:45.796980 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:00:45.796980 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:00:45.796980 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:00:45.796980 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:00:45.796980 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:00:45.796980 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:00:45.798505 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:00:45.798505 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:00:45.798505 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:00:45.814552 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1584029026-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testmultiattachvolumeswap-server-1584029026-2',id=7,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcyph/lzlfPzwzF2ik9TBAMRhykzkfSsaBTCiun/k+rxSvdcGAJypfCitS229KGkPzuKR0UrBeAKUFkzl8AnmQHHuOHIPUmIwa8nEyoNXRxQIaqq+TBt0S9ALq+N/gyug==',key_name='tempest-keypair-167177011',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e334950e7c432ca356cbe67e72c44d',ramdisk_id='',reservation_id='r-owzn0iqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-611409375',owner_user_name='tempest-TestMultiAttachVolumeSwap-611409375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6f43a4e43324b67b74b5a65d12cbcea',uuid=aee84b65-41d8-427d-96d0-cd328e4863ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:00:45.815031 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converting VIF {"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:45.815823 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:38:82,bridge_name='br-int',has_traffic_filtering=True,id=899734d7-d351-4e8e-9021-71e58ffa2734,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap899734d7-d3') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:45.816619 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lazy-loading 'pci_devices' on Instance uuid aee84b65-41d8-427d-96d0-cd328e4863ba {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:00:45.906401 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:45.907742 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922845.9074693, a0070282-e138-405c-b6c8-3478991d03f6 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:45.907934 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a0070282-e138-405c-b6c8-3478991d03f6] VM Resumed (Lifecycle Event)
May 27 23:00:45.978833 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-428cc3b3-e014-4e8f-b348-274285978352 req-fb365bff-1cbc-448f-b76d-5559e00716fe service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-changed-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:45.982164 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-428cc3b3-e014-4e8f-b348-274285978352 req-fb365bff-1cbc-448f-b76d-5559e00716fe service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Refreshing instance network info cache due to event network-changed-7faf9be9-b21d-441b-9e09-9c236e1f9fb5. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:45.982164 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-428cc3b3-e014-4e8f-b348-274285978352 req-fb365bff-1cbc-448f-b76d-5559e00716fe service nova] Acquiring lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:45.982164 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-428cc3b3-e014-4e8f-b348-274285978352 req-fb365bff-1cbc-448f-b76d-5559e00716fe service nova] Acquired lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:45.982164 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-428cc3b3-e014-4e8f-b348-274285978352 req-fb365bff-1cbc-448f-b76d-5559e00716fe service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Refreshing network info cache for port 7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:46.198892 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-493ab578-eb65-489f-907a-2cfa5dc7ad8a req-e2605b9c-53c3-4e71-a5d5-4b49b9b95bfd service nova] Releasing lock "refresh_cache-f31ea991-4cf8-43e7-9d65-cfb193c3413a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:46.290816 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:46.322476 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] End _get_guest_xml xml=<domain type="qemu">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <uuid>aee84b65-41d8-427d-96d0-cd328e4863ba</uuid>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <name>instance-00000007</name>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1584029026-2</nova:name>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:00:45</nova:creationTime>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:user uuid="f6f43a4e43324b67b74b5a65d12cbcea">tempest-TestMultiAttachVolumeSwap-611409375-project-member</nova:user>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:project uuid="88e334950e7c432ca356cbe67e72c44d">tempest-TestMultiAttachVolumeSwap-611409375</nova:project>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         <nova:port uuid="899734d7-d351-4e8e-9021-71e58ffa2734">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <system>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <entry name="serial">aee84b65-41d8-427d-96d0-cd328e4863ba</entry>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <entry name="uuid">aee84b65-41d8-427d-96d0-cd328e4863ba</entry>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     </system>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <os>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   </os>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <features>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   </features>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   <devices>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk.config"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:d4:38:82"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <target dev="tap899734d7-d3"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     </interface>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/console.log" append="off"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     </serial>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <video>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     </video>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     </rng>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:   </devices>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]: </domain>
May 27 23:00:46.322476 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:00:46.322476 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Preparing to wait for external event network-vif-plugged-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:00:46.322476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:46.322476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:46.324897 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:46.324897 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1584029026-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testmultiattachvolumeswap-server-1584029026-2',id=7,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcyph/lzlfPzwzF2ik9TBAMRhykzkfSsaBTCiun/k+rxSvdcGAJypfCitS229KGkPzuKR0UrBeAKUFkzl8AnmQHHuOHIPUmIwa8nEyoNXRxQIaqq+TBt0S9ALq+N/gyug==',key_name='tempest-keypair-167177011',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e334950e7c432ca356cbe67e72c44d',ramdisk_id='',reservation_id='r-owzn0iqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-611409375',owner_user_name='tempest-TestMultiAttachVolumeSwap-611409375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6f43a4e43324b67b74b5a65d12cbcea',uuid=aee84b65-41d8-427d-96d0-cd328e4863ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:00:46.324897 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converting VIF {"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:46.326300 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:38:82,bridge_name='br-int',has_traffic_filtering=True,id=899734d7-d351-4e8e-9021-71e58ffa2734,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap899734d7-d3') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:46.326300 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:38:82,bridge_name='br-int',has_traffic_filtering=True,id=899734d7-d351-4e8e-9021-71e58ffa2734,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap899734d7-d3') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:00:46.326581 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:46.326852 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:46.327036 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:00:46.327993 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:46.328058 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f79880c9-3193-533c-acae-ab3f78a3bdce', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:46.331252 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:46.331958 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:46.338603 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:46.343286 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:46.343521 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap899734d7-d3, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:46.343909 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap899734d7-d3, col_values=(('qos', UUID('32cad4e5-1793-42ff-b837-5bd9e94dd1c2')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:46.344050 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap899734d7-d3, col_values=(('external_ids', {'iface-id': '899734d7-d351-4e8e-9021-71e58ffa2734', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:38:82', 'vm-uuid': 'aee84b65-41d8-427d-96d0-cd328e4863ba'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:46.347804 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:46.385696 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:46.387378 np0000001565 nova-compute[98289]: INFO os_vif [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:38:82,bridge_name='br-int',has_traffic_filtering=True,id=899734d7-d351-4e8e-9021-71e58ffa2734,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap899734d7-d3')
May 27 23:00:46.390515 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:46.410846 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:46.418409 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:46.483152 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-428cc3b3-e014-4e8f-b348-274285978352 req-fb365bff-1cbc-448f-b76d-5559e00716fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:46.592688 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:46.594854 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:46.594854 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No VIF found with MAC fa:16:3e:cb:db:bd, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:00:46.594854 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Using config drive
May 27 23:00:46.920423 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922846.9201407, 3438591d-5ed5-45ed-8875-256372fc8333 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:46.920819 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] VM Started (Lifecycle Event)
May 27 23:00:46.952320 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:46.994109 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-428cc3b3-e014-4e8f-b348-274285978352 req-fb365bff-1cbc-448f-b76d-5559e00716fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:47.099130 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:47.114185 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Updated VIF entry in instance network info cache for port 899734d7-d351-4e8e-9021-71e58ffa2734. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:00:47.115320 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Updating instance_info_cache with network_info: [{"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:47.203729 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-428cc3b3-e014-4e8f-b348-274285978352 req-fb365bff-1cbc-448f-b76d-5559e00716fe service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Updated VIF entry in instance network info cache for port 7faf9be9-b21d-441b-9e09-9c236e1f9fb5. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:00:47.203975 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-428cc3b3-e014-4e8f-b348-274285978352 req-fb365bff-1cbc-448f-b76d-5559e00716fe service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Updating instance_info_cache with network_info: [{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:47.243849 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:00:47.244086 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:00:47.277799 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Creating config drive at /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk.config
May 27 23:00:47.282066 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2h9d09te {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:47.312158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2h9d09te" returned: 0 in 0.030s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:47.425931 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:47.427858 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922847.4275336, 3438591d-5ed5-45ed-8875-256372fc8333 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:47.428055 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] VM Paused (Lifecycle Event)
May 27 23:00:47.507567 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Received event network-vif-plugged-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:47.508233 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] Acquiring lock "3438591d-5ed5-45ed-8875-256372fc8333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:47.508414 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:47.508564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:47.508701 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Processing event network-vif-plugged-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:00:47.508823 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Received event network-vif-plugged-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:47.509019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] Acquiring lock "3438591d-5ed5-45ed-8875-256372fc8333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:47.509067 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:47.510350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:47.510350 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] No waiting events found dispatching network-vif-plugged-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:00:47.510350 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Received unexpected event network-vif-plugged-c75229d6-c711-4185-80fd-07e0cc9702c0 for instance with vm_state building and task_state spawning.
May 27 23:00:47.510350 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Received event network-changed-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:47.510350 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Refreshing instance network info cache due to event network-changed-3d3cda67-acda-4008-ad58-dc64f4eb2c8b. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:47.510350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] Acquiring lock "refresh_cache-a0070282-e138-405c-b6c8-3478991d03f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:47.510350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] Acquired lock "refresh_cache-a0070282-e138-405c-b6c8-3478991d03f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:47.510350 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Refreshing network info cache for port 3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:47.511807 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:00:47.521491 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:00:47.525983 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Instance spawned successfully.
May 27 23:00:47.526127 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:00:47.621046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a2592a9-f011-4315-b4cb-39000aa3d4a0 req-8da54485-2394-4591-960f-5d2791e2dffe service nova] Releasing lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:47.706211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-428cc3b3-e014-4e8f-b348-274285978352 req-fb365bff-1cbc-448f-b76d-5559e00716fe service nova] Releasing lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:47.746873 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:00:47.770899 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:47.803356 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:47.803356 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:47.890748 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:47.912199 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:47.919651 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:47.919651 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:47.919651 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No VIF found with MAC fa:16:3e:d4:38:82, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:00:47.919950 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Using config drive
May 27 23:00:47.931483 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:47.938580 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922847.9382105, 3438591d-5ed5-45ed-8875-256372fc8333 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:47.938765 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] VM Resumed (Lifecycle Event)
May 27 23:00:48.012899 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:48.041527 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:48.041527 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:48.041527 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:48.041527 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:48.041527 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:48.044560 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:48.092986 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received event network-vif-unplugged-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:48.094083 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:48.094345 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:48.094397 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:48.094566 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] No event matching network-vif-unplugged-1f508337-775f-4120-a399-7a785fa5a827 in dict_keys([('network-vif-plugged', '1f508337-775f-4120-a399-7a785fa5a827')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:00:48.094647 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received unexpected event network-vif-unplugged-1f508337-775f-4120-a399-7a785fa5a827 for instance with vm_state building and task_state spawning.
May 27 23:00:48.094738 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received event network-vif-unplugged-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:48.094846 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:48.094958 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:48.095077 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:48.095173 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] No event matching network-vif-unplugged-899734d7-d351-4e8e-9021-71e58ffa2734 in dict_keys([('network-vif-plugged', '899734d7-d351-4e8e-9021-71e58ffa2734')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:00:48.095270 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received unexpected event network-vif-unplugged-899734d7-d351-4e8e-9021-71e58ffa2734 for instance with vm_state building and task_state spawning.
May 27 23:00:48.096604 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received event network-vif-plugged-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:48.096604 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:48.096604 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:48.096604 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:48.096604 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-595681f2-19af-47fe-8ad3-503c1e7f9b4a req-41412f9e-bb81-4dd0-a2d3-a75de43c9c17 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Processing event network-vif-plugged-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:00:48.188125 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:48.197600 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:48.222043 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:48.257816 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.631s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:48.258348 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:00:48.432635 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:48.441876 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:48.445095 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:48.452809 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:48.551955 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Took 9.41 seconds to spawn the instance on the hypervisor.
May 27 23:00:48.552086 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:48.616670 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Updated VIF entry in instance network info cache for port 3d3cda67-acda-4008-ad58-dc64f4eb2c8b. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:00:48.620402 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Updating instance_info_cache with network_info: [{"id": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "address": "fa:16:3e:f7:29:8e", "network": {"id": "dc1c8145-c753-4e29-8f29-a3eb6dad6e3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-218840385-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e563b54a24044564bd9f42d080e21b90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3cda67-ac", "ovs_interfaceid": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:48.622287 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Creating config drive at /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk.config
May 27 23:00:48.629730 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbokarx0i {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:48.662082 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbokarx0i" returned: 0 in 0.032s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:48.687159 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:00:48.694502 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:00:48.698344 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Instance spawned successfully.
May 27 23:00:48.700039 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:00:48.767205 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:00:48.767467 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:00:48.767900 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:48.768222 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:48.842901 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f229055e36b2440ca4ef65af175b403b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676f4701774b4f98903b64e0de079504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:00:48.883535 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:00:48.883778 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:00:48.884047 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:00:48.884360 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:00:48.884532 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:00:48.884846 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:00:48.885042 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:00:48.885248 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:00:48.885501 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:00:48.949256 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:00:48.949942 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922848.9494646, f31ea991-4cf8-43e7-9d65-cfb193c3413a => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:48.949942 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] VM Started (Lifecycle Event)
May 27 23:00:49.064944 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Took 18.04 seconds to build instance.
May 27 23:00:49.124921 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3f47b8bc-910e-4c63-9414-e24e8b93249c req-773a69bd-bbe8-44f9-83c3-e62d2c6b3964 service nova] Releasing lock "refresh_cache-a0070282-e138-405c-b6c8-3478991d03f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:49.159385 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:49.188317 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:49.208157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:49.208383 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:49.208835 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:49.209217 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:49.209619 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:49.209997 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:49.272992 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:00:49.307828 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Successfully created port: 662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:00:49.312254 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:49.328944 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:49.328944 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:49.386348 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:49.387901 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:49.392357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:49.392357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:49.392357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:49.392357 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:00:49.454188 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:49.461442 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:49.569109 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ee0a47f-51fd-41f9-a731-10db000fdcb0 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "3438591d-5ed5-45ed-8875-256372fc8333" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.555s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:49.633520 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5c60b0bf-00ef-4800-9da0-b93c43e1f529 req-26a24b50-df8b-4a4b-b379-d39361c2b58e service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:49.633732 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5c60b0bf-00ef-4800-9da0-b93c43e1f529 req-26a24b50-df8b-4a4b-b379-d39361c2b58e service nova] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:49.633920 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5c60b0bf-00ef-4800-9da0-b93c43e1f529 req-26a24b50-df8b-4a4b-b379-d39361c2b58e service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:49.634105 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5c60b0bf-00ef-4800-9da0-b93c43e1f529 req-26a24b50-df8b-4a4b-b379-d39361c2b58e service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:49.634289 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5c60b0bf-00ef-4800-9da0-b93c43e1f529 req-26a24b50-df8b-4a4b-b379-d39361c2b58e service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] No event matching network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 in dict_keys([('network-vif-plugged', '4dc65314-8dc9-4ca6-a74b-2cb818efd866')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:00:49.635096 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5c60b0bf-00ef-4800-9da0-b93c43e1f529 req-26a24b50-df8b-4a4b-b379-d39361c2b58e service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received unexpected event network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 for instance with vm_state building and task_state spawning.
May 27 23:00:49.716575 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Took 7.99 seconds to spawn the instance on the hypervisor.
May 27 23:00:49.716743 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:49.781212 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:00:49.832473 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:00:49.964601 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:00:49.965046 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922849.9646761, f31ea991-4cf8-43e7-9d65-cfb193c3413a => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:49.965046 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] VM Paused (Lifecycle Event)
May 27 23:00:50.194028 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received event network-vif-plugged-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:50.194192 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:50.194352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:50.195559 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:50.195559 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] No waiting events found dispatching network-vif-plugged-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:00:50.195559 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received unexpected event network-vif-plugged-1f508337-775f-4120-a399-7a785fa5a827 for instance with vm_state active and task_state None.
May 27 23:00:50.195559 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received event network-vif-plugged-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:50.195559 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:50.195559 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:50.195559 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:50.195559 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Processing event network-vif-plugged-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:00:50.196695 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received event network-vif-plugged-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:50.197320 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:50.200241 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:50.200241 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:50.200241 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] No waiting events found dispatching network-vif-plugged-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:00:50.200241 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-4b361f35-7cd9-43f5-8dc4-c28a90bc0fd9 req-4cfe5bcf-22ba-44bc-9b4a-91a061d0e228 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received unexpected event network-vif-plugged-899734d7-d351-4e8e-9021-71e58ffa2734 for instance with vm_state building and task_state spawning.
May 27 23:00:50.236409 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Took 17.69 seconds to build instance.
May 27 23:00:50.250008 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:00:50.253504 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:00:50.254880 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Instance spawned successfully.
May 27 23:00:50.255066 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:00:50.305659 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Successfully updated port: 662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:00:50.386582 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:50.386582 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:50.391343 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:00:50.392126 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Claim successful on node np0000001565
May 27 23:00:50.433302 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:50.467760 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:50.473271 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922850.4727972, f31ea991-4cf8-43e7-9d65-cfb193c3413a => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:50.473545 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] VM Resumed (Lifecycle Event)
May 27 23:00:50.492655 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3132be51-d139-48a4-b5ed-a25d21a76c5f req-b66b6263-cb7e-447d-a5a7-40f89b9f3ba6 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Received event network-changed-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:50.492798 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3132be51-d139-48a4-b5ed-a25d21a76c5f req-b66b6263-cb7e-447d-a5a7-40f89b9f3ba6 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Refreshing instance network info cache due to event network-changed-c75229d6-c711-4185-80fd-07e0cc9702c0. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:50.493023 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3132be51-d139-48a4-b5ed-a25d21a76c5f req-b66b6263-cb7e-447d-a5a7-40f89b9f3ba6 service nova] Acquiring lock "refresh_cache-3438591d-5ed5-45ed-8875-256372fc8333" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:50.493136 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3132be51-d139-48a4-b5ed-a25d21a76c5f req-b66b6263-cb7e-447d-a5a7-40f89b9f3ba6 service nova] Acquired lock "refresh_cache-3438591d-5ed5-45ed-8875-256372fc8333" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:50.494870 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3132be51-d139-48a4-b5ed-a25d21a76c5f req-b66b6263-cb7e-447d-a5a7-40f89b9f3ba6 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Refreshing network info cache for port c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:50.516452 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:50.516889 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:50.599724 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:50.602409 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:50.694012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:50.694523 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:50.740353 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.205s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:50.764460 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:50.764610 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:50.764971 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:50.765247 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:50.765692 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:50.766012 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:50.778906 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:50.780847 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:50.800240 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:00:50.802691 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:00:50.803786 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Creating image(s)
May 27 23:00:50.804671 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "/opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:50.805341 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "/opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:50.806027 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "/opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:50.806906 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:50.811692 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:50.813248 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "refresh_cache-4000f391-003d-4de9-ad03-792bbd0e5e0b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:50.813428 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquired lock "refresh_cache-4000f391-003d-4de9-ad03-792bbd0e5e0b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:50.813574 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:00:50.817455 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:50.874722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:50.875748 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:50.917548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.099s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:50.917548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:50.917548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:50.918122 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:50.923129 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:50.924166 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:50.956523 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:50.959137 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:50.978691 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:50.981022 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:50.998763 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3132be51-d139-48a4-b5ed-a25d21a76c5f req-b66b6263-cb7e-447d-a5a7-40f89b9f3ba6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:51.012062 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.012157 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:51.045440 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.048406 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:51.068446 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk 1073741824" returned: 0 in 0.052s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.068446 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:51.068446 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:51.135668 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.069s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.136482 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:00:51.136950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:51.153934 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.158683 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:51.228929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.230258 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Cannot resize image /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:00:51.230258 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:00:51.230258 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Ensure instance console log exists: /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:00:51.230860 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:51.231428 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:51.231679 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:51.259966 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.263265 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:51.279455 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Took 7.12 seconds to spawn the instance on the hypervisor.
May 27 23:00:51.279720 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:51.346559 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:51.349458 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.353051 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:51.439242 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.439891 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:51.467052 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:51.489194 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922851.4888585, aee84b65-41d8-427d-96d0-cd328e4863ba => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:51.489408 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] VM Started (Lifecycle Event)
May 27 23:00:51.515995 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.519659 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:51.607280 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.607280 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:51.710365 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.712662 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:00:51.714513 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:51.743812 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.025s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:51.749272 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=14069MB free_disk=74.75191879272461GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:00:51.749691 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:51.776342 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:51.776342 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:51.776955 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:51.778397 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:51.778397 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Processing event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:00:51.778397 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:51.778397 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:51.778397 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:51.778397 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:51.778397 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No waiting events found dispatching network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:00:51.778397 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received unexpected event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with vm_state building and task_state spawning.
May 27 23:00:51.778910 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Received event network-changed-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:51.778910 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Refreshing instance network info cache due to event network-changed-662344a5-a569-4f3d-ad66-77fed104617b. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:51.778910 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Acquiring lock "refresh_cache-4000f391-003d-4de9-ad03-792bbd0e5e0b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:51.783640 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Instance event wait completed in 17 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:00:51.792776 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:00:51.794093 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Took 19.19 seconds to build instance.
May 27 23:00:51.813170 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Instance spawned successfully.
May 27 23:00:51.813170 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:00:51.827944 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:51.995765 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:51.995765 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:52.003448 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3132be51-d139-48a4-b5ed-a25d21a76c5f req-b66b6263-cb7e-447d-a5a7-40f89b9f3ba6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:52.131723 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Updating instance_info_cache with network_info: [{"id": "662344a5-a569-4f3d-ad66-77fed104617b", "address": "fa:16:3e:61:c5:16", "network": {"id": "63470321-4dfa-4159-99f5-7c5480fa8d13", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1954691505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "676f4701774b4f98903b64e0de079504", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap662344a5-a5", "ovs_interfaceid": "662344a5-a569-4f3d-ad66-77fed104617b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:52.236028 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:00:52.236245 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:00:52.251583 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3132be51-d139-48a4-b5ed-a25d21a76c5f req-b66b6263-cb7e-447d-a5a7-40f89b9f3ba6 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Updated VIF entry in instance network info cache for port c75229d6-c711-4185-80fd-07e0cc9702c0. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:00:52.252054 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3132be51-d139-48a4-b5ed-a25d21a76c5f req-b66b6263-cb7e-447d-a5a7-40f89b9f3ba6 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Updating instance_info_cache with network_info: [{"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:52.296106 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.705s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:52.319705 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:52.319705 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:52.320086 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:52.320312 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:52.320567 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:52.320789 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:52.461362 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:52.498010 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922852.497199, aee84b65-41d8-427d-96d0-cd328e4863ba => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:52.498397 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] VM Paused (Lifecycle Event)
May 27 23:00:52.638113 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Releasing lock "refresh_cache-4000f391-003d-4de9-ad03-792bbd0e5e0b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:52.638113 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Instance network_info: |[{"id": "662344a5-a569-4f3d-ad66-77fed104617b", "address": "fa:16:3e:61:c5:16", "network": {"id": "63470321-4dfa-4159-99f5-7c5480fa8d13", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1954691505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "676f4701774b4f98903b64e0de079504", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap662344a5-a5", "ovs_interfaceid": "662344a5-a569-4f3d-ad66-77fed104617b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:00:52.638113 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Acquired lock "refresh_cache-4000f391-003d-4de9-ad03-792bbd0e5e0b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:52.639809 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Refreshing network info cache for port 662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:52.642528 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Start _get_guest_xml network_info=[{"id": "662344a5-a569-4f3d-ad66-77fed104617b", "address": "fa:16:3e:61:c5:16", "network": {"id": "63470321-4dfa-4159-99f5-7c5480fa8d13", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1954691505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "676f4701774b4f98903b64e0de079504", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap662344a5-a5", "ovs_interfaceid": "662344a5-a569-4f3d-ad66-77fed104617b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:00:52.645377 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:00:52.646693 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-1083517067', uuid='4000f391-003d-4de9-ad03-792bbd0e5e0b'), owner=OwnerMeta(userid='f229055e36b2440ca4ef65af175b403b', username='tempest-DeleteServersTestJSON-932935839-project-member', projectid='676f4701774b4f98903b64e0de079504', projectname='tempest-DeleteServersTestJSON-932935839'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "662344a5-a569-4f3d-ad66-77fed104617b", "address": "fa:16:3e:61:c5:16", "network": {"id": "63470321-4dfa-4159-99f5-7c5480fa8d13", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1954691505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "676f4701774b4f98903b64e0de079504", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap662344a5-a5", "ovs_interfaceid": "662344a5-a569-4f3d-ad66-77fed104617b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922852.646201) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:00:52.652373 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:00:52.653248 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:00:52.654543 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:00:52.655011 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:00:52.656989 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:00:52.657080 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:00:52.657266 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:00:52.657460 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:00:52.657667 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:00:52.661999 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:00:52.662164 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:00:52.662377 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:00:52.662808 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:00:52.662982 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:00:52.663093 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:00:52.663236 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:00:52.675689 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1083517067',display_name='tempest-DeleteServersTestJSON-server-1083517067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-deleteserverstestjson-server-1083517067',id=8,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='676f4701774b4f98903b64e0de079504',ramdisk_id='',reservation_id='r-89017auh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-932935839',owner_user_name='tempest-DeleteServersTestJSON-932935839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:50Z,user_data=None,user_id='f229055e36b2440ca4ef65af175b403b',uuid=4000f391-003d-4de9-ad03-792bbd0e5e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "662344a5-a569-4f3d-ad66-77fed104617b", "address": "fa:16:3e:61:c5:16", "network": {"id": "63470321-4dfa-4159-99f5-7c5480fa8d13", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1954691505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "676f4701774b4f98903b64e0de079504", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap662344a5-a5", "ovs_interfaceid": "662344a5-a569-4f3d-ad66-77fed104617b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:00:52.675689 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Converting VIF {"id": "662344a5-a569-4f3d-ad66-77fed104617b", "address": "fa:16:3e:61:c5:16", "network": {"id": "63470321-4dfa-4159-99f5-7c5480fa8d13", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1954691505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "676f4701774b4f98903b64e0de079504", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap662344a5-a5", "ovs_interfaceid": "662344a5-a569-4f3d-ad66-77fed104617b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:52.676276 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:c5:16,bridge_name='br-int',has_traffic_filtering=True,id=662344a5-a569-4f3d-ad66-77fed104617b,network=Network(63470321-4dfa-4159-99f5-7c5480fa8d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662344a5-a5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:52.676850 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lazy-loading 'pci_devices' on Instance uuid 4000f391-003d-4de9-ad03-792bbd0e5e0b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:00:52.741480 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:00:52.755532 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3132be51-d139-48a4-b5ed-a25d21a76c5f req-b66b6263-cb7e-447d-a5a7-40f89b9f3ba6 service nova] Releasing lock "refresh_cache-3438591d-5ed5-45ed-8875-256372fc8333" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:52.825134 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Took 31.30 seconds to spawn the instance on the hypervisor.
May 27 23:00:52.825315 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:52.905985 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:53.001416 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:53.004473 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922853.0042114, aee84b65-41d8-427d-96d0-cd328e4863ba => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:53.004655 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] VM Resumed (Lifecycle Event)
May 27 23:00:53.144486 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:53.179892 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] End _get_guest_xml xml=<domain type="qemu">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <uuid>4000f391-003d-4de9-ad03-792bbd0e5e0b</uuid>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <name>instance-00000008</name>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <nova:name>tempest-DeleteServersTestJSON-server-1083517067</nova:name>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:00:52</nova:creationTime>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:user uuid="f229055e36b2440ca4ef65af175b403b">tempest-DeleteServersTestJSON-932935839-project-member</nova:user>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:project uuid="676f4701774b4f98903b64e0de079504">tempest-DeleteServersTestJSON-932935839</nova:project>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         <nova:port uuid="662344a5-a569-4f3d-ad66-77fed104617b">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <system>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <entry name="serial">4000f391-003d-4de9-ad03-792bbd0e5e0b</entry>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <entry name="uuid">4000f391-003d-4de9-ad03-792bbd0e5e0b</entry>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     </system>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <os>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   </os>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <features>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   </features>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   <devices>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk.config"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:61:c5:16"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <target dev="tap662344a5-a5"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     </interface>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/console.log" append="off"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     </serial>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <video>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     </video>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     </rng>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:   </devices>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]: </domain>
May 27 23:00:53.179892 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:00:53.182625 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Preparing to wait for external event network-vif-plugged-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:00:53.182625 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:53.182625 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:53.182625 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:53.182625 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1083517067',display_name='tempest-DeleteServersTestJSON-server-1083517067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-deleteserverstestjson-server-1083517067',id=8,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='676f4701774b4f98903b64e0de079504',ramdisk_id='',reservation_id='r-89017auh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-932935839',owner_user_name='tempest-DeleteServersTestJSON-932935839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:50Z,user_data=None,user_id='f229055e36b2440ca4ef65af175b403b',uuid=4000f391-003d-4de9-ad03-792bbd0e5e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "662344a5-a569-4f3d-ad66-77fed104617b", "address": "fa:16:3e:61:c5:16", "network": {"id": "63470321-4dfa-4159-99f5-7c5480fa8d13", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1954691505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "676f4701774b4f98903b64e0de079504", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap662344a5-a5", "ovs_interfaceid": "662344a5-a569-4f3d-ad66-77fed104617b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:00:53.182830 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Converting VIF {"id": "662344a5-a569-4f3d-ad66-77fed104617b", "address": "fa:16:3e:61:c5:16", "network": {"id": "63470321-4dfa-4159-99f5-7c5480fa8d13", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1954691505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "676f4701774b4f98903b64e0de079504", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap662344a5-a5", "ovs_interfaceid": "662344a5-a569-4f3d-ad66-77fed104617b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:53.182830 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:c5:16,bridge_name='br-int',has_traffic_filtering=True,id=662344a5-a569-4f3d-ad66-77fed104617b,network=Network(63470321-4dfa-4159-99f5-7c5480fa8d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662344a5-a5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:53.184495 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:c5:16,bridge_name='br-int',has_traffic_filtering=True,id=662344a5-a569-4f3d-ad66-77fed104617b,network=Network(63470321-4dfa-4159-99f5-7c5480fa8d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662344a5-a5') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:00:53.184495 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:53.184495 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:53.184495 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:00:53.184906 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:53.184906 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '182259f0-803a-5b42-88f6-36e4c87f7f09', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:53.186540 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:53.187467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:53.187856 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:53.191678 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:53.192074 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap662344a5-a5, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:53.192379 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap662344a5-a5, col_values=(('qos', UUID('cd47ef45-f1a6-407a-8618-10cff717d922')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:53.192592 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap662344a5-a5, col_values=(('external_ids', {'iface-id': '662344a5-a569-4f3d-ad66-77fed104617b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:c5:16', 'vm-uuid': '4000f391-003d-4de9-ad03-792bbd0e5e0b'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:53.193584 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:53.196089 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:53.202536 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:53.203974 np0000001565 nova-compute[98289]: INFO os_vif [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:c5:16,bridge_name='br-int',has_traffic_filtering=True,id=662344a5-a569-4f3d-ad66-77fed104617b,network=Network(63470321-4dfa-4159-99f5-7c5480fa8d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662344a5-a5')
May 27 23:00:53.254737 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.868s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:53.256966 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.505s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:53.258235 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:00:53.341596 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Took 36.56 seconds to build instance.
May 27 23:00:53.508720 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:53.510666 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:53.597667 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:53.784406 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Updated VIF entry in instance network info cache for port 662344a5-a569-4f3d-ad66-77fed104617b. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:00:53.785163 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Updating instance_info_cache with network_info: [{"id": "662344a5-a569-4f3d-ad66-77fed104617b", "address": "fa:16:3e:61:c5:16", "network": {"id": "63470321-4dfa-4159-99f5-7c5480fa8d13", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1954691505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "676f4701774b4f98903b64e0de079504", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap662344a5-a5", "ovs_interfaceid": "662344a5-a569-4f3d-ad66-77fed104617b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:53.788009 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:00:53.788009 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:00:53.789259 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:53.791115 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:53.846461 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-158a37d3-278b-481c-875f-1787cb0b0e06 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.073s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:53.886199 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77950bc2ac63423a8d5840370f33d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f043ce59c483a85bfdeaa3b04eb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:00:54.013191 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922854.0129097, 119d02f0-0974-4fa4-9d6a-ecfefe01e029 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:54.013607 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] VM Resumed (Lifecycle Event)
May 27 23:00:54.295464 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:00:54.302121 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Releasing lock "refresh_cache-4000f391-003d-4de9-ad03-792bbd0e5e0b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:54.302277 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:54.302446 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:54.302628 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:54.302772 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:54.302818 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Processing event network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:00:54.302939 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:54.303075 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:54.303192 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:54.303272 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:54.303410 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] No waiting events found dispatching network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:00:54.303557 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-4540b0fd-0e13-4208-8d24-9247be57fcff req-f87eb96c-6294-47a2-bd9a-e3b11648a195 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received unexpected event network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 for instance with vm_state building and task_state spawning.
May 27 23:00:54.304145 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Instance event wait completed in 13 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:00:54.311636 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:00:54.314698 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Instance spawned successfully.
May 27 23:00:54.316479 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:00:54.368882 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 119d02f0-0974-4fa4-9d6a-ecfefe01e029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:00:54.370794 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 489adb12-811c-408c-af3f-24edcfc9d4bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:00:54.370794 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 13686e4c-ae8e-4837-a71f-2d710575ab33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:00:54.370794 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance a0070282-e138-405c-b6c8-3478991d03f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:00:54.370794 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 3438591d-5ed5-45ed-8875-256372fc8333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:00:54.370794 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance f31ea991-4cf8-43e7-9d65-cfb193c3413a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:00:54.370794 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance aee84b65-41d8-427d-96d0-cd328e4863ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:00:54.370794 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 4000f391-003d-4de9-ad03-792bbd0e5e0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:00:54.370794 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:00:54.370794 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:00:54.370794 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:00:51 up 29 min,  2 users,  load average: 7.10, 2.95, 1.37\n', 'num_instances': '9', 'num_vm_active': '6', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_7efe372c67374c55bd40d7757474f80a': '2', 'io_workload': '3', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_a3864f7301d84dbdbbb57d5a3ff0d764': '1', 'num_proj_e563b54a24044564bd9f42d080e21b90': '1', 'num_proj_b17fb0c9be4c4d30bd907eb08e2c5e3e': '1', 'num_proj_88e334950e7c432ca356cbe67e72c44d': '2', 'num_proj_676f4701774b4f98903b64e0de079504': '1', 'num_proj_321f043ce59c483a85bfdeaa3b04eb4e': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:00:54.519209 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:54.525050 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:54.594933 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Successfully created port: 039e01d5-9a94-446c-a16c-fc2c425033f4 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:00:54.723913 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:54.725686 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:00:54.725686 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] No VIF found with MAC fa:16:3e:61:c5:16, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:00:54.725686 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Using config drive
May 27 23:00:54.765507 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-420a0643-9abb-4127-9292-6990f699318d req-679d060b-1a6c-4f34-ae16-f528a8451b2e service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received event network-changed-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:54.765660 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-420a0643-9abb-4127-9292-6990f699318d req-679d060b-1a6c-4f34-ae16-f528a8451b2e service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Refreshing instance network info cache due to event network-changed-899734d7-d351-4e8e-9021-71e58ffa2734. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:54.765849 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-420a0643-9abb-4127-9292-6990f699318d req-679d060b-1a6c-4f34-ae16-f528a8451b2e service nova] Acquiring lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:54.765977 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-420a0643-9abb-4127-9292-6990f699318d req-679d060b-1a6c-4f34-ae16-f528a8451b2e service nova] Acquired lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:54.766130 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-420a0643-9abb-4127-9292-6990f699318d req-679d060b-1a6c-4f34-ae16-f528a8451b2e service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Refreshing network info cache for port 899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:54.801275 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:00:54.826085 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:54.826265 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:54.826636 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:54.826954 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:54.827276 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:54.827609 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:00:55.019042 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:00:55.019563 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:00:55.028562 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922855.0282238, 489adb12-811c-408c-af3f-24edcfc9d4bb => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:55.028710 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] VM Resumed (Lifecycle Event)
May 27 23:00:55.230613 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:55.276414 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-420a0643-9abb-4127-9292-6990f699318d req-679d060b-1a6c-4f34-ae16-f528a8451b2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:55.281882 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Successfully updated port: 039e01d5-9a94-446c-a16c-fc2c425033f4 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:00:55.339173 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Took 23.50 seconds to spawn the instance on the hypervisor.
May 27 23:00:55.341305 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:55.373101 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7e45ea12-7e8e-4298-9901-a19ca7672311 req-ec479d19-08c5-4c4d-b626-ead7846373bb service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Received event network-changed-039e01d5-9a94-446c-a16c-fc2c425033f4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:55.373101 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7e45ea12-7e8e-4298-9901-a19ca7672311 req-ec479d19-08c5-4c4d-b626-ead7846373bb service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Refreshing instance network info cache due to event network-changed-039e01d5-9a94-446c-a16c-fc2c425033f4. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:00:55.373101 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7e45ea12-7e8e-4298-9901-a19ca7672311 req-ec479d19-08c5-4c4d-b626-ead7846373bb service nova] Acquiring lock "refresh_cache-1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:55.373101 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7e45ea12-7e8e-4298-9901-a19ca7672311 req-ec479d19-08c5-4c4d-b626-ead7846373bb service nova] Acquired lock "refresh_cache-1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:55.373101 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7e45ea12-7e8e-4298-9901-a19ca7672311 req-ec479d19-08c5-4c4d-b626-ead7846373bb service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Refreshing network info cache for port 039e01d5-9a94-446c-a16c-fc2c425033f4 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:00:55.487724 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Creating config drive at /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk.config
May 27 23:00:55.495086 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp753ta62h {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:55.526134 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:00:55.538367 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp753ta62h" returned: 0 in 0.043s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:55.539547 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:55.544581 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:55.751431 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-420a0643-9abb-4127-9292-6990f699318d req-679d060b-1a6c-4f34-ae16-f528a8451b2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:55.789646 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "refresh_cache-1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:55.822683 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:00:55.823859 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:00:55.824115 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Creating image(s)
May 27 23:00:55.824646 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:55.824838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "/opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:55.825317 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "/opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:55.825890 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:55.828688 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:55.830285 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:55.878351 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7e45ea12-7e8e-4298-9901-a19ca7672311 req-ec479d19-08c5-4c4d-b626-ead7846373bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:55.883933 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Took 28.83 seconds to build instance.
May 27 23:00:55.943865 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.113s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:55.944744 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:55.946052 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:55.946709 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:55.957356 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:00:55.958016 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:56.033292 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7e45ea12-7e8e-4298-9901-a19ca7672311 req-ec479d19-08c5-4c4d-b626-ead7846373bb service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:56.046307 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:00:56.046665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.792s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:56.052013 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.23 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:00:56.088554 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-420a0643-9abb-4127-9292-6990f699318d req-679d060b-1a6c-4f34-ae16-f528a8451b2e service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Updated VIF entry in instance network info cache for port 899734d7-d351-4e8e-9021-71e58ffa2734. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:00:56.096149 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-420a0643-9abb-4127-9292-6990f699318d req-679d060b-1a6c-4f34-ae16-f528a8451b2e service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Updating instance_info_cache with network_info: [{"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:56.101034 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.140s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:56.101034 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:56.143924 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:56.154947 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk 1073741824" returned: 0 in 0.055s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:56.154947 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:56.154947 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:56.171813 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:56.249226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:56.249718 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:00:56.250029 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:00:56.320953 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7e45ea12-7e8e-4298-9901-a19ca7672311 req-ec479d19-08c5-4c4d-b626-ead7846373bb service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:56.336743 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:56.360224 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:00:56.360793 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Cannot resize image /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:00:56.362295 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:00:56.362805 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Ensure instance console log exists: /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:00:56.363427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:56.364720 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:56.364720 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:56.389272 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c067e4a-adb0-4043-9cec-e748c0e0f751 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.344s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:56.579510 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:56.581525 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:56.585273 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:56.608598 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:56.609799 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-420a0643-9abb-4127-9292-6990f699318d req-679d060b-1a6c-4f34-ae16-f528a8451b2e service nova] Releasing lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:56.828308 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7e45ea12-7e8e-4298-9901-a19ca7672311 req-ec479d19-08c5-4c4d-b626-ead7846373bb service nova] Releasing lock "refresh_cache-1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:56.828695 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquired lock "refresh_cache-1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:56.828887 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:00:57.067988 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922857.0674834, 4000f391-003d-4de9-ad03-792bbd0e5e0b => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:57.068661 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] VM Started (Lifecycle Event)
May 27 23:00:57.396726 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:00:57.556270 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Rescuing
May 27 23:00:57.556640 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "refresh_cache-489adb12-811c-408c-af3f-24edcfc9d4bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:00:57.556723 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquired lock "refresh_cache-489adb12-811c-408c-af3f-24edcfc9d4bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:00:57.556869 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:00:57.571692 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:57.573982 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922857.5737486, 4000f391-003d-4de9-ad03-792bbd0e5e0b => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:00:57.574099 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] VM Paused (Lifecycle Event)
May 27 23:00:57.613982 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:57.790982 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Updating instance_info_cache with network_info: [{"id": "039e01d5-9a94-446c-a16c-fc2c425033f4", "address": "fa:16:3e:2b:21:a3", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap039e01d5-9a", "ovs_interfaceid": "039e01d5-9a94-446c-a16c-fc2c425033f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:57.909216 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:58.061246 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:58.076250 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:00:58.079765 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:00:58.196051 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:58.293930 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Releasing lock "refresh_cache-1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:00:58.294176 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Instance network_info: |[{"id": "039e01d5-9a94-446c-a16c-fc2c425033f4", "address": "fa:16:3e:2b:21:a3", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap039e01d5-9a", "ovs_interfaceid": "039e01d5-9a94-446c-a16c-fc2c425033f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:00:58.299673 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Start _get_guest_xml network_info=[{"id": "039e01d5-9a94-446c-a16c-fc2c425033f4", "address": "fa:16:3e:2b:21:a3", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap039e01d5-9a", "ovs_interfaceid": "039e01d5-9a94-446c-a16c-fc2c425033f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:00:58.305994 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:00:58.305994 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-103161366', uuid='1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a'), owner=OwnerMeta(userid='77950bc2ac63423a8d5840370f33d411', username='tempest-ServersNegativeTestJSON-1019668163-project-member', projectid='321f043ce59c483a85bfdeaa3b04eb4e', projectname='tempest-ServersNegativeTestJSON-1019668163'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "039e01d5-9a94-446c-a16c-fc2c425033f4", "address": "fa:16:3e:2b:21:a3", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap039e01d5-9a", "ovs_interfaceid": "039e01d5-9a94-446c-a16c-fc2c425033f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922858.3037047) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:00:58.308111 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:00:58.308500 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:00:58.309137 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:00:58.309315 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:00:58.310252 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:00:58.310648 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:00:58.310817 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:00:58.310959 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:00:58.311143 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:00:58.311257 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:00:58.311257 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:00:58.311477 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:00:58.311619 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:00:58.311763 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:00:58.311905 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:00:58.312072 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:00:58.330572 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-103161366',display_name='tempest-ServersNegativeTestJSON-server-103161366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serversnegativetestjson-server-103161366',id=9,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='321f043ce59c483a85bfdeaa3b04eb4e',ramdisk_id='',reservation_id='r-09o5buma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1019668163',owner_user_name='tempest-ServersNegativeTestJSON-1019668163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:55Z,user_data=None,user_id='77950bc2ac63423a8d5840370f33d411',uuid=1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "039e01d5-9a94-446c-a16c-fc2c425033f4", "address": "fa:16:3e:2b:21:a3", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap039e01d5-9a", "ovs_interfaceid": "039e01d5-9a94-446c-a16c-fc2c425033f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:00:58.330846 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converting VIF {"id": "039e01d5-9a94-446c-a16c-fc2c425033f4", "address": "fa:16:3e:2b:21:a3", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap039e01d5-9a", "ovs_interfaceid": "039e01d5-9a94-446c-a16c-fc2c425033f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:58.331490 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:21:a3,bridge_name='br-int',has_traffic_filtering=True,id=039e01d5-9a94-446c-a16c-fc2c425033f4,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039e01d5-9a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:58.335109 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:00:58.443312 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:00:58.582489 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:00:58.635026 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Updating instance_info_cache with network_info: [{"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:00:58.836863 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] End _get_guest_xml xml=<domain type="qemu">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <uuid>1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a</uuid>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <name>instance-00000009</name>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServersNegativeTestJSON-server-103161366</nova:name>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:00:58</nova:creationTime>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:user uuid="77950bc2ac63423a8d5840370f33d411">tempest-ServersNegativeTestJSON-1019668163-project-member</nova:user>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:project uuid="321f043ce59c483a85bfdeaa3b04eb4e">tempest-ServersNegativeTestJSON-1019668163</nova:project>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         <nova:port uuid="039e01d5-9a94-446c-a16c-fc2c425033f4">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <system>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <entry name="serial">1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a</entry>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <entry name="uuid">1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a</entry>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     </system>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <os>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   </os>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <features>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   </features>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   <devices>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk.config"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     </disk>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:2b:21:a3"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <target dev="tap039e01d5-9a"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     </interface>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/console.log" append="off"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     </serial>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <video>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     </video>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     </rng>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:   </devices>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]: </domain>
May 27 23:00:58.836863 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:00:58.839620 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Preparing to wait for external event network-vif-plugged-039e01d5-9a94-446c-a16c-fc2c425033f4 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:00:58.839620 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:58.839620 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:58.839620 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:58.839620 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-103161366',display_name='tempest-ServersNegativeTestJSON-server-103161366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serversnegativetestjson-server-103161366',id=9,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='321f043ce59c483a85bfdeaa3b04eb4e',ramdisk_id='',reservation_id='r-09o5buma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1019668163',owner_user_name='tempest-ServersNegativeTestJSON-1019668163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:55Z,user_data=None,user_id='77950bc2ac63423a8d5840370f33d411',uuid=1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "039e01d5-9a94-446c-a16c-fc2c425033f4", "address": "fa:16:3e:2b:21:a3", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap039e01d5-9a", "ovs_interfaceid": "039e01d5-9a94-446c-a16c-fc2c425033f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:00:58.839958 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converting VIF {"id": "039e01d5-9a94-446c-a16c-fc2c425033f4", "address": "fa:16:3e:2b:21:a3", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap039e01d5-9a", "ovs_interfaceid": "039e01d5-9a94-446c-a16c-fc2c425033f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:00:58.840621 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:21:a3,bridge_name='br-int',has_traffic_filtering=True,id=039e01d5-9a94-446c-a16c-fc2c425033f4,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039e01d5-9a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:00:58.841102 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:21:a3,bridge_name='br-int',has_traffic_filtering=True,id=039e01d5-9a94-446c-a16c-fc2c425033f4,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039e01d5-9a') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:00:58.841500 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:58.841789 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:58.842140 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:00:58.844184 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:58.844184 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1924ef6-4af9-578c-8945-929944ac86d5', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:58.845692 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:58.847054 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:58.849155 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:58.849557 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap039e01d5-9a, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:58.850062 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap039e01d5-9a, col_values=(('qos', UUID('5efe2e50-ee7b-4642-bf29-4109f7847334')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:58.850859 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap039e01d5-9a, col_values=(('external_ids', {'iface-id': '039e01d5-9a94-446c-a16c-fc2c425033f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:21:a3', 'vm-uuid': '1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:00:58.852609 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:58.854959 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:00:58.859650 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:00:58.861483 np0000001565 nova-compute[98289]: INFO os_vif [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:21:a3,bridge_name='br-int',has_traffic_filtering=True,id=039e01d5-9a94-446c-a16c-fc2c425033f4,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039e01d5-9a')
May 27 23:00:59.082875 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d57ca6e7-258a-446d-8c35-2b3c1dd52652 req-5890b0eb-3848-4edf-b665-e9e3931c4593 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Received event network-vif-unplugged-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:00:59.084037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d57ca6e7-258a-446d-8c35-2b3c1dd52652 req-5890b0eb-3848-4edf-b665-e9e3931c4593 service nova] Acquiring lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:00:59.084037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d57ca6e7-258a-446d-8c35-2b3c1dd52652 req-5890b0eb-3848-4edf-b665-e9e3931c4593 service nova] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:00:59.084037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d57ca6e7-258a-446d-8c35-2b3c1dd52652 req-5890b0eb-3848-4edf-b665-e9e3931c4593 service nova] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:00:59.084037 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d57ca6e7-258a-446d-8c35-2b3c1dd52652 req-5890b0eb-3848-4edf-b665-e9e3931c4593 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] No event matching network-vif-unplugged-662344a5-a569-4f3d-ad66-77fed104617b in dict_keys([('network-vif-plugged', '662344a5-a569-4f3d-ad66-77fed104617b')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:00:59.084037 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-d57ca6e7-258a-446d-8c35-2b3c1dd52652 req-5890b0eb-3848-4edf-b665-e9e3931c4593 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Received unexpected event network-vif-unplugged-662344a5-a569-4f3d-ad66-77fed104617b for instance with vm_state building and task_state spawning.
May 27 23:00:59.136775 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Releasing lock "refresh_cache-489adb12-811c-408c-af3f-24edcfc9d4bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:00.376987 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:00.377393 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:00.377393 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] No VIF found with MAC fa:16:3e:2b:21:a3, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:00.377761 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Using config drive
May 27 23:01:00.822913 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:00.844019 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:00.885167 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:00.986969 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:00.997772 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:01.060008 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Creating config drive at /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk.config
May 27 23:01:01.062484 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt1p858ye {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:01.097460 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt1p858ye" returned: 0 in 0.035s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:01.171770 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Received event network-vif-plugged-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:01.174877 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] Acquiring lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:01.175096 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:01.175267 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:01.175432 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Processing event network-vif-plugged-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:01:01.175615 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Received event network-vif-plugged-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:01.175770 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] Acquiring lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:01.175858 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:01.175970 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:01.176088 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] No waiting events found dispatching network-vif-plugged-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:01.176210 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Received unexpected event network-vif-plugged-662344a5-a569-4f3d-ad66-77fed104617b for instance with vm_state building and task_state spawning.
May 27 23:01:01.176314 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:01.176457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:01.176595 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:01.176702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:01.176805 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] No waiting events found dispatching network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:01.176917 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3bc77d81-64c1-4e41-91f4-d7d32959c2fa req-1b3c965f-de81-4db0-9304-2d2398bd567c service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received unexpected event network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 for instance with vm_state active and task_state rescuing.
May 27 23:01:01.177924 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:01:01.181268 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:01:01.182137 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922861.181811, 4000f391-003d-4de9-ad03-792bbd0e5e0b => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:01.182315 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] VM Resumed (Lifecycle Event)
May 27 23:01:01.188832 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Instance spawned successfully.
May 27 23:01:01.189308 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:01:01.233100 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Instance destroyed successfully.
May 27 23:01:01.233413 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'numa_topology' on Instance uuid 489adb12-811c-408c-af3f-24edcfc9d4bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:01.631599 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:01.666703 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:01.666703 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:01.691553 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:01.697290 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:01.705187 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:01.705187 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:01.705187 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:01.705187 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:01.705634 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:01.706123 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:01.748046 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Attempting rescue
May 27 23:01:01.750067 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98289) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 23:01:01.754410 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Instance directory exists: not creating {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 23:01:01.754410 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Creating image(s)
May 27 23:01:01.756417 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:01.758929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:01.760364 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:01.760364 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'trusted_certs' on Instance uuid 489adb12-811c-408c-af3f-24edcfc9d4bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:01.795156 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:01.865301 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-43636ce4-2020-4708-9de3-49831b82f7c3 req-2c91de50-a566-4394-8ce8-1f109571284d service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Received event network-vif-plugged-039e01d5-9a94-446c-a16c-fc2c425033f4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:01.865301 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-43636ce4-2020-4708-9de3-49831b82f7c3 req-2c91de50-a566-4394-8ce8-1f109571284d service nova] Acquiring lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:01.865301 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-43636ce4-2020-4708-9de3-49831b82f7c3 req-2c91de50-a566-4394-8ce8-1f109571284d service nova] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:01.865301 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-43636ce4-2020-4708-9de3-49831b82f7c3 req-2c91de50-a566-4394-8ce8-1f109571284d service nova] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:01.865301 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-43636ce4-2020-4708-9de3-49831b82f7c3 req-2c91de50-a566-4394-8ce8-1f109571284d service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Processing event network-vif-plugged-039e01d5-9a94-446c-a16c-fc2c425033f4 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:01:02.059425 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:02.068560 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:02.075564 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:02.097521 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:02.105558 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:02.200193 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:01:02.201043 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.9993387479999 future=<Future at 0x726e60190680 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:02.201469 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998942838999938 future=<Future at 0x726e60190680 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:02.201602 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998741263000056 future=<Future at 0x726e60190680 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:02.212904 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Took 11.41 seconds to spawn the instance on the hypervisor.
May 27 23:01:02.213082 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:02.267989 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<489adb12-811c-408c-af3f-24edcfc9d4bb> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:02.268668 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:02.273551 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:02.274719 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:02.275455 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:02.275816 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:02.280392 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:02.280850 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:02.359597 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.078s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:02.360022 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:02.393777 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue" returned: 0 in 0.033s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:02.393777 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.118s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:02.393914 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'migration_context' on Instance uuid 489adb12-811c-408c-af3f-24edcfc9d4bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:02.514385 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922862.5120664, 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:02.514916 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] VM Started (Lifecycle Event)
May 27 23:01:02.516669 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:01:02.520059 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:01:02.521810 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Instance spawned successfully.
May 27 23:01:02.522381 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:01:02.721742 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Took 17.15 seconds to build instance.
May 27 23:01:02.897255 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<489adb12-811c-408c-af3f-24edcfc9d4bb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:02.897537 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:01:02.898065 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Start _get_guest_xml network_info=[{"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:67:1b:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:01:02.898245 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'resources' on Instance uuid 489adb12-811c-408c-af3f-24edcfc9d4bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:02.919640 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:03.018749 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:03.020579 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:03.033013 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:03.033157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:03.033553 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:03.033765 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:03.034033 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:03.034279 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:03.223487 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.663s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:03.244613 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-77ffdfd3-ea1b-493f-a49d-4fbb4be37e8c req-d495013d-5332-4e14-ad44-34cb6e897204 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:03.244767 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-77ffdfd3-ea1b-493f-a49d-4fbb4be37e8c req-d495013d-5332-4e14-ad44-34cb6e897204 service nova] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:03.244945 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-77ffdfd3-ea1b-493f-a49d-4fbb4be37e8c req-d495013d-5332-4e14-ad44-34cb6e897204 service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:03.245264 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-77ffdfd3-ea1b-493f-a49d-4fbb4be37e8c req-d495013d-5332-4e14-ad44-34cb6e897204 service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:03.245467 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-77ffdfd3-ea1b-493f-a49d-4fbb4be37e8c req-d495013d-5332-4e14-ad44-34cb6e897204 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] No waiting events found dispatching network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:03.245592 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-77ffdfd3-ea1b-493f-a49d-4fbb4be37e8c req-d495013d-5332-4e14-ad44-34cb6e897204 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received unexpected event network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 for instance with vm_state active and task_state rescuing.
May 27 23:01:03.400311 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<489adb12-811c-408c-af3f-24edcfc9d4bb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:03.401749 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:01:03.402989 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-602165631', uuid='489adb12-811c-408c-af3f-24edcfc9d4bb'), owner=OwnerMeta(userid='8d33b630152d4b96949f3afbb65d7115', username='tempest-ServerRescueNegativeTestJSON-550001831-project-member', projectid='7efe372c67374c55bd40d7757474f80a', projectname='tempest-ServerRescueNegativeTestJSON-550001831'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:67:1b:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922863.402599) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:01:03.404581 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:01:03.404951 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:01:03.405549 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:01:03.405706 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:01:03.406614 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:01:03.406916 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:01:03.407037 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:01:03.407132 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:01:03.407268 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:01:03.407371 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:01:03.407480 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:01:03.407620 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:01:03.407714 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:01:03.407851 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:01:03.407939 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:01:03.408049 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:01:03.408231 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'vcpu_model' on Instance uuid 489adb12-811c-408c-af3f-24edcfc9d4bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:03.522872 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:01:03.522872 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922863.5216742, 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:03.522872 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] VM Paused (Lifecycle Event)
May 27 23:01:03.539027 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Took 7.72 seconds to spawn the instance on the hypervisor.
May 27 23:01:03.539590 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:03.852699 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:03.911119 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<489adb12-811c-408c-af3f-24edcfc9d4bb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:03.933952 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-602165631',display_name='tempest-ServerRescueNegativeTestJSON-server-602165631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-602165631',id=2,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:55Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-0koevn0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:55Z,user_data=None,user_id='8d33b630152d4b96949f3afbb65d7115',uuid=489adb12-811c-408c-af3f-24edcfc9d4bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:67:1b:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:01:03.934120 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:67:1b:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:03.934752 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=4dc65314-8dc9-4ca6-a74b-2cb818efd866,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc65314-8d') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:03.935974 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'pci_devices' on Instance uuid 489adb12-811c-408c-af3f-24edcfc9d4bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:03.939481 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b4fd93e-7867-4be2-9857-d7899512e6b8 req-9aae4f10-c1bd-4f7e-b9ef-f0903c9a1907 service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Received event network-vif-plugged-039e01d5-9a94-446c-a16c-fc2c425033f4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:03.939676 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b4fd93e-7867-4be2-9857-d7899512e6b8 req-9aae4f10-c1bd-4f7e-b9ef-f0903c9a1907 service nova] Acquiring lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:03.942403 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b4fd93e-7867-4be2-9857-d7899512e6b8 req-9aae4f10-c1bd-4f7e-b9ef-f0903c9a1907 service nova] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:03.942403 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b4fd93e-7867-4be2-9857-d7899512e6b8 req-9aae4f10-c1bd-4f7e-b9ef-f0903c9a1907 service nova] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:03.942403 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b4fd93e-7867-4be2-9857-d7899512e6b8 req-9aae4f10-c1bd-4f7e-b9ef-f0903c9a1907 service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] No waiting events found dispatching network-vif-plugged-039e01d5-9a94-446c-a16c-fc2c425033f4 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:03.942403 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3b4fd93e-7867-4be2-9857-d7899512e6b8 req-9aae4f10-c1bd-4f7e-b9ef-f0903c9a1907 service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Received unexpected event network-vif-plugged-039e01d5-9a94-446c-a16c-fc2c425033f4 for instance with vm_state active and task_state None.
May 27 23:01:04.025100 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:04.028017 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922864.0266235, 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:04.028017 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] VM Resumed (Lifecycle Event)
May 27 23:01:04.047446 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Took 13.71 seconds to build instance.
May 27 23:01:04.169520 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:04.169659 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:04.438075 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<489adb12-811c-408c-af3f-24edcfc9d4bb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:04.439092 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] End _get_guest_xml xml=<domain type="qemu">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <uuid>489adb12-811c-408c-af3f-24edcfc9d4bb</uuid>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <name>instance-00000002</name>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-602165631</nova:name>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:01:03</nova:creationTime>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:user uuid="8d33b630152d4b96949f3afbb65d7115">tempest-ServerRescueNegativeTestJSON-550001831-project-member</nova:user>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:project uuid="7efe372c67374c55bd40d7757474f80a">tempest-ServerRescueNegativeTestJSON-550001831</nova:project>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         <nova:port uuid="4dc65314-8dc9-4ca6-a74b-2cb818efd866">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <system>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <entry name="serial">489adb12-811c-408c-af3f-24edcfc9d4bb</entry>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <entry name="uuid">489adb12-811c-408c-af3f-24edcfc9d4bb</entry>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     </system>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <os>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   </os>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <features>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   </features>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   <devices>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.config.rescue"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:67:1b:a1"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <target dev="tap4dc65314-8d"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     </interface>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/console.log" append="off"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     </serial>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <video>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     </video>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     </rng>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:   </devices>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]: </domain>
May 27 23:01:04.439092 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:01:04.445396 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Instance destroyed successfully.
May 27 23:01:04.531922 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:04.534273 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:04.549216 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.221s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:04.673290 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lazy-loading 'flavor' on Instance uuid 4000f391-003d-4de9-ad03-792bbd0e5e0b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:05.681768 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:05.968662 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:05.968790 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:05.968945 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:05.969077 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No VIF found with MAC fa:16:3e:67:1b:a1, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:05.969610 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Using config drive
May 27 23:01:06.472811 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'ec2_ids' on Instance uuid 489adb12-811c-408c-af3f-24edcfc9d4bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:06.517095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "aed73162-7eae-4c10-98c8-3044b4aaa820" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:06.517570 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:06.978931 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<489adb12-811c-408c-af3f-24edcfc9d4bb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:06.979472 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'keypairs' on Instance uuid 489adb12-811c-408c-af3f-24edcfc9d4bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:07.022841 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:01:07.276047 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:07.276152 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:07.276354 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Attaching volume a0995b0b-ee50-4a67-967a-dc871bf866a6 to /dev/vdb
May 27 23:01:07.335279 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:07.335974 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmph7eus0yi/privsep.sock']
May 27 23:01:07.343158 np0000001565 sudo[111396]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmph7eus0yi/privsep.sock
May 27 23:01:07.343845 np0000001565 sudo[111396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 27 23:01:07.496016 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<489adb12-811c-408c-af3f-24edcfc9d4bb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:07.500548 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:07.620966 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:07.624895 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:07.628177 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:01:07.631711 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Claim successful on node np0000001565
May 27 23:01:07.663693 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 27 23:01:07.663812 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 23:01:07.663889 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 23:01:07.663973 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:01:07.664051 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 23:01:07.664117 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 23:01:07.664182 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 23:01:07.664269 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:01:07.664350 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 27 23:01:07.741376 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Creating config drive at /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.config.rescue
May 27 23:01:07.744213 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsxfspod1 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:07.777916 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsxfspod1" returned: 0 in 0.033s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:07.921857 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:08.029982 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 27 23:01:08.030411 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 23:01:08.030411 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 23:01:08.030411 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:01:08.030411 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 23:01:08.030411 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 23:01:08.030544 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 23:01:08.030544 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 23:01:08.030589 np0000001565 nova-compute[98289]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 27 23:01:08.249638 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:08.274101 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:08.275202 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:08.337719 np0000001565 sudo[111396]: pam_unix(sudo:session): session closed for user root
May 27 23:01:08.341518 np0000001565 nova-compute[98289]: INFO oslo.privsep.daemon [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Spawned new privsep daemon via rootwrap
May 27 23:01:08.419528 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:08.446404 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:01:08.446544 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.nvmeof [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 27 23:01:08.476726 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:08.492696 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:08.505191 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dd6589a0-2cf4-411a-84cf-d2f1a1413f69 req-cf9816d5-6478-40ce-bc98-9ed5933a688d service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:08.508748 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd6589a0-2cf4-411a-84cf-d2f1a1413f69 req-cf9816d5-6478-40ce-bc98-9ed5933a688d service nova] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:08.509690 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd6589a0-2cf4-411a-84cf-d2f1a1413f69 req-cf9816d5-6478-40ce-bc98-9ed5933a688d service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:08.509893 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd6589a0-2cf4-411a-84cf-d2f1a1413f69 req-cf9816d5-6478-40ce-bc98-9ed5933a688d service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:08.510081 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dd6589a0-2cf4-411a-84cf-d2f1a1413f69 req-cf9816d5-6478-40ce-bc98-9ed5933a688d service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] No waiting events found dispatching network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:08.510229 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-dd6589a0-2cf4-411a-84cf-d2f1a1413f69 req-cf9816d5-6478-40ce-bc98-9ed5933a688d service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received unexpected event network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 for instance with vm_state active and task_state rescuing.
May 27 23:01:08.512050 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:01:08.514727 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:01:08.531100 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:01:08.533066 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe38:c53a', 'fe80::cc7a:76ff:fe01:2cc5', 'fe80::fc16:3eff:fef7:298e', 'fe80::90cc:87ff:fe39:148b', 'fe80::fc16:3eff:fe2e:138c', 'fe80::68e2:adff:fe5e:9fb', 'fe80::fc16:3eff:fecb:dbbd', 'fe80::b0f9:b0ff:fe67:8049', 'fe80::fc16:3eff:fed4:3882', 'fe80::fc16:3eff:fe61:c516', 'fe80::f4df:8fff:fe42:24aa', 'fe80::fc16:3eff:fe2b:21a3', 'fe80::48b6:7aff:feda:b750', 'fe80::fc16:3eff:fe67:1ba1'] 
May 27 23:01:08.533215 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:01:08.534943 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:01:08.535540 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] <== get_connector_properties: return (1199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:08.535540 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Updating existing volume attachment record: 875dce1c-4cb8-4dca-9cb2-b653b79c7d73 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:01:08.853790 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:09.122349 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 489adb12-811c-408c-af3f-24edcfc9d4bb due to new event <LifecycleEvent: 1779922869.1219473, 489adb12-811c-408c-af3f-24edcfc9d4bb => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:01:09.122676 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922869.1219473, 489adb12-811c-408c-af3f-24edcfc9d4bb => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:09.122676 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] VM Resumed (Lifecycle Event)
May 27 23:01:09.127310 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:09.127310 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:09.128504 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-05af663c-0b7c-4670-94f1-e306b064607f tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:09.130363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connector [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Factory for ISCSI on None {{(pid=98289) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 27 23:01:09.130716 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:09.130922 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:01:09.131364 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0995b0b-ee50-4a67-967a-dc871bf866a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:09.133722 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:09.135276 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:09.137599 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0995b0b-ee50-4a67-967a-dc871bf866a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:01:09.150810 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:09.151055 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:09.152117 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:09.154725 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:01:09.154966 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:09.155085 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:01:09.169289 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:01:09.169289 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:09.170662 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:01:09.170662 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:09.189140 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6] added
May 27 23:01:09.189140 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:01:09.189140 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:09.189140 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:09.189140 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:09.189140 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:09.189140 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:09.189140 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:01:09.189140 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:01:09.189140 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:01:09.191657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6] added
May 27 23:01:09.191657 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:01:09.191657 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:09.191657 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:09.191657 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:09.191657 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:09.191657 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:09.191881 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:01:09.192116 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0406(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:01:09.192344 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:01:09.312576 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:01:09.312817 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:01:09.628230 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:09.629492 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:09.815881 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:01:10.137360 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922870.1337528, 489adb12-811c-408c-af3f-24edcfc9d4bb => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:10.137360 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] VM Started (Lifecycle Event)
May 27 23:01:10.189413 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:01:10.194918 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:10.203867 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:10.203867 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:10.209368 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:10.209368 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:10.225359 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:10.225755 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:10.239270 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9904c68b-4183-4a2a-9eec-d119adcfaad6 (non-flash)
May 27 23:01:10.239270 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:10.239270 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsi session list stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9904c68b-4183-4a2a-9eec-d119adcfaad6 (non-flash)
May 27 23:01:10.239270 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:10.244552 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9904c68b-4183-4a2a-9eec-d119adcfaad6 (non-flash)
May 27 23:01:10.244552 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:10.244738 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsi session list stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9904c68b-4183-4a2a-9eec-d119adcfaad6 (non-flash)
May 27 23:01:10.244738 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:10.279438 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6, portal: 192.168.40.100,3260]
May 27 23:01:10.279438 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6, portal: 192.168.40.100,3260] successful.
May 27 23:01:10.279438 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:10.293374 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:10.322744 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.698s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:10.323344 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:01:10.332212 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9904c68b-4183-4a2a-9eec-d119adcfaad6 (non-flash)
May 27 23:01:10.332212 np0000001565 nova-compute[98289]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6 (non-flash)
May 27 23:01:10.332212 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:10.332212 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsi session list stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9904c68b-4183-4a2a-9eec-d119adcfaad6 (non-flash)
May 27 23:01:10.332212 np0000001565 nova-compute[98289]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6 (non-flash)
May 27 23:01:10.332212 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:10.332542 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:10.333541 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:10.334189 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] HCTL ('8', '-', '-', 0) found on session 2 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:10.334516 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:10.358918 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Searching for a device in session 2 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:10.359186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0995b0b-ee50-4a67-967a-dc871bf866a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:10.585258 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4b832d9e-42cc-4464-80b5-085c6547ea46 req-852efdc4-65cc-425a-a863-57538b0dba1f service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:10.588403 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b832d9e-42cc-4464-80b5-085c6547ea46 req-852efdc4-65cc-425a-a863-57538b0dba1f service nova] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:10.588403 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b832d9e-42cc-4464-80b5-085c6547ea46 req-852efdc4-65cc-425a-a863-57538b0dba1f service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:10.588403 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b832d9e-42cc-4464-80b5-085c6547ea46 req-852efdc4-65cc-425a-a863-57538b0dba1f service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:10.588403 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4b832d9e-42cc-4464-80b5-085c6547ea46 req-852efdc4-65cc-425a-a863-57538b0dba1f service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] No waiting events found dispatching network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:10.588403 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-4b832d9e-42cc-4464-80b5-085c6547ea46 req-852efdc4-65cc-425a-a863-57538b0dba1f service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received unexpected event network-vif-plugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 for instance with vm_state rescued and task_state None.
May 27 23:01:10.640680 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:10.643504 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:10.837416 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:01:10.837572 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:01:10.837854 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:10.838110 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:10.990360 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77950bc2ac63423a8d5840370f33d411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f043ce59c483a85bfdeaa3b04eb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:01:11.279545 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6, portal: 192.168.50.100,3260]
May 27 23:01:11.279545 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6, portal: 192.168.50.100,3260] successful.
May 27 23:01:11.279545 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:11.290285 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:11.305741 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9904c68b-4183-4a2a-9eec-d119adcfaad6 (non-flash)
May 27 23:01:11.305741 np0000001565 nova-compute[98289]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6 (non-flash)
May 27 23:01:11.305741 np0000001565 nova-compute[98289]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6 (non-flash)
May 27 23:01:11.305741 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:11.305998 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsi session list stdout=tcp: [1] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9904c68b-4183-4a2a-9eec-d119adcfaad6 (non-flash)
May 27 23:01:11.305998 np0000001565 nova-compute[98289]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6 (non-flash)
May 27 23:01:11.305998 np0000001565 nova-compute[98289]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6 (non-flash)
May 27 23:01:11.305998 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:11.306171 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.151s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:11.306259 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:11.306805 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] HCTL ('9', '-', '-', 0) found on session 3 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:11.306916 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:11.325275 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Searching for a device in session 3 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:11.325402 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a0995b0b-ee50-4a67-967a-dc871bf866a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:11.341014 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:01:11.587862 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Successfully created port: 92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:01:11.844778 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:01:12.168302 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Successfully updated port: 92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:01:12.182707 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:01:12.416530 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Rescuing
May 27 23:01:12.416841 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:12.416915 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquired lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:12.417079 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:01:12.662284 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7eea5586-a4ef-4132-a540-9ab69bcea0bd req-91c6edc6-baf7-454d-b835-7b7026084db2 service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Received event network-changed-92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:12.665968 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7eea5586-a4ef-4132-a540-9ab69bcea0bd req-91c6edc6-baf7-454d-b835-7b7026084db2 service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Refreshing instance network info cache due to event network-changed-92df6523-9a48-4238-bf14-ecd3a89e8fe8. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:01:12.665968 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7eea5586-a4ef-4132-a540-9ab69bcea0bd req-91c6edc6-baf7-454d-b835-7b7026084db2 service nova] Acquiring lock "refresh_cache-aed73162-7eae-4c10-98c8-3044b4aaa820" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:12.665968 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7eea5586-a4ef-4132-a540-9ab69bcea0bd req-91c6edc6-baf7-454d-b835-7b7026084db2 service nova] Acquired lock "refresh_cache-aed73162-7eae-4c10-98c8-3044b4aaa820" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:12.665968 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7eea5586-a4ef-4132-a540-9ab69bcea0bd req-91c6edc6-baf7-454d-b835-7b7026084db2 service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Refreshing network info cache for port 92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:01:12.672862 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "refresh_cache-aed73162-7eae-4c10-98c8-3044b4aaa820" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:12.853454 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:01:12.854583 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:01:12.854881 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Creating image(s)
May 27 23:01:12.858512 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "/opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:12.859009 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "/opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:12.859544 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "/opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:12.860199 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:12.869666 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:12.872199 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:12.927076 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:12.937165 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:12.953352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:12.953352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:12.953352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:12.953352 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:12.959489 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:12.959850 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:13.047744 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:13.048868 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:13.083922 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk 1073741824" returned: 0 in 0.035s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:13.084310 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.132s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:13.084677 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:13.172633 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7eea5586-a4ef-4132-a540-9ab69bcea0bd req-91c6edc6-baf7-454d-b835-7b7026084db2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:13.174654 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:13.175154 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:01:13.175883 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:13.210983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445798927 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:01:13.211672 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.076s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:13.211994 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] <== connect_volume: return (4078ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798927', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798927'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:13.212195 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798927', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798927'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:01:13.214978 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lazy-loading 'flavor' on Instance uuid 4000f391-003d-4de9-ad03-792bbd0e5e0b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:13.268911 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:13.269347 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Cannot resize image /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:01:13.269738 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:01:13.269973 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Ensure instance console log exists: /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:01:13.270601 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:13.270794 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:13.270912 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:13.273654 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7eea5586-a4ef-4132-a540-9ab69bcea0bd req-91c6edc6-baf7-454d-b835-7b7026084db2 service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:01:13.455352 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:13.495313 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7eea5586-a4ef-4132-a540-9ab69bcea0bd req-91c6edc6-baf7-454d-b835-7b7026084db2 service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:13.597671 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Updating instance_info_cache with network_info: [{"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:13.720272 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Attempting to attach volume a0995b0b-ee50-4a67-967a-dc871bf866a6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:01:13.721374 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:01:13.721374 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:13.721374 np0000001565 nova-compute[98289]:   <alias name="ua-a0995b0b-ee50-4a67-967a-dc871bf866a6"/>
May 27 23:01:13.721374 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:01:13.721374 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:13.721374 np0000001565 nova-compute[98289]:   <serial>a0995b0b-ee50-4a67-967a-dc871bf866a6</serial>
May 27 23:01:13.721374 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:13.721374 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:01:13.854564 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:14.001844 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7eea5586-a4ef-4132-a540-9ab69bcea0bd req-91c6edc6-baf7-454d-b835-7b7026084db2 service nova] Releasing lock "refresh_cache-aed73162-7eae-4c10-98c8-3044b4aaa820" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:14.002392 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquired lock "refresh_cache-aed73162-7eae-4c10-98c8-3044b4aaa820" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:14.002687 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:01:14.099861 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Releasing lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:14.601632 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:01:14.916321 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:15.090986 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Updating instance_info_cache with network_info: [{"id": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "address": "fa:16:3e:2d:fe:fd", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92df6523-9a", "ovs_interfaceid": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:15.407279 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:15.407486 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:15.408043 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:15.408043 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] No VIF found with MAC fa:16:3e:61:c5:16, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:15.593321 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Releasing lock "refresh_cache-aed73162-7eae-4c10-98c8-3044b4aaa820" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:15.593706 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Instance network_info: |[{"id": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "address": "fa:16:3e:2d:fe:fd", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92df6523-9a", "ovs_interfaceid": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:01:15.597817 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Start _get_guest_xml network_info=[{"id": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "address": "fa:16:3e:2d:fe:fd", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92df6523-9a", "ovs_interfaceid": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:01:15.606698 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:01:15.608205 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-473877233', uuid='aed73162-7eae-4c10-98c8-3044b4aaa820'), owner=OwnerMeta(userid='77950bc2ac63423a8d5840370f33d411', username='tempest-ServersNegativeTestJSON-1019668163-project-member', projectid='321f043ce59c483a85bfdeaa3b04eb4e', projectname='tempest-ServersNegativeTestJSON-1019668163'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "address": "fa:16:3e:2d:fe:fd", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92df6523-9a", "ovs_interfaceid": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922875.6078112) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:01:15.615230 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:01:15.615642 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:01:15.616625 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:01:15.616823 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:01:15.617883 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:01:15.618259 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:01:15.618493 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:01:15.618594 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:01:15.618731 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:01:15.618867 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:01:15.618988 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:01:15.619171 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:01:15.619314 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:01:15.619478 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:01:15.619605 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:01:15.619726 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:01:15.636466 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-473877233',display_name='tempest-ServersNegativeTestJSON-server-473877233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serversnegativetestjson-server-473877233',id=10,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='321f043ce59c483a85bfdeaa3b04eb4e',ramdisk_id='',reservation_id='r-wuj2nyvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1019668163',owner_user_name='tempest-ServersNegativeTestJSON-1019668163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:01:12Z,user_data=None,user_id='77950bc2ac63423a8d5840370f33d411',uuid=aed73162-7eae-4c10-98c8-3044b4aaa820,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "address": "fa:16:3e:2d:fe:fd", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92df6523-9a", "ovs_interfaceid": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:01:15.636714 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converting VIF {"id": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "address": "fa:16:3e:2d:fe:fd", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92df6523-9a", "ovs_interfaceid": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:15.637361 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:fe:fd,bridge_name='br-int',has_traffic_filtering=True,id=92df6523-9a48-4238-bf14-ecd3a89e8fe8,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92df6523-9a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:15.637989 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lazy-loading 'pci_devices' on Instance uuid aed73162-7eae-4c10-98c8-3044b4aaa820 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:15.730707 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:15.733010 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:15.750839 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:16.014360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:16.016110 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:16.032004 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5ffd6461-974d-4a71-b99f-4fd4685979e4 req-e187bb7b-9fb8-4987-9a2d-5292578d080b service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:16.034393 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5ffd6461-974d-4a71-b99f-4fd4685979e4 req-e187bb7b-9fb8-4987-9a2d-5292578d080b service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:16.039293 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5ffd6461-974d-4a71-b99f-4fd4685979e4 req-e187bb7b-9fb8-4987-9a2d-5292578d080b service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:16.039293 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5ffd6461-974d-4a71-b99f-4fd4685979e4 req-e187bb7b-9fb8-4987-9a2d-5292578d080b service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:16.039293 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5ffd6461-974d-4a71-b99f-4fd4685979e4 req-e187bb7b-9fb8-4987-9a2d-5292578d080b service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No waiting events found dispatching network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:16.039293 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5ffd6461-974d-4a71-b99f-4fd4685979e4 req-e187bb7b-9fb8-4987-9a2d-5292578d080b service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received unexpected event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with vm_state active and task_state rescuing.
May 27 23:01:16.079459 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999594142999968 future=<Future at 0x726e6022a420 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:16.082896 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Instance destroyed successfully.
May 27 23:01:16.086942 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'numa_topology' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:16.143039 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] End _get_guest_xml xml=<domain type="qemu">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <uuid>aed73162-7eae-4c10-98c8-3044b4aaa820</uuid>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <name>instance-0000000a</name>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServersNegativeTestJSON-server-473877233</nova:name>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:01:15</nova:creationTime>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:user uuid="77950bc2ac63423a8d5840370f33d411">tempest-ServersNegativeTestJSON-1019668163-project-member</nova:user>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:project uuid="321f043ce59c483a85bfdeaa3b04eb4e">tempest-ServersNegativeTestJSON-1019668163</nova:project>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         <nova:port uuid="92df6523-9a48-4238-bf14-ecd3a89e8fe8">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <system>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <entry name="serial">aed73162-7eae-4c10-98c8-3044b4aaa820</entry>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <entry name="uuid">aed73162-7eae-4c10-98c8-3044b4aaa820</entry>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     </system>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <os>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   </os>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <features>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   </features>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   <devices>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk.config"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:2d:fe:fd"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <target dev="tap92df6523-9a"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     </interface>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/console.log" append="off"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     </serial>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <video>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     </video>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     </rng>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:   </devices>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]: </domain>
May 27 23:01:16.143039 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:01:16.143039 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Preparing to wait for external event network-vif-plugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:01:16.143039 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:16.143039 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:16.143039 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:16.145387 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-473877233',display_name='tempest-ServersNegativeTestJSON-server-473877233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serversnegativetestjson-server-473877233',id=10,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='321f043ce59c483a85bfdeaa3b04eb4e',ramdisk_id='',reservation_id='r-wuj2nyvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1019668163',owner_user_name='tempest-ServersNegativeTestJSON-1019668163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:01:12Z,user_data=None,user_id='77950bc2ac63423a8d5840370f33d411',uuid=aed73162-7eae-4c10-98c8-3044b4aaa820,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "address": "fa:16:3e:2d:fe:fd", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92df6523-9a", "ovs_interfaceid": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:01:16.145387 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converting VIF {"id": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "address": "fa:16:3e:2d:fe:fd", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92df6523-9a", "ovs_interfaceid": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:16.145387 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:fe:fd,bridge_name='br-int',has_traffic_filtering=True,id=92df6523-9a48-4238-bf14-ecd3a89e8fe8,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92df6523-9a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:16.145585 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:fe:fd,bridge_name='br-int',has_traffic_filtering=True,id=92df6523-9a48-4238-bf14-ecd3a89e8fe8,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92df6523-9a') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:01:16.146481 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:16.146709 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:16.146963 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:01:16.148241 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:16.148441 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b78eff6-c7b9-5639-b614-71b464adc029', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:16.150104 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:16.150770 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:16.155051 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:16.158039 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:16.158190 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92df6523-9a, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:16.160273 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92df6523-9a, col_values=(('qos', UUID('fb8aa74d-6c62-4e18-9487-159debd95a62')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:16.160273 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92df6523-9a, col_values=(('external_ids', {'iface-id': '92df6523-9a48-4238-bf14-ecd3a89e8fe8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:fe:fd', 'vm-uuid': 'aed73162-7eae-4c10-98c8-3044b4aaa820'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:16.160763 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:16.169112 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:16.169580 np0000001565 nova-compute[98289]: INFO os_vif [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:fe:fd,bridge_name='br-int',has_traffic_filtering=True,id=92df6523-9a48-4238-bf14-ecd3a89e8fe8,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92df6523-9a')
May 27 23:01:16.592387 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Attempting rescue
May 27 23:01:16.592890 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98289) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 23:01:16.595328 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Instance directory exists: not creating {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 23:01:16.597552 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Creating image(s)
May 27 23:01:16.598143 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:16.598315 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:16.598761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:16.598951 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'trusted_certs' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:16.971202 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7bde5a60-0a06-4d48-b58d-27cb3550db31 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.692s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:17.103837 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<119d02f0-0974-4fa4-9d6a-ecfefe01e029> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:17.103837 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:17.103959 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:17.106117 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:17.106431 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:17.106683 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:17.108883 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:17.109142 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:17.197992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:17.199519 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.rescue {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:17.211380 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.009777643999996144 future=<Future at 0x726e60190680 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:17.211601 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:17.211894 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=13.867147822000106 future=<Future at 0x726e6022a420 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:17.212034 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=13.86696505000009 future=<Future at 0x726e6022a420 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:17.236460 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.rescue" returned: 0 in 0.037s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:17.236747 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.130s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:17.237073 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'migration_context' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:17.344199 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:17.344199 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:17.344199 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:17.344199 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:17.344199 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:17.348067 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Terminating instance
May 27 23:01:17.692356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:17.692356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:17.692356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] No VIF found with MAC fa:16:3e:2d:fe:fd, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:17.693050 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Using config drive
May 27 23:01:17.740140 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<119d02f0-0974-4fa4-9d6a-ecfefe01e029> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:17.740559 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:01:17.741272 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Start _get_guest_xml network_info=[{"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:9e:b7:7a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:01:17.741611 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'resources' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:17.855350 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:01:17.897215 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:17.918792 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:17.925619 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:17.968405 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:18.108405 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:18.108855 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:18.108855 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:18.108855 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:18.108855 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No waiting events found dispatching network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:18.109177 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received unexpected event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with vm_state active and task_state rescuing.
May 27 23:01:18.109177 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Received event network-vif-unplugged-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:18.109177 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] Acquiring lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:18.110063 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:18.110063 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:18.110063 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] No waiting events found dispatching network-vif-unplugged-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:18.110063 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-47daeee1-846a-422a-a328-ecea8b6fba0e req-d0dd125a-fbae-4c41-96d7-ba88a7246936 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Received event network-vif-unplugged-662344a5-a569-4f3d-ad66-77fed104617b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:01:18.203916 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:18.208298 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999794127000087 future=<Future at 0x726e602d1910 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:18.212353 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Instance destroyed successfully.
May 27 23:01:18.214028 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lazy-loading 'resources' on Instance uuid 4000f391-003d-4de9-ad03-792bbd0e5e0b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:18.244877 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<119d02f0-0974-4fa4-9d6a-ecfefe01e029> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:18.247027 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:01:18.248641 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2120896372', uuid='119d02f0-0974-4fa4-9d6a-ecfefe01e029'), owner=OwnerMeta(userid='8d33b630152d4b96949f3afbb65d7115', username='tempest-ServerRescueNegativeTestJSON-550001831-project-member', projectid='7efe372c67374c55bd40d7757474f80a', projectname='tempest-ServerRescueNegativeTestJSON-550001831'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:9e:b7:7a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922878.2482135) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:01:18.249605 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:01:18.250010 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:01:18.250849 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:01:18.251011 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:01:18.251935 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:01:18.252246 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:01:18.252415 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:01:18.252874 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:01:18.253005 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:01:18.253098 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:01:18.253224 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:01:18.253417 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:01:18.253605 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:01:18.253723 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:01:18.253867 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:01:18.253983 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:01:18.255919 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'vcpu_model' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:18.400717 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Creating config drive at /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk.config
May 27 23:01:18.408356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfobmc0db {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:18.457363 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfobmc0db" returned: 0 in 0.051s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:18.717487 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1083517067',display_name='tempest-DeleteServersTestJSON-server-1083517067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-deleteserverstestjson-server-1083517067',id=8,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:01:02Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='676f4701774b4f98903b64e0de079504',ramdisk_id='',reservation_id='r-89017auh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-932935839',owner_user_name='tempest-DeleteServersTestJSON-932935839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:01:02Z,user_data=None,user_id='f229055e36b2440ca4ef65af175b403b',uuid=4000f391-003d-4de9-ad03-792bbd0e5e0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "662344a5-a569-4f3d-ad66-77fed104617b", "address": "fa:16:3e:61:c5:16", "network": {"id": "63470321-4dfa-4159-99f5-7c5480fa8d13", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1954691505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "676f4701774b4f98903b64e0de079504", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap662344a5-a5", "ovs_interfaceid": "662344a5-a569-4f3d-ad66-77fed104617b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:01:18.719353 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Converting VIF {"id": "662344a5-a569-4f3d-ad66-77fed104617b", "address": "fa:16:3e:61:c5:16", "network": {"id": "63470321-4dfa-4159-99f5-7c5480fa8d13", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1954691505-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "676f4701774b4f98903b64e0de079504", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap662344a5-a5", "ovs_interfaceid": "662344a5-a569-4f3d-ad66-77fed104617b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:18.719353 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:c5:16,bridge_name='br-int',has_traffic_filtering=True,id=662344a5-a569-4f3d-ad66-77fed104617b,network=Network(63470321-4dfa-4159-99f5-7c5480fa8d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662344a5-a5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:18.719733 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:c5:16,bridge_name='br-int',has_traffic_filtering=True,id=662344a5-a569-4f3d-ad66-77fed104617b,network=Network(63470321-4dfa-4159-99f5-7c5480fa8d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662344a5-a5') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:01:18.722047 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:18.722356 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap662344a5-a5, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:18.724670 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:18.733025 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:18.733794 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:18.733935 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd47ef45-f1a6-407a-8618-10cff717d922) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:18.734845 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:18.735566 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:18.743436 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:18.747982 np0000001565 nova-compute[98289]: INFO os_vif [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:c5:16,bridge_name='br-int',has_traffic_filtering=True,id=662344a5-a569-4f3d-ad66-77fed104617b,network=Network(63470321-4dfa-4159-99f5-7c5480fa8d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662344a5-a5')
May 27 23:01:18.749519 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:01:18.750375 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0995b0b-ee50-4a67-967a-dc871bf866a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:18.750375 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:18.751088 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:18.751964 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0995b0b-ee50-4a67-967a-dc871bf866a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:01:18.751964 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:01:18.756861 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<119d02f0-0974-4fa4-9d6a-ecfefe01e029> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:18.772368 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2120896372',display_name='tempest-ServerRescueNegativeTestJSON-server-2120896372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-2120896372',id=1,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:52Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-8c5lw0uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:00:53Z,user_data=None,user_id='8d33b630152d4b96949f3afbb65d7115',uuid=119d02f0-0974-4fa4-9d6a-ecfefe01e029,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:9e:b7:7a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:01:18.772570 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:9e:b7:7a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:18.773123 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b7:7a,bridge_name='br-int',has_traffic_filtering=True,id=c2e9f6b2-ff45-449c-89c3-b661ae2ee33a,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e9f6b2-ff') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:18.773851 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'pci_devices' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:18.779931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6 (non-flash)
May 27 23:01:18.779931 np0000001565 nova-compute[98289]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6 (non-flash)
May 27 23:01:18.779931 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:18.779931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6 (non-flash)
May 27 23:01:18.779931 np0000001565 nova-compute[98289]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6 (non-flash)
May 27 23:01:18.779931 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:18.779931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', '2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', '3')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:01:18.779931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', '2')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:01:18.781353 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6', '3')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:01:18.782280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e601285e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6'): ({'sdd'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:01:18.782939 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Removing multipathed devices sdd, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:01:18.782939 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Flush multipath device 330000000a508b40d {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:01:18.816585 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:01:18.858870 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:01:18.911314 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:18.922754 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:01:18.922904 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:01:18.923974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:01:18.942967 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:01:18.943178 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:01:18.944722 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:18.958134 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:18.995326 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6, portal: 192.168.40.100,3260]
May 27 23:01:18.995326 np0000001565 nova-compute[98289]: Logout of [sid: 2, target: iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6, portal: 192.168.40.100,3260] successful.
May 27 23:01:18.995326 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:19.012275 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:19.025253 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:19.047724 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:19.053617 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6, portal: 192.168.50.100,3260]
May 27 23:01:19.053617 np0000001565 nova-compute[98289]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-a0995b0b-ee50-4a67-967a-dc871bf866a6, portal: 192.168.50.100,3260] successful.
May 27 23:01:19.053617 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:19.065990 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:19.066375 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:19.066375 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] <== disconnect_volume: return (315ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:19.066506 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:01:19.066851 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Deleting instance files /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b_del
May 27 23:01:19.067382 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Deletion of /opt/stack/data/nova/instances/4000f391-003d-4de9-ad03-792bbd0e5e0b_del complete
May 27 23:01:19.119997 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:19.126838 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:19.183429 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fffe48cc-e153-444b-9abd-1083de45bd75 req-ce53e926-a4dc-442c-829e-7248f7b778f4 service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Received event network-vif-plugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:19.183429 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fffe48cc-e153-444b-9abd-1083de45bd75 req-ce53e926-a4dc-442c-829e-7248f7b778f4 service nova] Acquiring lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:19.183429 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fffe48cc-e153-444b-9abd-1083de45bd75 req-ce53e926-a4dc-442c-829e-7248f7b778f4 service nova] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:19.183429 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fffe48cc-e153-444b-9abd-1083de45bd75 req-ce53e926-a4dc-442c-829e-7248f7b778f4 service nova] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:19.183429 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fffe48cc-e153-444b-9abd-1083de45bd75 req-ce53e926-a4dc-442c-829e-7248f7b778f4 service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Processing event network-vif-plugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:01:19.276512 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<119d02f0-0974-4fa4-9d6a-ecfefe01e029> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:19.277820 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] End _get_guest_xml xml=<domain type="qemu">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <uuid>119d02f0-0974-4fa4-9d6a-ecfefe01e029</uuid>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <name>instance-00000001</name>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2120896372</nova:name>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:01:18</nova:creationTime>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:user uuid="8d33b630152d4b96949f3afbb65d7115">tempest-ServerRescueNegativeTestJSON-550001831-project-member</nova:user>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:project uuid="7efe372c67374c55bd40d7757474f80a">tempest-ServerRescueNegativeTestJSON-550001831</nova:project>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         <nova:port uuid="c2e9f6b2-ff45-449c-89c3-b661ae2ee33a">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <system>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <entry name="serial">119d02f0-0974-4fa4-9d6a-ecfefe01e029</entry>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <entry name="uuid">119d02f0-0974-4fa4-9d6a-ecfefe01e029</entry>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     </system>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <os>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   </os>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <features>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   </features>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   <devices>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.rescue"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.config.rescue"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:9e:b7:7a"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <target dev="tapc2e9f6b2-ff"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     </interface>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/console.log" append="off"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     </serial>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <video>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     </video>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     </rng>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:   </devices>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]: </domain>
May 27 23:01:19.277820 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:01:19.282112 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Instance destroyed successfully.
May 27 23:01:19.573065 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Took 1.71 seconds to destroy the instance on the hypervisor.
May 27 23:01:19.573957 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:01:19.574256 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:01:19.574478 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:01:19.575192 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:19.658509 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:19.757913 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922879.7575498, aed73162-7eae-4c10-98c8-3044b4aaa820 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:19.758367 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] VM Started (Lifecycle Event)
May 27 23:01:19.759676 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:01:19.764945 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:01:19.768917 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Instance spawned successfully.
May 27 23:01:19.776855 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:01:20.194481 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c53c6767-fecc-483b-b81e-d826c75b4cf7 req-35b6a7a2-2900-44eb-9a1c-eb92f592156d service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Received event network-vif-unplugged-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:20.194881 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c53c6767-fecc-483b-b81e-d826c75b4cf7 req-35b6a7a2-2900-44eb-9a1c-eb92f592156d service nova] Acquiring lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:20.194881 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c53c6767-fecc-483b-b81e-d826c75b4cf7 req-35b6a7a2-2900-44eb-9a1c-eb92f592156d service nova] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:20.194969 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c53c6767-fecc-483b-b81e-d826c75b4cf7 req-35b6a7a2-2900-44eb-9a1c-eb92f592156d service nova] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:20.195715 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c53c6767-fecc-483b-b81e-d826c75b4cf7 req-35b6a7a2-2900-44eb-9a1c-eb92f592156d service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] No waiting events found dispatching network-vif-unplugged-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:20.195715 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c53c6767-fecc-483b-b81e-d826c75b4cf7 req-35b6a7a2-2900-44eb-9a1c-eb92f592156d service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Received event network-vif-unplugged-662344a5-a569-4f3d-ad66-77fed104617b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:01:20.262128 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:20.266793 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:20.286349 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:20.286530 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:20.286948 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:20.287237 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:20.288015 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:20.288423 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:20.438814 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:20.769947 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:01:20.770228 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922880.7700348, aed73162-7eae-4c10-98c8-3044b4aaa820 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:20.770370 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] VM Paused (Lifecycle Event)
May 27 23:01:20.794277 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Took 7.94 seconds to spawn the instance on the hypervisor.
May 27 23:01:20.794492 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:20.810574 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:20.810770 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:20.810919 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:20.811065 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No VIF found with MAC fa:16:3e:9e:b7:7a, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:20.811569 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Using config drive
May 27 23:01:20.940962 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Took 1.37 seconds to deallocate network for instance.
May 27 23:01:21.268292 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b34c699-dfc4-4761-94c4-286e0cad9c5c req-8cd9ba85-160c-442c-94c4-ed8bdb5b1f67 service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Received event network-vif-plugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:21.269165 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b34c699-dfc4-4761-94c4-286e0cad9c5c req-8cd9ba85-160c-442c-94c4-ed8bdb5b1f67 service nova] Acquiring lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:21.269668 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b34c699-dfc4-4761-94c4-286e0cad9c5c req-8cd9ba85-160c-442c-94c4-ed8bdb5b1f67 service nova] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:21.269975 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b34c699-dfc4-4761-94c4-286e0cad9c5c req-8cd9ba85-160c-442c-94c4-ed8bdb5b1f67 service nova] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:21.270146 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b34c699-dfc4-4761-94c4-286e0cad9c5c req-8cd9ba85-160c-442c-94c4-ed8bdb5b1f67 service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] No waiting events found dispatching network-vif-plugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:21.271043 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3b34c699-dfc4-4761-94c4-286e0cad9c5c req-8cd9ba85-160c-442c-94c4-ed8bdb5b1f67 service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Received unexpected event network-vif-plugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 for instance with vm_state active and task_state None.
May 27 23:01:21.271784 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b34c699-dfc4-4761-94c4-286e0cad9c5c req-8cd9ba85-160c-442c-94c4-ed8bdb5b1f67 service nova] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Received event network-vif-deleted-662344a5-a569-4f3d-ad66-77fed104617b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:21.274026 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:21.275280 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922881.2750115, aed73162-7eae-4c10-98c8-3044b4aaa820 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:21.275436 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] VM Resumed (Lifecycle Event)
May 27 23:01:21.304283 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Took 13.76 seconds to build instance.
May 27 23:01:21.316686 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'ec2_ids' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:21.350279 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "interface-13686e4c-ae8e-4837-a71f-2d710575ab33-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:21.351925 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "interface-13686e4c-ae8e-4837-a71f-2d710575ab33-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:21.351925 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lazy-loading 'flavor' on Instance uuid 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:21.537764 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Took 0.60 seconds to detach 1 volumes for instance.
May 27 23:01:21.778094 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:21.782039 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:21.805901 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.288s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:21.820087 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<119d02f0-0974-4fa4-9d6a-ecfefe01e029> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:21.820269 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'keypairs' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:21.855489 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:22.032750 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lazy-loading 'pci_requests' on Instance uuid 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:22.046853 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:22.047722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:22.198796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "aed73162-7eae-4c10-98c8-3044b4aaa820" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:22.199067 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:22.199346 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:22.199779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:22.200045 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:22.202251 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Terminating instance
May 27 23:01:22.284779 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] During sync_power_state the instance has a pending task (deleting). Skip.
May 27 23:01:22.324714 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<119d02f0-0974-4fa4-9d6a-ecfefe01e029> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:22.327289 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:22.471263 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Creating config drive at /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.config.rescue
May 27 23:01:22.477247 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnve080h5 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:22.513255 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnve080h5" returned: 0 in 0.036s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:22.535797 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Object Instance<13686e4c-ae8e-4837-a71f-2d710575ab33> lazy-loaded attributes: flavor,pci_requests {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:22.536020 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:01:22.536374 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:22.536682 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:22.627410 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7581bdc53e7e463a8b5951ed443d106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3864f7301d84dbdbbb57d5a3ff0d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:01:22.711411 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:01:22.711861 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:01:22.714936 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:01:22.748983 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:22.770093 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:22.898618 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:22.909413 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:22.979868 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.015274 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.021696 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.172173 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Successfully created port: 2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:01:23.216186 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:01:23.243994 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.247181 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.250447 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999544263999951 future=<Future at 0x726e601b3c50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:23.256781 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Instance destroyed successfully.
May 27 23:01:23.259577 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lazy-loading 'resources' on Instance uuid aed73162-7eae-4c10-98c8-3044b4aaa820 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:23.324458 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7f22cc37-c1ae-4ba2-95ce-863941c17741 req-0cbb1e22-43e2-46c0-ba30-9f90c3daef23 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:23.324832 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7f22cc37-c1ae-4ba2-95ce-863941c17741 req-0cbb1e22-43e2-46c0-ba30-9f90c3daef23 service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:23.325016 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7f22cc37-c1ae-4ba2-95ce-863941c17741 req-0cbb1e22-43e2-46c0-ba30-9f90c3daef23 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:23.325186 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7f22cc37-c1ae-4ba2-95ce-863941c17741 req-0cbb1e22-43e2-46c0-ba30-9f90c3daef23 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:23.325373 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7f22cc37-c1ae-4ba2-95ce-863941c17741 req-0cbb1e22-43e2-46c0-ba30-9f90c3daef23 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No waiting events found dispatching network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:23.326048 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-7f22cc37-c1ae-4ba2-95ce-863941c17741 req-0cbb1e22-43e2-46c0-ba30-9f90c3daef23 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received unexpected event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with vm_state active and task_state rescuing.
May 27 23:01:23.356518 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Received event network-vif-unplugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:23.356518 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] Acquiring lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:23.356518 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:23.356518 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:23.356518 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] No waiting events found dispatching network-vif-unplugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:23.356518 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Received event network-vif-unplugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:01:23.356518 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Received event network-vif-unplugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:23.356518 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] Acquiring lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:23.357275 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:23.357539 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:23.357729 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] No waiting events found dispatching network-vif-unplugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:23.357915 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f14e53fa-084c-4627-a65d-98dd127d98b0 req-16f21169-7609-4f86-be29-05bb3b1488fb service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Received event network-vif-unplugged-92df6523-9a48-4238-bf14-ecd3a89e8fe8 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:01:23.729773 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Successfully updated port: 2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:01:23.734776 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.739123 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.692s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:23.764890 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-473877233',display_name='tempest-ServersNegativeTestJSON-server-473877233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serversnegativetestjson-server-473877233',id=10,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:01:20Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='321f043ce59c483a85bfdeaa3b04eb4e',ramdisk_id='',reservation_id='r-wuj2nyvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1019668163',owner_user_name='tempest-ServersNegativeTestJSON-1019668163-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:01:21Z,user_data=None,user_id='77950bc2ac63423a8d5840370f33d411',uuid=aed73162-7eae-4c10-98c8-3044b4aaa820,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "address": "fa:16:3e:2d:fe:fd", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92df6523-9a", "ovs_interfaceid": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:01:23.765108 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converting VIF {"id": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "address": "fa:16:3e:2d:fe:fd", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92df6523-9a", "ovs_interfaceid": "92df6523-9a48-4238-bf14-ecd3a89e8fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:23.765764 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:fe:fd,bridge_name='br-int',has_traffic_filtering=True,id=92df6523-9a48-4238-bf14-ecd3a89e8fe8,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92df6523-9a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:23.766549 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:fe:fd,bridge_name='br-int',has_traffic_filtering=True,id=92df6523-9a48-4238-bf14-ecd3a89e8fe8,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92df6523-9a') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:01:23.768029 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.768348 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92df6523-9a, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:23.769963 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.770980 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:23.771973 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.773552 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.773731 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb8aa74d-6c62-4e18-9487-159debd95a62) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:23.774351 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.775019 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:23.777754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:23.781080 np0000001565 nova-compute[98289]: INFO os_vif [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:fe:fd,bridge_name='br-int',has_traffic_filtering=True,id=92df6523-9a48-4238-bf14-ecd3a89e8fe8,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92df6523-9a')
May 27 23:01:23.781497 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Deleting instance files /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820_del
May 27 23:01:23.784462 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Deletion of /opt/stack/data/nova/instances/aed73162-7eae-4c10-98c8-3044b4aaa820_del complete
May 27 23:01:23.790983 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Deleted allocations for instance 4000f391-003d-4de9-ad03-792bbd0e5e0b
May 27 23:01:23.812885 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-15888704-9fa6-48f2-8bb7-c1501a039f86 req-bc356efb-b294-4bef-adaa-e9b573167677 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-changed-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:23.813454 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-15888704-9fa6-48f2-8bb7-c1501a039f86 req-bc356efb-b294-4bef-adaa-e9b573167677 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Refreshing instance network info cache due to event network-changed-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:01:23.813736 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-15888704-9fa6-48f2-8bb7-c1501a039f86 req-bc356efb-b294-4bef-adaa-e9b573167677 service nova] Acquiring lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:23.813923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-15888704-9fa6-48f2-8bb7-c1501a039f86 req-bc356efb-b294-4bef-adaa-e9b573167677 service nova] Acquired lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:23.815023 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-15888704-9fa6-48f2-8bb7-c1501a039f86 req-bc356efb-b294-4bef-adaa-e9b573167677 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Refreshing network info cache for port 2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:01:23.971375 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 119d02f0-0974-4fa4-9d6a-ecfefe01e029 due to new event <LifecycleEvent: 1779922883.970972, 119d02f0-0974-4fa4-9d6a-ecfefe01e029 => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:01:23.971535 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922883.970972, 119d02f0-0974-4fa4-9d6a-ecfefe01e029 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:23.971670 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] VM Resumed (Lifecycle Event)
May 27 23:01:23.974889 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1ab8e22e-c2c5-4d31-8cb0-9db8678563a1 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:24.232787 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:24.300834 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Took 1.59 seconds to destroy the instance on the hypervisor.
May 27 23:01:24.301616 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:01:24.305363 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:01:24.305363 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:01:24.305363 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:24.316697 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-15888704-9fa6-48f2-8bb7-c1501a039f86 req-bc356efb-b294-4bef-adaa-e9b573167677 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:24.383415 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:24.480391 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:24.489039 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:24.580163 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "a0070282-e138-405c-b6c8-3478991d03f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:24.581307 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:24.659112 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-15888704-9fa6-48f2-8bb7-c1501a039f86 req-bc356efb-b294-4bef-adaa-e9b573167677 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:24.799835 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-15888704-9fa6-48f2-8bb7-c1501a039f86 req-bc356efb-b294-4bef-adaa-e9b573167677 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Added VIF to instance network info cache for port 2627f66f-f8cf-4fcc-b9c3-a66c97b6111a. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3530}}
May 27 23:01:24.800885 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-15888704-9fa6-48f2-8bb7-c1501a039f86 req-bc356efb-b294-4bef-adaa-e9b573167677 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Updating instance_info_cache with network_info: [{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:24.801955 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c8401c91-5f5e-457f-b6fe-7ac52e1e2fd8 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Lock "4000f391-003d-4de9-ad03-792bbd0e5e0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.460s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:24.993887 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922884.9936054, 119d02f0-0974-4fa4-9d6a-ecfefe01e029 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:24.994020 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] VM Started (Lifecycle Event)
May 27 23:01:25.084405 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lazy-loading 'flavor' on Instance uuid a0070282-e138-405c-b6c8-3478991d03f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:25.153294 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:25.303111 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-15888704-9fa6-48f2-8bb7-c1501a039f86 req-bc356efb-b294-4bef-adaa-e9b573167677 service nova] Releasing lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:25.303697 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquired lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:25.303882 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:01:25.387778 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Unrescuing
May 27 23:01:25.388180 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:25.388180 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquired lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:25.388254 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:01:25.396085 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:25.396579 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:25.396789 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:25.396940 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:25.397088 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No waiting events found dispatching network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:25.397235 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received unexpected event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with vm_state rescued and task_state unrescuing.
May 27 23:01:25.397405 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-vif-unplugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:25.397560 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:25.397717 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:25.397818 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:25.397941 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] No waiting events found dispatching network-vif-unplugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:25.398540 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received unexpected event network-vif-unplugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a for instance with vm_state active and task_state None.
May 27 23:01:25.398540 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a73ee9b0-1fae-406e-9620-9bbbea192e89 req-f208fc03-0293-496b-a74c-4a22890efc92 service nova] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Received event network-vif-deleted-92df6523-9a48-4238-bf14-ecd3a89e8fe8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:25.496236 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:25.497865 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:25.655276 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Took 1.35 seconds to deallocate network for instance.
May 27 23:01:25.886987 np0000001565 nova-compute[98289]: WARNING nova.network.neutron [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] 118f7628-4e5f-4311-8dab-2058676045c9 already exists in list: networks containing: ['118f7628-4e5f-4311-8dab-2058676045c9']. ignoring it
May 27 23:01:25.887111 np0000001565 nova-compute[98289]: WARNING nova.network.neutron [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] 2627f66f-f8cf-4fcc-b9c3-a66c97b6111a already exists in list: port_ids containing: ['2627f66f-f8cf-4fcc-b9c3-a66c97b6111a']. ignoring it
May 27 23:01:25.889863 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:26.000157 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 27 23:01:26.091093 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:26.137359 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:26.163174 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:26.163857 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:26.241344 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:26.418584 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Updating instance_info_cache with network_info: [{"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:26.579454 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:26.749448 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Updating instance_info_cache with network_info: [{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:26.783455 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:01:26.783692 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:01:26.921457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Releasing lock "refresh_cache-119d02f0-0974-4fa4-9d6a-ecfefe01e029" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:26.922042 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'flavor' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:26.995319 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Acquiring lock "3438591d-5ed5-45ed-8875-256372fc8333" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:26.995703 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "3438591d-5ed5-45ed-8875-256372fc8333" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:27.251856 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Releasing lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:27.253698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1581082659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1581082659',id=3,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbXJ25uvRq+YEKR1kzxedf9FvXb2eZ7io19cQ3tAnPpWU1tiaY+f+xttFfQpCrSUW1ryPIO60u8KO1pLzAlayI1KKlUoQpfHOPvHJtzvGfeubKnVhz74qMUmiGcKUUEGw==',key_name='tempest-keypair-853654392',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:42Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3864f7301d84dbdbbb57d5a3ff0d764',ramdisk_id='',reservation_id='r-2wuc69yq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-637545634',owner_user_name='tempest-TaggedAttachmentsTest-637545634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7581bdc53e7e463a8b5951ed443d106a',uuid=13686e4c-ae8e-4837-a71f-2d710575ab33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:01:27.254036 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converting VIF {"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:27.254864 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:27.254864 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:01:27.255126 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.255430 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:27.255663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:01:27.256460 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.256609 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd20589ed-016c-525c-86f4-a6f25b5c3387', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:27.257359 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.257913 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:27.259091 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.261470 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.261600 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2627f66f-f8, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:27.261885 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2627f66f-f8, col_values=(('qos', UUID('80d9e705-e72c-484e-bddc-af110abb0ace')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:27.262029 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2627f66f-f8, col_values=(('external_ids', {'iface-id': '2627f66f-f8cf-4fcc-b9c3-a66c97b6111a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:43:c2', 'vm-uuid': '13686e4c-ae8e-4837-a71f-2d710575ab33'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:27.264077 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.264077 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:27.269930 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.272711 np0000001565 nova-compute[98289]: INFO os_vif [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8')
May 27 23:01:27.272711 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1581082659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1581082659',id=3,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbXJ25uvRq+YEKR1kzxedf9FvXb2eZ7io19cQ3tAnPpWU1tiaY+f+xttFfQpCrSUW1ryPIO60u8KO1pLzAlayI1KKlUoQpfHOPvHJtzvGfeubKnVhz74qMUmiGcKUUEGw==',key_name='tempest-keypair-853654392',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:42Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3864f7301d84dbdbbb57d5a3ff0d764',ramdisk_id='',reservation_id='r-2wuc69yq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-637545634',owner_user_name='tempest-TaggedAttachmentsTest-637545634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7581bdc53e7e463a8b5951ed443d106a',uuid=13686e4c-ae8e-4837-a71f-2d710575ab33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:01:27.272711 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converting VIF {"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:27.273130 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:27.274535 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] attach device xml: <interface type="ethernet">
May 27 23:01:27.274535 np0000001565 nova-compute[98289]:   <mac address="fa:16:3e:c0:43:c2"/>
May 27 23:01:27.274535 np0000001565 nova-compute[98289]:   <model type="virtio"/>
May 27 23:01:27.274535 np0000001565 nova-compute[98289]:   <driver name="qemu"/>
May 27 23:01:27.274535 np0000001565 nova-compute[98289]:   <mtu size="1372"/>
May 27 23:01:27.274535 np0000001565 nova-compute[98289]:   <target dev="tap2627f66f-f8"/>
May 27 23:01:27.274535 np0000001565 nova-compute[98289]: </interface>
May 27 23:01:27.274535 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:01:27.288559 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:01:27.294191 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.371932 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.374214 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.377923 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.394380 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.451276 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.474985 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.502745 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lazy-loading 'flavor' on Instance uuid 3438591d-5ed5-45ed-8875-256372fc8333 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:27.517057 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "a0070282-e138-405c-b6c8-3478991d03f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:27.517216 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:27.520361 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Attaching volume 34bf9816-3eda-4bfc-a260-492ad981a0f9 to /dev/sdc
May 27 23:01:27.585779 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:27.600247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:01:27.628470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:27.660462 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:01:27.660946 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:01:27.670427 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:01:27.672375 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe38:c53a', 'fe80::cc7a:76ff:fe01:2cc5', 'fe80::fc16:3eff:fef7:298e', 'fe80::90cc:87ff:fe39:148b', 'fe80::fc16:3eff:fe2e:138c', 'fe80::68e2:adff:fe5e:9fb', 'fe80::fc16:3eff:fecb:dbbd', 'fe80::b0f9:b0ff:fe67:8049', 'fe80::fc16:3eff:fed4:3882', 'fe80::fc16:3eff:fe2b:21a3', 'fe80::48b6:7aff:feda:b750', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fec0:43c2', 'fe80::8cb0:efff:fe8f:244a'] 
May 27 23:01:27.672527 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:01:27.672674 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:01:27.672987 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:27.673287 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Updating existing volume attachment record: 0cf0406f-0445-4069-80c8-f6c99fd60c20 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:01:27.686087 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.693048 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.697770 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.725978 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.735691 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:27.759287 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bd389a88-b7f5-40f1-a812-2a589fc1e817 req-c966020f-6911-42cd-a31d-99aba4812915 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-vif-plugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:27.760895 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bd389a88-b7f5-40f1-a812-2a589fc1e817 req-c966020f-6911-42cd-a31d-99aba4812915 service nova] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:27.761406 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bd389a88-b7f5-40f1-a812-2a589fc1e817 req-c966020f-6911-42cd-a31d-99aba4812915 service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:27.761614 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bd389a88-b7f5-40f1-a812-2a589fc1e817 req-c966020f-6911-42cd-a31d-99aba4812915 service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:27.761662 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bd389a88-b7f5-40f1-a812-2a589fc1e817 req-c966020f-6911-42cd-a31d-99aba4812915 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] No waiting events found dispatching network-vif-plugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:27.761770 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-bd389a88-b7f5-40f1-a812-2a589fc1e817 req-c966020f-6911-42cd-a31d-99aba4812915 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received unexpected event network-vif-plugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a for instance with vm_state active and task_state None.
May 27 23:01:27.796542 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999643463999973 future=<Future at 0x726e604c4080 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:27.801407 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.635s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:27.802491 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Instance destroyed successfully.
May 27 23:01:27.802964 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'numa_topology' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:27.858481 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Deleted allocations for instance aed73162-7eae-4c10-98c8-3044b4aaa820
May 27 23:01:27.992114 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:28.000674 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:28.021058 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:28.240724 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:01:28.241133 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34bf9816-3eda-4bfc-a260-492ad981a0f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:28.241320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:28.241743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:28.241983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34bf9816-3eda-4bfc-a260-492ad981a0f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:01:28.256063 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:28.256678 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:28.257314 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:28.257588 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:01:28.257891 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:28.258058 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:01:28.270070 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:01:28.270070 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:28.275184 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:01:28.275184 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:28.283418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9] added
May 27 23:01:28.283418 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:01:28.283418 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:28.283418 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:28.283418 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:28.283418 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:28.283418 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:28.283418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:01:28.283681 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:01:28.283681 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:01:28.286129 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9] added
May 27 23:01:28.286129 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:01:28.286129 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:28.286129 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:28.286129 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:28.286129 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:28.286129 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:28.286319 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:01:28.286450 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:01:28.286570 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:01:28.305167 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<119d02f0-0974-4fa4-9d6a-ecfefe01e029> lazy-loaded attributes: flavor,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:28.511449 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "3438591d-5ed5-45ed-8875-256372fc8333" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:28.737067 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:28.749847 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:28.754964 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:28.870793 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:28.879896 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-878c032a-32b3-490e-a8cb-043384ca5d66 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "aed73162-7eae-4c10-98c8-3044b4aaa820" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.681s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:28.899207 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:28.900213 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:28.930319 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:28.930515 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:28.930640 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] No VIF found with MAC fa:16:3e:38:c5:3a, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:29.190030 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:29.284598 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:01:29.286964 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:29.295805 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:29.295805 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:29.302232 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:29.302232 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:29.309195 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:29.314981 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:29.322496 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:29.322496 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:29.322496 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsi session list stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:29.322496 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:29.329512 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:29.329512 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:29.329632 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsi session list stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:29.329632 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:29.357899 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9, portal: 192.168.40.100,3260]
May 27 23:01:29.357899 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9, portal: 192.168.40.100,3260] successful.
May 27 23:01:29.357899 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:29.369924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9, portal: 192.168.50.100,3260]
May 27 23:01:29.369924 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9, portal: 192.168.50.100,3260] successful.
May 27 23:01:29.369924 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:29.370344 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:29.386289 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:29.386728 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:29.386728 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:29.386728 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:29.386728 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:29.387043 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsi session list stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:29.387043 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:29.387043 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:29.387043 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:29.387317 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:29.387473 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:29.390652 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] HCTL ('8', '-', '-', 0) found on session 5 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:29.390767 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:29.399797 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:29.399797 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:29.399797 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:29.399797 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:29.400223 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsi session list stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:29.400223 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:29.400223 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:29.400223 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:29.400740 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:29.400862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:29.401350 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] HCTL ('9', '-', '-', 0) found on session 6 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:29.401455 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:29.407405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Searching for a device in session 5 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:29.407405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34bf9816-3eda-4bfc-a260-492ad981a0f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:29.417057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Searching for a device in session 6 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:29.417263 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '34bf9816-3eda-4bfc-a260-492ad981a0f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:29.435505 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1581082659', uuid='13686e4c-ae8e-4837-a71f-2d710575ab33'), owner=OwnerMeta(userid='7581bdc53e7e463a8b5951ed443d106a', username='tempest-TaggedAttachmentsTest-637545634-project-member', projectid='a3864f7301d84dbdbbb57d5a3ff0d764', projectname='tempest-TaggedAttachmentsTest-637545634'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922889.4350317) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:01:29.436401 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   <nova:package version="33.1.0"/>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   <nova:name>tempest-device-tagging-server-1581082659</nova:name>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   <nova:creationTime>2026-05-27 23:01:29</nova:creationTime>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   <nova:flavor name="m1.nano" id="42">
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:memory>192</nova:memory>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:disk>1</nova:disk>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:swap>0</nova:swap>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:vcpus>1</nova:vcpus>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:extraSpecs>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     </nova:extraSpecs>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   </nova:flavor>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:minDisk>1</nova:minDisk>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:minRam>0</nova:minRam>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:properties>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     </nova:properties>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   </nova:image>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   <nova:owner>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:user uuid="7581bdc53e7e463a8b5951ed443d106a">tempest-TaggedAttachmentsTest-637545634-project-member</nova:user>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:project uuid="a3864f7301d84dbdbbb57d5a3ff0d764">tempest-TaggedAttachmentsTest-637545634</nova:project>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   </nova:owner>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   <nova:ports>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:port uuid="7faf9be9-b21d-441b-9e09-9c236e1f9fb5">
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:       <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     </nova:port>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     <nova:port uuid="2627f66f-f8cf-4fcc-b9c3-a66c97b6111a">
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:     </nova:port>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:   </nova:ports>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]: </nova:instance>
May 27 23:01:29.436401 np0000001565 nova-compute[98289]:  {{(pid=98289) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 27 23:01:29.631914 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Acquiring lock "3438591d-5ed5-45ed-8875-256372fc8333" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:29.632280 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "3438591d-5ed5-45ed-8875-256372fc8333" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:29.632280 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Attaching volume 6b43be18-5df6-4777-996a-afb63b3463fe to /dev/vdb
May 27 23:01:29.645059 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 119d02f0-0974-4fa4-9d6a-ecfefe01e029 due to new event <LifecycleEvent: 1779922889.644792, 119d02f0-0974-4fa4-9d6a-ecfefe01e029 => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:01:29.645251 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922889.644792, 119d02f0-0974-4fa4-9d6a-ecfefe01e029 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:29.645404 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] VM Resumed (Lifecycle Event)
May 27 23:01:29.647819 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c5ba66e2-fda2-4a73-b84a-70ceeeca9469 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:29.674035 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:29.688700 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:01:29.708240 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:29.737061 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:01:29.737391 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:01:29.746084 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:01:29.747565 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe38:c53a', 'fe80::cc7a:76ff:fe01:2cc5', 'fe80::fc16:3eff:fef7:298e', 'fe80::90cc:87ff:fe39:148b', 'fe80::fc16:3eff:fe2e:138c', 'fe80::68e2:adff:fe5e:9fb', 'fe80::fc16:3eff:fecb:dbbd', 'fe80::b0f9:b0ff:fe67:8049', 'fe80::fc16:3eff:fed4:3882', 'fe80::fc16:3eff:fe2b:21a3', 'fe80::48b6:7aff:feda:b750', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fec0:43c2', 'fe80::8cb0:efff:fe8f:244a', 'fe80::fc16:3eff:fe9e:b77a'] 
May 27 23:01:29.747696 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:01:29.747792 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:01:29.748226 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] <== get_connector_properties: return (73ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:29.748283 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Updating existing volume attachment record: 095e4829-aaf6-4a22-a743-66d2b8602443 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:01:29.864693 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-vif-plugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:29.865345 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:29.865591 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:29.865889 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:29.865889 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] No waiting events found dispatching network-vif-plugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:29.866022 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received unexpected event network-vif-plugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a for instance with vm_state active and task_state None.
May 27 23:01:29.866169 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:29.866379 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:29.866490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:29.866603 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:29.866831 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No waiting events found dispatching network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:29.866876 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received unexpected event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with vm_state active and task_state None.
May 27 23:01:29.867080 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:29.867186 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:29.867504 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:29.867504 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:29.867571 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No waiting events found dispatching network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:29.867674 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received unexpected event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with vm_state active and task_state None.
May 27 23:01:29.867803 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:29.868370 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:29.868526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:29.868648 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:29.868798 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No waiting events found dispatching network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:29.868919 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received unexpected event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with vm_state active and task_state None.
May 27 23:01:29.869038 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:29.869185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:29.869314 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:29.869490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:29.869570 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No waiting events found dispatching network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:29.869689 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c499073c-1a1f-40e6-a4cf-2f0317009df9 req-e0894709-b061-43d3-a6c0-98a324765923 service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received unexpected event network-vif-plugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with vm_state active and task_state None.
May 27 23:01:29.943295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d76db387-9bb0-4d1b-a3a8-0267bf912f88 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "interface-13686e4c-ae8e-4837-a71f-2d710575ab33-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 8.592s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:30.148083 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:30.149729 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:30.259107 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:01:30.305354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:01:30.305635 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b43be18-5df6-4777-996a-afb63b3463fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:30.305756 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:30.653162 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922890.6528945, 119d02f0-0974-4fa4-9d6a-ecfefe01e029 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:30.653873 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] VM Started (Lifecycle Event)
May 27 23:01:31.079510 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00046810999992885627 future=<Future at 0x726e6022a420 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:31.079888 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:31.079958 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.1281484430001 future=<Future at 0x726e602d1910 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:31.079997 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.1280555549999463 future=<Future at 0x726e602d1910 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:31.157417 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:31.157713 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:31.160101 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:31.167695 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:31.279086 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Found WWN 330000000caaaf74f for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:01:31.279201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:31.279451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000caaaf74f', 'path': '/dev/dm-0', 'multipath_id': '330000000caaaf74f'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:31.279623 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000caaaf74f', 'path': '/dev/dm-0', 'multipath_id': '330000000caaaf74f'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:01:31.280382 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.975s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:31.280631 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b43be18-5df6-4777-996a-afb63b3463fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:01:31.290872 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lazy-loading 'flavor' on Instance uuid a0070282-e138-405c-b6c8-3478991d03f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:31.300456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:31.301190 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:31.301796 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:31.302812 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:01:31.303019 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:31.303270 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:01:31.316242 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:01:31.316242 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:31.322130 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:01:31.322130 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:31.329530 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe] added
May 27 23:01:31.329530 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:01:31.329530 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:31.329530 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:31.329530 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:31.329530 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:31.329530 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:31.329530 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:01:31.329530 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:01:31.329720 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:01:31.332370 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe] added
May 27 23:01:31.332370 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:01:31.332370 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:31.332370 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:31.332370 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:31.332370 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:31.332370 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:31.332600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:01:31.332929 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:01:31.332980 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:01:31.662904 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lazy-loading 'flavor' on Instance uuid 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:31.796016 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:01:31.796016 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:31.796016 np0000001565 nova-compute[98289]:   <alias name="ua-34bf9816-3eda-4bfc-a260-492ad981a0f9"/>
May 27 23:01:31.796016 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:01:31.796016 np0000001565 nova-compute[98289]:   <target dev="sdc" bus="scsi"/>
May 27 23:01:31.796016 np0000001565 nova-compute[98289]:   <serial>34bf9816-3eda-4bfc-a260-492ad981a0f9</serial>
May 27 23:01:31.796016 np0000001565 nova-compute[98289]:   <address type="drive" controller="0" unit="2"/>
May 27 23:01:31.796016 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:31.796016 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:01:31.947273 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received event network-changed-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:31.947273 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Refreshing instance network info cache due to event network-changed-899734d7-d351-4e8e-9021-71e58ffa2734. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:01:31.947273 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] Acquiring lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:31.947273 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] Acquired lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:31.947273 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Refreshing network info cache for port 899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:01:32.266468 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:32.330079 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:01:32.333455 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:32.346667 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:32.346667 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:32.352085 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:32.352085 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:32.361850 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:32.363279 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:32.377657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:32.377657 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.377657 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.377657 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:32.378047 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:32.378047 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.378047 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.378047 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:32.378308 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsi session list stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:32.378308 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.378308 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.378308 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:32.379168 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsi session list stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:32.379168 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.379168 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.379168 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:32.392831 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:32.392831 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:32.412925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe, portal: 192.168.50.100,3260]
May 27 23:01:32.412925 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe, portal: 192.168.50.100,3260] successful.
May 27 23:01:32.412925 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:32.423622 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe, portal: 192.168.40.100,3260]
May 27 23:01:32.423622 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe, portal: 192.168.40.100,3260] successful.
May 27 23:01:32.423622 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:32.424015 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:32.434763 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:32.447590 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsi session list stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:32.447590 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] HCTL ('10', '-', '-', 0) found on session 7 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:32.447590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:32.449125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:32.449125 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.449125 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.449125 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:32.449125 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:32.449125 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:32.449310 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsi session list stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:32.449310 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.449310 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:32.449310 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:32.449310 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:32.449310 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:32.449586 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:32.449706 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:32.450344 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:32.453879 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] HCTL ('11', '-', '-', 0) found on session 8 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:32.453989 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:32.473725 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Searching for a device in session 7 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:32.473725 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6b43be18-5df6-4777-996a-afb63b3463fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:32.477715 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Searching for a device in session 8 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:32.477715 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b43be18-5df6-4777-996a-afb63b3463fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:32.669945 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:32.823560 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:32.895289 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lazy-loading 'flavor' on Instance uuid aee84b65-41d8-427d-96d0-cd328e4863ba {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:32.986244 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Updated VIF entry in instance network info cache for port 899734d7-d351-4e8e-9021-71e58ffa2734. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:01:32.986684 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Updating instance_info_cache with network_info: [{"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:33.024830 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:33.208745 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0005973239999548241 future=<Future at 0x726e602d1910 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:33.208850 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:33.208850 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.04049063399998 future=<Future at 0x726e601b3c50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:33.208931 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.040418584000008 future=<Future at 0x726e601b3c50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:33.211433 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Emitting event <LifecycleEvent: 1779922878.2079966, 4000f391-003d-4de9-ad03-792bbd0e5e0b => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:33.211433 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] VM Stopped (Lifecycle Event)
May 27 23:01:33.302144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:01:33.488847 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] Releasing lock "refresh_cache-aee84b65-41d8-427d-96d0-cd328e4863ba" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:33.489029 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received event network-changed-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:33.489182 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Refreshing instance network info cache due to event network-changed-1f508337-775f-4120-a399-7a785fa5a827. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:01:33.489317 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] Acquiring lock "refresh_cache-f31ea991-4cf8-43e7-9d65-cfb193c3413a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:33.489429 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] Acquired lock "refresh_cache-f31ea991-4cf8-43e7-9d65-cfb193c3413a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:33.489538 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Refreshing network info cache for port 1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:01:33.531176 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] No BDM found with device name sda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:33.531408 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:33.531487 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:33.531597 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] No VIF found with MAC fa:16:3e:f7:29:8e, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:33.715455 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d7405c06-1cbe-4960-82b5-8e650c88cd7d tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 4000f391-003d-4de9-ad03-792bbd0e5e0b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:33.904390 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:33.997953 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:34.031044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:34.031264 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:34.245021 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:34.245201 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:34.245412 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Attaching volume 2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 to /dev/vdb
May 27 23:01:34.309370 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:34.322422 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:01:34.323068 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Found WWN 330000000c8c842db for multipath device dm-1 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:01:34.324031 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:34.324303 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] <== connect_volume: return (4018ms) {'type': 'block', 'scsi_wwn': '330000000c8c842db', 'path': '/dev/dm-1', 'multipath_id': '330000000c8c842db'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:34.324613 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c8c842db', 'path': '/dev/dm-1', 'multipath_id': '330000000c8c842db'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:01:34.326847 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lazy-loading 'flavor' on Instance uuid 3438591d-5ed5-45ed-8875-256372fc8333 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:34.349357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:34.380525 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:01:34.381926 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:01:34.390267 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:01:34.392749 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe38:c53a', 'fe80::cc7a:76ff:fe01:2cc5', 'fe80::fc16:3eff:fef7:298e', 'fe80::90cc:87ff:fe39:148b', 'fe80::fc16:3eff:fe2e:138c', 'fe80::68e2:adff:fe5e:9fb', 'fe80::fc16:3eff:fecb:dbbd', 'fe80::b0f9:b0ff:fe67:8049', 'fe80::fc16:3eff:fed4:3882', 'fe80::fc16:3eff:fe2b:21a3', 'fe80::48b6:7aff:feda:b750', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fec0:43c2', 'fe80::8cb0:efff:fe8f:244a', 'fe80::fc16:3eff:fe9e:b77a'] 
May 27 23:01:34.392920 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:01:34.393075 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:01:34.393859 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:34.394074 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Updating existing volume attachment record: a1cf91e3-3f3a-4b51-8b43-f4ade3792b86 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:01:34.431392 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:34.536048 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:01:34.610444 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:34.700015 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Updated VIF entry in instance network info cache for port 1f508337-775f-4120-a399-7a785fa5a827. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:01:34.700323 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Updating instance_info_cache with network_info: [{"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:34.830460 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Attempting to attach volume 6b43be18-5df6-4777-996a-afb63b3463fe with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:01:34.831852 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] attach device xml: <disk type="block" device="disk">
May 27 23:01:34.831852 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:34.831852 np0000001565 nova-compute[98289]:   <alias name="ua-6b43be18-5df6-4777-996a-afb63b3463fe"/>
May 27 23:01:34.831852 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-1"/>
May 27 23:01:34.831852 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:34.831852 np0000001565 nova-compute[98289]:   <serial>6b43be18-5df6-4777-996a-afb63b3463fe</serial>
May 27 23:01:34.831852 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:34.831852 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:01:34.974429 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:01:34.974691 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:34.974825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:34.975198 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:34.975393 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:01:34.989600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:34.990265 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:34.990784 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:34.991017 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:01:34.991930 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:34.991930 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:01:35.014655 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:01:35.014655 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:35.015758 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:01:35.015758 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:35.020228 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:35.020515 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:35.020801 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Attaching volume ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f to /dev/vdb
May 27 23:01:35.032870 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0] added
May 27 23:01:35.032870 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:01:35.032870 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:35.032870 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:35.032870 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:35.032870 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:35.032870 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:35.034084 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:01:35.034531 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0428(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:01:35.034531 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:01:35.038750 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0] added
May 27 23:01:35.038750 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:01:35.038750 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:35.038750 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:35.038750 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:35.038750 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:35.038750 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:35.038933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:01:35.040653 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0483(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:01:35.040879 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:01:35.075319 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:35.091889 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:01:35.098123 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:35.098385 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:35.101754 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:01:35.101917 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Claim successful on node np0000001565
May 27 23:01:35.112371 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a5787a98-c4a2-4c71-bb7b-ead7c8ef430c tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.595s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:35.120360 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:35.154561 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:01:35.154974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:01:35.163589 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:01:35.166455 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe38:c53a', 'fe80::cc7a:76ff:fe01:2cc5', 'fe80::fc16:3eff:fef7:298e', 'fe80::90cc:87ff:fe39:148b', 'fe80::fc16:3eff:fe2e:138c', 'fe80::68e2:adff:fe5e:9fb', 'fe80::fc16:3eff:fecb:dbbd', 'fe80::b0f9:b0ff:fe67:8049', 'fe80::fc16:3eff:fed4:3882', 'fe80::fc16:3eff:fe2b:21a3', 'fe80::48b6:7aff:feda:b750', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fec0:43c2', 'fe80::8cb0:efff:fe8f:244a', 'fe80::fc16:3eff:fe9e:b77a'] 
May 27 23:01:35.166687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:01:35.166788 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:01:35.167143 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:35.167649 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Updating existing volume attachment record: 95df882d-e05d-4ff6-81f7-0852e67f8aeb {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:01:35.204696 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-27b9e040-508d-4c51-ae6a-fb406c1bb15b req-5cf3306e-c46f-42e1-a297-918cb00c8781 service nova] Releasing lock "refresh_cache-f31ea991-4cf8-43e7-9d65-cfb193c3413a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:35.744747 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:01:35.745023 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:35.745140 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:36.034995 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:01:36.041229 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:36.047696 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:36.047696 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:36.052907 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:36.052907 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:36.058616 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:36.067697 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:36.074008 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:36.074008 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.074008 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.074008 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.074008 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.074008 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:36.074148 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsi session list stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:36.074148 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.074148 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.074148 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.074148 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.074148 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:36.079609 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:36.079609 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.079609 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.079609 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.079609 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.079609 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:36.080010 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsi session list stdout=tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:36.080010 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.080010 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.080010 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.080010 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.080010 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:36.107157 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0, portal: 192.168.50.100,3260]
May 27 23:01:36.107157 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0, portal: 192.168.50.100,3260] successful.
May 27 23:01:36.107157 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:36.118869 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0, portal: 192.168.40.100,3260]
May 27 23:01:36.118869 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0, portal: 192.168.40.100,3260] successful.
May 27 23:01:36.118869 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:36.122237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:36.136353 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:36.143800 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:36.143800 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:36.143800 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.143800 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.143800 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.143800 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.143800 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:36.143800 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:36.144729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:36.144729 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:36.144729 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.144729 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.144729 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.144729 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.144729 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:36.144729 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:36.144729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:36.144729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:36.145381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] HCTL ('12', '-', '-', 0) found on session 9 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:36.145381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:36.154347 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:36.154347 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:36.154347 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.154347 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.154347 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.154347 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.154347 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:36.154347 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:36.155196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:36.155196 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:36.155196 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.155196 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:36.155196 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.155196 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:36.155196 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:36.155196 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:36.155196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:36.155196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:36.156346 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] HCTL ('13', '-', '-', 0) found on session 10 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:36.156346 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:36.168081 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Searching for a device in session 9 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:36.168231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:36.173630 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Searching for a device in session 10 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:36.174236 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:36.240862 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "a0070282-e138-405c-b6c8-3478991d03f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:36.241146 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:36.488846 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:36.489079 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:36.489209 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:36.489364 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] No VIF found with MAC fa:16:3e:2e:13:8c, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:36.746218 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Detaching volume 34bf9816-3eda-4bfc-a260-492ad981a0f9
May 27 23:01:36.760765 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:01:36.761002 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:01:36.808401 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:36.835833 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Attempting to driver detach volume 34bf9816-3eda-4bfc-a260-492ad981a0f9 from mountpoint /dev/sdc
May 27 23:01:36.839848 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Found disk sdc by alias ua-34bf9816-3eda-4bfc-a260-492ad981a0f9 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:01:36.840985 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Found disk sdc by alias ua-34bf9816-3eda-4bfc-a260-492ad981a0f9 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:01:36.840985 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Attempting to detach device sdc from instance a0070282-e138-405c-b6c8-3478991d03f6 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:01:36.841215 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:01:36.841215 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:36.841215 np0000001565 nova-compute[98289]:   <alias name="ua-34bf9816-3eda-4bfc-a260-492ad981a0f9"/>
May 27 23:01:36.841215 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:01:36.841215 np0000001565 nova-compute[98289]:   <target dev="sdc" bus="scsi"/>
May 27 23:01:36.841215 np0000001565 nova-compute[98289]:   <serial>34bf9816-3eda-4bfc-a260-492ad981a0f9</serial>
May 27 23:01:36.841215 np0000001565 nova-compute[98289]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 27 23:01:36.841215 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:36.841215 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:36.849128 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Successfully detached device sdc from instance a0070282-e138-405c-b6c8-3478991d03f6 from the persistent domain config.
May 27 23:01:36.849387 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] (1/8): Attempting to detach device sdc with device alias ua-34bf9816-3eda-4bfc-a260-492ad981a0f9 from instance a0070282-e138-405c-b6c8-3478991d03f6 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:01:36.849643 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:01:36.849643 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:36.849643 np0000001565 nova-compute[98289]:   <alias name="ua-34bf9816-3eda-4bfc-a260-492ad981a0f9"/>
May 27 23:01:36.849643 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:01:36.849643 np0000001565 nova-compute[98289]:   <target dev="sdc" bus="scsi"/>
May 27 23:01:36.849643 np0000001565 nova-compute[98289]:   <serial>34bf9816-3eda-4bfc-a260-492ad981a0f9</serial>
May 27 23:01:36.849643 np0000001565 nova-compute[98289]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 27 23:01:36.849643 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:36.849643 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:36.991026 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:01:37.043050 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779922897.0337703, a0070282-e138-405c-b6c8-3478991d03f6 => ua-34bf9816-3eda-4bfc-a260-492ad981a0f9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:01:37.043050 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-34bf9816-3eda-4bfc-a260-492ad981a0f9 for instance a0070282-e138-405c-b6c8-3478991d03f6 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:01:37.044650 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Successfully detached device sdc from instance a0070282-e138-405c-b6c8-3478991d03f6 from the live domain config.
May 27 23:01:37.045613 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:01:37.046135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34bf9816-3eda-4bfc-a260-492ad981a0f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:37.046135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:37.056741 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:37.057002 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:37.057704 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:37.057704 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:37.057704 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:37.060156 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Terminating instance
May 27 23:01:37.266978 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:01:37.271078 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:37.565797 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:01:37.583687 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:37.586227 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:37.606891 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:37.611384 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:37.634217 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:37.774049 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.675s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:37.777373 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:01:37.880141 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:37.908238 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:37.920880 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999657739999975 future=<Future at 0x726e6056bd70 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:37.924670 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Instance destroyed successfully.
May 27 23:01:37.924670 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lazy-loading 'resources' on Instance uuid 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:37.937743 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.011768 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Found WWN 330000000d8aeda9b for multipath device dm-2 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:01:38.012112 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:38.012902 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.267s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:38.013309 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000d8aeda9b', 'path': '/dev/dm-2', 'multipath_id': '330000000d8aeda9b'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:38.013671 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:01:38.013865 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d8aeda9b', 'path': '/dev/dm-2', 'multipath_id': '330000000d8aeda9b'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:01:38.016598 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lazy-loading 'flavor' on Instance uuid 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:38.026106 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.028357 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:38.029660 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:38.029660 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:38.030256 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:01:38.030256 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:38.030256 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:01:38.048392 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:01:38.048392 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:38.048991 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:01:38.048991 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:38.056169 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-688ddb29-9ba8-4331-b0d1-17b7193e84de tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "3438591d-5ed5-45ed-8875-256372fc8333" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.424s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:38.063791 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f] added
May 27 23:01:38.063791 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:01:38.063791 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:38.063791 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:38.063791 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:38.063791 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:38.063791 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:38.064792 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:01:38.064909 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f] added
May 27 23:01:38.064909 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:01:38.064909 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:38.064909 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:38.064909 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:01:38.064909 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:01:38.064909 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:38.066625 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:01:38.066625 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:01:38.066625 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0358(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:01:38.066625 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:01:38.066625 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:01:38.257347 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.000311647999978959 future=<Future at 0x726e601b3c50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:38.257347 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:38.257347 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=4.546246485999973 future=<Future at 0x726e604c4080 state=cancelled>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:38.257347 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=4.546165959999826 future=<Future at 0x726e604c4080 state=cancelled>) was cancelled while queued, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:38.257347 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:38.257347 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.668568640000103 future=<Future at 0x726e6056bd70 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:38.257347 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.668505516000096 future=<Future at 0x726e6056bd70 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:38.262261 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Emitting event <LifecycleEvent: 1779922883.2492886, aed73162-7eae-4c10-98c8-3044b4aaa820 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:38.262598 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.263924 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] VM Stopped (Lifecycle Event)
May 27 23:01:38.267078 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.270930 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.281962 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:01:38.282594 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:01:38.283096 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:38.283522 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:38.299973 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.304646 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.376557 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d33b630152d4b96949f3afbb65d7115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efe372c67374c55bd40d7757474f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:01:38.379825 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9033ec4b-7fea-4f55-9982-102e0a514ddc tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] volume_snapshot_create: create_info: {'snapshot_id': '92773a8b-3a55-46df-9f38-9b7fa7290071', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98289) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 27 23:01:38.383354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9033ec4b-7fea-4f55-9982-102e0a514ddc tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] snap xml: <domainsnapshot>
May 27 23:01:38.383354 np0000001565 nova-compute[98289]:   <disks>
May 27 23:01:38.383354 np0000001565 nova-compute[98289]:     <disk name="/dev/dm-1" snapshot="external" type="file">
May 27 23:01:38.383354 np0000001565 nova-compute[98289]:       <source file="/dev/new_file"/>
May 27 23:01:38.383354 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:38.383354 np0000001565 nova-compute[98289]:     <disk name="vda" snapshot="no"/>
May 27 23:01:38.383354 np0000001565 nova-compute[98289]:     <disk name="hda" snapshot="no"/>
May 27 23:01:38.383354 np0000001565 nova-compute[98289]:   </disks>
May 27 23:01:38.383354 np0000001565 nova-compute[98289]: </domainsnapshot>
May 27 23:01:38.383354 np0000001565 nova-compute[98289]:  {{(pid=98289) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 27 23:01:38.383354 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9033ec4b-7fea-4f55-9982-102e0a514ddc tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] Lazy-loading 'system_metadata' on Instance uuid 3438591d-5ed5-45ed-8875-256372fc8333 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:38.420387 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.430104 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-103161366',display_name='tempest-ServersNegativeTestJSON-server-103161366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serversnegativetestjson-server-103161366',id=9,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:01:03Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='321f043ce59c483a85bfdeaa3b04eb4e',ramdisk_id='',reservation_id='r-09o5buma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1019668163',owner_user_name='tempest-ServersNegativeTestJSON-1019668163-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:01:04Z,user_data=None,user_id='77950bc2ac63423a8d5840370f33d411',uuid=1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "039e01d5-9a94-446c-a16c-fc2c425033f4", "address": "fa:16:3e:2b:21:a3", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap039e01d5-9a", "ovs_interfaceid": "039e01d5-9a94-446c-a16c-fc2c425033f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:01:38.430428 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converting VIF {"id": "039e01d5-9a94-446c-a16c-fc2c425033f4", "address": "fa:16:3e:2b:21:a3", "network": {"id": "254157f5-ea4e-41fb-9349-4f40622073d2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-550029963-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321f043ce59c483a85bfdeaa3b04eb4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap039e01d5-9a", "ovs_interfaceid": "039e01d5-9a94-446c-a16c-fc2c425033f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:38.431302 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:21:a3,bridge_name='br-int',has_traffic_filtering=True,id=039e01d5-9a94-446c-a16c-fc2c425033f4,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039e01d5-9a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:38.431637 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:21:a3,bridge_name='br-int',has_traffic_filtering=True,id=039e01d5-9a94-446c-a16c-fc2c425033f4,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039e01d5-9a') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:01:38.435500 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.435500 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap039e01d5-9a, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:38.435500 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:38.442641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.443993 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.443993 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5efe2e50-ee7b-4642-bf29-4109f7847334) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:38.444259 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:38.445163 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:38.447080 np0000001565 nova-compute[98289]: INFO os_vif [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:21:a3,bridge_name='br-int',has_traffic_filtering=True,id=039e01d5-9a94-446c-a16c-fc2c425033f4,network=Network(254157f5-ea4e-41fb-9349-4f40622073d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039e01d5-9a')
May 27 23:01:38.447416 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Deleting instance files /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a_del
May 27 23:01:38.448109 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Deletion of /opt/stack/data/nova/instances/1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a_del complete
May 27 23:01:38.458627 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b7d6e8a9-034e-43c3-8fe2-412b250a9e92 tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] volume_snapshot_delete: delete_info: {'volume_id': '6b43be18-5df6-4777-996a-afb63b3463fe'} {{(pid=98289) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 27 23:01:38.462300 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [None req-b7d6e8a9-034e-43c3-8fe2-412b250a9e92 tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 27 23:01:38.462300 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Traceback (most recent call last):
May 27 23:01:38.462300 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 27 23:01:38.462300 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]     self._volume_snapshot_delete(context, instance, volume_id,
May 27 23:01:38.462300 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 27 23:01:38.462300 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]     if delete_info['type'] != 'qcow2':
May 27 23:01:38.462300 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]        ~~~~~~~~~~~^^^^^^^^
May 27 23:01:38.462300 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333] KeyError: 'type'
May 27 23:01:38.462300 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333] 
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [None req-b7d6e8a9-034e-43c3-8fe2-412b250a9e92 tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver 
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver 
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-de2b82d4-d2f3-4121-89d2-d47d485f0dab)
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver 
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver 
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 27 23:01:38.500048 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.501851 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 27 23:01:38.501851 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 27 23:01:38.501851 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.501851 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 27 23:01:38.501851 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 27 23:01:38.501851 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.501851 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 27 23:01:38.501851 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 27 23:01:38.501851 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 27 23:01:38.501851 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver 
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server [None req-b7d6e8a9-034e-43c3-8fe2-412b250a9e92 tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] Exception during message handling: KeyError: 'type'
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     raise self.value
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     raise self.value
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 27 23:01:38.508896 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server 
May 27 23:01:38.519116 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Attempting to attach volume 2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:01:38.520404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:01:38.520404 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:38.520404 np0000001565 nova-compute[98289]:   <alias name="ua-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0"/>
May 27 23:01:38.520404 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:01:38.520404 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:38.520404 np0000001565 nova-compute[98289]:   <serial>2b0df7c7-3fbf-4f3e-8213-6586f551a9b0</serial>
May 27 23:01:38.520404 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:38.520404 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:01:38.768814 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0222c878-20a7-4f15-97a8-2eb10f863095 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aed73162-7eae-4c10-98c8-3044b4aaa820] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:38.788414 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:01:38.887252 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-9033ec4b-7fea-4f55-9982-102e0a514ddc tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Skipping quiescing instance: QEMU guest agent is not enabled.
May 27 23:01:38.896856 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Successfully created port: d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:01:38.903182 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [None req-9033ec4b-7fea-4f55-9982-102e0a514ddc tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 23:01:38.903182 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Traceback (most recent call last):
May 27 23:01:38.903182 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 27 23:01:38.903182 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 27 23:01:38.903182 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 27 23:01:38.903182 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 27 23:01:38.903182 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 27 23:01:38.903182 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 27 23:01:38.903182 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 23:01:38.903182 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333] 
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [None req-9033ec4b-7fea-4f55-9982-102e0a514ddc tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Traceback (most recent call last):
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]     self._volume_snapshot_create(context, instance, guest,
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 23:01:38.903750 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [instance: 3438591d-5ed5-45ed-8875-256372fc8333] 
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver [None req-9033ec4b-7fea-4f55-9982-102e0a514ddc tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 92773a8b-3a55-46df-9f38-9b7fa7290071 could not be found.
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver 
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver 
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 92773a8b-3a55-46df-9f38-9b7fa7290071 could not be found. (HTTP 404) (Request-ID: req-4a50220a-5de9-4650-98fb-7e01fd83f5e7)
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver 
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver 
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 27 23:01:38.953120 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 92773a8b-3a55-46df-9f38-9b7fa7290071 could not be found.
May 27 23:01:38.954545 np0000001565 nova-compute[98289]: ERROR nova.virt.libvirt.driver 
May 27 23:01:38.959700 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 23:01:38.960321 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:01:38.961284 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server [None req-9033ec4b-7fea-4f55-9982-102e0a514ddc tempest-VolumesAssistedSnapshotsTest-1479030499 tempest-VolumesAssistedSnapshotsTest-1479030499-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     raise self.value
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     raise self.value
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 23:01:38.962943 np0000001565 nova-compute[98289]: ERROR oslo_messaging.rpc.server 
May 27 23:01:38.963894 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:01:38.963894 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:39.024661 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:39.066844 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:01:39.069637 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:39.083229 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:39.083229 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:39.086744 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:39.086744 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:39.099550 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:39.103822 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:39.113876 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.113876 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:39.113876 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.113876 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.113876 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.113876 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.113876 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.113876 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:39.115032 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.115032 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:39.115032 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.115032 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.115032 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.115032 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.115032 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.115032 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:39.123467 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.123467 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:39.123467 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.123467 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.123467 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.123467 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.123467 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.123467 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:39.123644 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.123644 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:39.123644 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.123644 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.123644 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.123644 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.123644 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.123644 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:39.158445 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f, portal: 192.168.50.100,3260]
May 27 23:01:39.158445 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f, portal: 192.168.50.100,3260] successful.
May 27 23:01:39.158445 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:39.174651 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:39.194596 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f, portal: 192.168.40.100,3260]
May 27 23:01:39.194596 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f, portal: 192.168.40.100,3260] successful.
May 27 23:01:39.194596 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:39.200900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.200900 np0000001565 nova-compute[98289]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:39.200900 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:39.200900 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:39.200900 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.200900 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.200900 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.200900 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.200900 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.200900 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:39.201131 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.201131 np0000001565 nova-compute[98289]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:39.201131 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:39.201131 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:39.201131 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.201131 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.201131 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.201131 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.201131 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.201131 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:39.201352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:39.201504 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:39.202616 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] HCTL ('14', '-', '-', 0) found on session 11 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:39.202747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:39.211110 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:39.224705 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Searching for a device in session 11 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:39.224705 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:39.233878 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.233878 np0000001565 nova-compute[98289]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:39.233878 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:39.233878 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:39.233878 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.233878 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.233878 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.233878 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.233878 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.233878 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:39.234219 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.234219 np0000001565 nova-compute[98289]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:39.234219 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:39.234219 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:39.234219 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.234219 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:39.234219 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.234219 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:39.234219 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:39.234219 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:39.234750 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:39.234932 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:39.235847 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] HCTL ('15', '-', '-', 0) found on session 12 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:39.235993 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:39.251718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Searching for a device in session 12 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:39.251718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:39.294642 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:01:39.339242 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9ba71f3c-6d91-433e-8a65-3d5ae540eb78 req-25e8e3d7-632a-4bf1-850b-9dbc755d2a52 service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Received event network-vif-deleted-039e01d5-9a94-446c-a16c-fc2c425033f4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:39.339414 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-9ba71f3c-6d91-433e-8a65-3d5ae540eb78 req-25e8e3d7-632a-4bf1-850b-9dbc755d2a52 service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Neutron deleted interface 039e01d5-9a94-446c-a16c-fc2c425033f4; detaching it from the instance and deleting it from the info cache
May 27 23:01:39.341085 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9ba71f3c-6d91-433e-8a65-3d5ae540eb78 req-25e8e3d7-632a-4bf1-850b-9dbc755d2a52 service nova] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Detach interface failed, port_id=039e01d5-9a94-446c-a16c-fc2c425033f4, reason: Instance 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:01:39.420258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Acquiring lock "3438591d-5ed5-45ed-8875-256372fc8333" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:39.420508 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "3438591d-5ed5-45ed-8875-256372fc8333" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:39.560426 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Successfully updated port: d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:01:39.611525 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4459c7e5-ba90-470f-ad7c-897174912fbb req-0aee79c4-4678-4e7f-a17a-6d11e3db0455 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-changed-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:39.613507 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4459c7e5-ba90-470f-ad7c-897174912fbb req-0aee79c4-4678-4e7f-a17a-6d11e3db0455 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Refreshing instance network info cache due to event network-changed-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:01:39.613507 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4459c7e5-ba90-470f-ad7c-897174912fbb req-0aee79c4-4678-4e7f-a17a-6d11e3db0455 service nova] Acquiring lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:39.613507 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4459c7e5-ba90-470f-ad7c-897174912fbb req-0aee79c4-4678-4e7f-a17a-6d11e3db0455 service nova] Acquired lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:39.613507 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4459c7e5-ba90-470f-ad7c-897174912fbb req-0aee79c4-4678-4e7f-a17a-6d11e3db0455 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Refreshing network info cache for port d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:01:39.674581 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:39.674836 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:39.765512 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:39.923485 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Detaching volume 6b43be18-5df6-4777-996a-afb63b3463fe
May 27 23:01:39.963805 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Attempting to driver detach volume 6b43be18-5df6-4777-996a-afb63b3463fe from mountpoint /dev/vdb
May 27 23:01:39.966615 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Found disk vdb by alias ua-6b43be18-5df6-4777-996a-afb63b3463fe {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:01:39.967528 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Found disk vdb by alias ua-6b43be18-5df6-4777-996a-afb63b3463fe {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:01:39.967635 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Attempting to detach device vdb from instance 3438591d-5ed5-45ed-8875-256372fc8333 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:01:39.967854 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] detach device xml: <disk type="block" device="disk">
May 27 23:01:39.967854 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:39.967854 np0000001565 nova-compute[98289]:   <alias name="ua-6b43be18-5df6-4777-996a-afb63b3463fe"/>
May 27 23:01:39.967854 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-1"/>
May 27 23:01:39.967854 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:39.967854 np0000001565 nova-compute[98289]:   <serial>6b43be18-5df6-4777-996a-afb63b3463fe</serial>
May 27 23:01:39.967854 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:01:39.967854 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:39.967854 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:39.971974 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Successfully detached device vdb from instance 3438591d-5ed5-45ed-8875-256372fc8333 from the persistent domain config.
May 27 23:01:39.972101 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] (1/8): Attempting to detach device vdb with device alias ua-6b43be18-5df6-4777-996a-afb63b3463fe from instance 3438591d-5ed5-45ed-8875-256372fc8333 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:01:39.972315 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] detach device xml: <disk type="block" device="disk">
May 27 23:01:39.972315 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:39.972315 np0000001565 nova-compute[98289]:   <alias name="ua-6b43be18-5df6-4777-996a-afb63b3463fe"/>
May 27 23:01:39.972315 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-1"/>
May 27 23:01:39.972315 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:39.972315 np0000001565 nova-compute[98289]:   <serial>6b43be18-5df6-4777-996a-afb63b3463fe</serial>
May 27 23:01:39.972315 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:01:39.972315 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:39.972315 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:40.030131 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:01:40.062776 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:40.114805 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4459c7e5-ba90-470f-ad7c-897174912fbb req-0aee79c4-4678-4e7f-a17a-6d11e3db0455 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:40.175889 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4459c7e5-ba90-470f-ad7c-897174912fbb req-0aee79c4-4678-4e7f-a17a-6d11e3db0455 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:01:40.177577 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:01:40.198005 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:40.198243 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:40.198373 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] No VIF found with MAC fa:16:3e:38:c5:3a, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:40.267181 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Took 1.31 seconds to deallocate network for instance.
May 27 23:01:40.302360 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:01:40.303478 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:01:40.303552 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Creating image(s)
May 27 23:01:40.304408 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:40.304408 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:40.305020 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:40.305489 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:40.308206 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:40.309819 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:40.327253 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4459c7e5-ba90-470f-ad7c-897174912fbb req-0aee79c4-4678-4e7f-a17a-6d11e3db0455 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:40.388437 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:40.388840 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:40.389280 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:40.389664 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:40.391971 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:40.392258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:40.451620 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779922900.4504642, 3438591d-5ed5-45ed-8875-256372fc8333 => ua-6b43be18-5df6-4777-996a-afb63b3463fe> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:01:40.453289 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-6b43be18-5df6-4777-996a-afb63b3463fe for instance 3438591d-5ed5-45ed-8875-256372fc8333 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:01:40.457886 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Successfully detached device vdb from instance 3438591d-5ed5-45ed-8875-256372fc8333 from the live domain config.
May 27 23:01:40.458826 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:01:40.459469 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b43be18-5df6-4777-996a-afb63b3463fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:40.459752 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:40.470585 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.078s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:40.471071 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:40.504756 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk 1073741824" returned: 0 in 0.033s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:40.505266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.116s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:40.505651 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:40.573907 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.068s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:40.574501 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:01:40.574775 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:40.645301 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:40.645672 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Cannot resize image /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:01:40.646086 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:01:40.646273 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Ensure instance console log exists: /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:01:40.646545 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:40.646796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:40.646944 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:40.724740 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:40.725401 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:40.727782 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:01:40.727928 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Claim successful on node np0000001565
May 27 23:01:40.772660 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:40.831120 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4459c7e5-ba90-470f-ad7c-897174912fbb req-0aee79c4-4678-4e7f-a17a-6d11e3db0455 service nova] Releasing lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:40.831718 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquired lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:40.831963 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:01:41.048551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Found WWN 3300000004d095082 for multipath device dm-3 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:01:41.048992 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:41.049443 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] <== connect_volume: return (5304ms) {'type': 'block', 'scsi_wwn': '3300000004d095082', 'path': '/dev/dm-3', 'multipath_id': '3300000004d095082'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:41.049619 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004d095082', 'path': '/dev/dm-3', 'multipath_id': '3300000004d095082'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:01:41.049970 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:41.050762 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34bf9816-3eda-4bfc-a260-492ad981a0f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:01:41.050927 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:01:41.054977 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lazy-loading 'flavor' on Instance uuid aee84b65-41d8-427d-96d0-cd328e4863ba {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:41.077099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:41.077099 np0000001565 nova-compute[98289]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:41.077099 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:41.077099 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:41.077099 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:41.077099 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:41.077099 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:41.077099 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:41.077099 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:41.077099 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:41.077420 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:41.077420 np0000001565 nova-compute[98289]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:41.077420 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:41.077420 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:41.077420 np0000001565 nova-compute[98289]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:41.077420 np0000001565 nova-compute[98289]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9 (non-flash)
May 27 23:01:41.077420 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:41.077420 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:41.077420 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:41.077420 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:41.077420 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', '9')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:01:41.077658 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', '5')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:01:41.078485 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9', '6')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:01:41.079253 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e601adb20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9'): ({'sdd'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:01:41.079486 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Removing multipathed devices sdd, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:01:41.079732 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Flush multipath device 330000000caaaf74f {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:01:41.118609 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:01:41.178917 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:01:41.228784 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:01:41.229041 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:01:41.230188 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:01:41.241071 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:01:41.241306 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:01:41.252259 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.282360 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9, portal: 192.168.40.100,3260]
May 27 23:01:41.282360 np0000001565 nova-compute[98289]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9, portal: 192.168.40.100,3260] successful.
May 27 23:01:41.282360 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.298265 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.308137 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.338356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9, portal: 192.168.50.100,3260]
May 27 23:01:41.338356 np0000001565 nova-compute[98289]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-34bf9816-3eda-4bfc-a260-492ad981a0f9, portal: 192.168.50.100,3260] successful.
May 27 23:01:41.338356 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.354237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.354476 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:41.354709 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] <== disconnect_volume: return (4309ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:41.354923 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:01:41.355182 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.895s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:41.355540 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b43be18-5df6-4777-996a-afb63b3463fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:01:41.358562 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:01:41.384247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:41.384247 np0000001565 nova-compute[98289]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:41.384247 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:41.384247 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:41.384247 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:41.384247 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:41.384247 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:41.384247 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:41.384473 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:41.384473 np0000001565 nova-compute[98289]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:41.384473 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:41.384473 np0000001565 nova-compute[98289]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4 (non-flash)
May 27 23:01:41.384473 np0000001565 nova-compute[98289]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:41.384473 np0000001565 nova-compute[98289]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe (non-flash)
May 27 23:01:41.384473 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:41.384473 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:41.384711 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6047a5dc-30b9-45d1-94d2-9b3e686606f4', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', '9')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:01:41.384860 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', '8')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:01:41.386030 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe', '7')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:01:41.386839 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58731620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:01:41.387230 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Removing multipathed devices sdf, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:01:41.387514 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Flush multipath device 330000000c8c842db {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:01:41.415820 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:01:41.420646 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:01:41.478179 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:01:41.528920 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:01:41.529111 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] SCSI volumes sdf, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:01:41.532964 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:01:41.544082 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:01:41.544301 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:01:41.557497 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.560596 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Attempting to attach volume ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:01:41.561953 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:01:41.561953 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:41.561953 np0000001565 nova-compute[98289]:   <alias name="ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f"/>
May 27 23:01:41.561953 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:01:41.561953 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:41.561953 np0000001565 nova-compute[98289]:   <serial>ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f</serial>
May 27 23:01:41.561953 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:01:41.561953 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:41.561953 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:01:41.590790 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:41.600562 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe, portal: 192.168.40.100,3260]
May 27 23:01:41.600562 np0000001565 nova-compute[98289]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe, portal: 192.168.40.100,3260] successful.
May 27 23:01:41.600562 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.616255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.635825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.671675 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe, portal: 192.168.50.100,3260]
May 27 23:01:41.671675 np0000001565 nova-compute[98289]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-6b43be18-5df6-4777-996a-afb63b3463fe, portal: 192.168.50.100,3260] successful.
May 27 23:01:41.671675 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.689742 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:41.689943 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:41.690076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] <== disconnect_volume: return (1230ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:41.690198 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:01:41.747123 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-05b2c39b-1fd4-4cf1-80fd-009094f5259f tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.502s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:41.771410 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updating instance_info_cache with network_info: [{"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:41.914745 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lazy-loading 'flavor' on Instance uuid a0070282-e138-405c-b6c8-3478991d03f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:42.000241 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0f52b356-b40c-44cd-8ca2-780ba079b32e req-6fc380a7-0ecf-4fe6-8a90-028c718e488a service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:42.000790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0f52b356-b40c-44cd-8ca2-780ba079b32e req-6fc380a7-0ecf-4fe6-8a90-028c718e488a service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:42.001053 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0f52b356-b40c-44cd-8ca2-780ba079b32e req-6fc380a7-0ecf-4fe6-8a90-028c718e488a service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:42.001403 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0f52b356-b40c-44cd-8ca2-780ba079b32e req-6fc380a7-0ecf-4fe6-8a90-028c718e488a service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:42.001795 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0f52b356-b40c-44cd-8ca2-780ba079b32e req-6fc380a7-0ecf-4fe6-8a90-028c718e488a service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:42.001933 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-0f52b356-b40c-44cd-8ca2-780ba079b32e req-6fc380a7-0ecf-4fe6-8a90-028c718e488a service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received unexpected event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with vm_state building and task_state spawning.
May 27 23:01:42.254766 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lazy-loading 'flavor' on Instance uuid 3438591d-5ed5-45ed-8875-256372fc8333 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:42.274404 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Releasing lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:42.274999 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Instance network_info: |[{"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:01:42.276432 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Start _get_guest_xml network_info=[{"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:01:42.278282 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:01:42.279433 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1387169604', uuid='602b3e68-4ea1-48f7-a212-af3d9f8ddf7d'), owner=OwnerMeta(userid='8d33b630152d4b96949f3afbb65d7115', username='tempest-ServerRescueNegativeTestJSON-550001831-project-member', projectid='7efe372c67374c55bd40d7757474f80a', projectname='tempest-ServerRescueNegativeTestJSON-550001831'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922902.2791035) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:01:42.280244 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:01:42.280604 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:01:42.281628 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:01:42.281628 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:01:42.282253 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:01:42.283809 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:01:42.283809 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:01:42.283809 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:01:42.283809 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:01:42.283809 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:01:42.283809 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:01:42.283809 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:01:42.284122 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:01:42.284122 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:01:42.284196 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:01:42.284384 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:01:42.297455 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387169604',display_name='tempest-ServerRescueNegativeTestJSON-server-1387169604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-1387169604',id=11,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMm+yhSwEok+0ExtQUX/N7Mp2wWehXO06JZkCmX7PNpDkKIgB3aEsU6fo/i2atzPjbTEkDy8zEdL4FI+9I32CVR1gqa6cI1Wn0i/uB7WDgHSVop9ymnZE7TmYqrtE4yC3w==',key_name='tempest-keypair-1375101173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-nkhrldeb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:01:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d33b630152d4b96949f3afbb65d7115',uuid=602b3e68-4ea1-48f7-a212-af3d9f8ddf7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:01:42.297671 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:42.298133 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=d1c554f6-4c5e-4c94-b8dd-469ba0a41da8,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c554f6-4c') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:42.298747 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'pci_devices' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:42.300301 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:01:42.300301 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:01:42.803795 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:01:42.809089 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] End _get_guest_xml xml=<domain type="qemu">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <uuid>602b3e68-4ea1-48f7-a212-af3d9f8ddf7d</uuid>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <name>instance-0000000b</name>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1387169604</nova:name>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:01:42</nova:creationTime>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:user uuid="8d33b630152d4b96949f3afbb65d7115">tempest-ServerRescueNegativeTestJSON-550001831-project-member</nova:user>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:project uuid="7efe372c67374c55bd40d7757474f80a">tempest-ServerRescueNegativeTestJSON-550001831</nova:project>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         <nova:port uuid="d1c554f6-4c5e-4c94-b8dd-469ba0a41da8">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <system>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <entry name="serial">602b3e68-4ea1-48f7-a212-af3d9f8ddf7d</entry>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <entry name="uuid">602b3e68-4ea1-48f7-a212-af3d9f8ddf7d</entry>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     </system>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <os>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   </os>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <features>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   </features>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   <devices>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.config"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:47:f0:45"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <target dev="tapd1c554f6-4c"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     </interface>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/console.log" append="off"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     </serial>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <video>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     </video>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     </rng>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:   </devices>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]: </domain>
May 27 23:01:42.809089 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:01:42.811209 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Preparing to wait for external event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:01:42.811209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:42.811209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:42.811209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:42.811897 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387169604',display_name='tempest-ServerRescueNegativeTestJSON-server-1387169604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-1387169604',id=11,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMm+yhSwEok+0ExtQUX/N7Mp2wWehXO06JZkCmX7PNpDkKIgB3aEsU6fo/i2atzPjbTEkDy8zEdL4FI+9I32CVR1gqa6cI1Wn0i/uB7WDgHSVop9ymnZE7TmYqrtE4yC3w==',key_name='tempest-keypair-1375101173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-nkhrldeb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:01:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d33b630152d4b96949f3afbb65d7115',uuid=602b3e68-4ea1-48f7-a212-af3d9f8ddf7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:01:42.812100 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:42.812743 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=d1c554f6-4c5e-4c94-b8dd-469ba0a41da8,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c554f6-4c') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:42.813080 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=d1c554f6-4c5e-4c94-b8dd-469ba0a41da8,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c554f6-4c') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:01:42.813466 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:42.813795 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:42.814043 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:01:42.815052 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:42.815193 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58a532f7-dbda-58bd-93cb-cf2dec6c1463', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:42.815945 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:42.817072 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:42.819155 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:42.819441 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1c554f6-4c, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:42.819762 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1c554f6-4c, col_values=(('qos', UUID('05dda841-ab0d-45f8-b876-388b039257a4')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:42.822713 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1c554f6-4c, col_values=(('external_ids', {'iface-id': 'd1c554f6-4c5e-4c94-b8dd-469ba0a41da8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:f0:45', 'vm-uuid': '602b3e68-4ea1-48f7-a212-af3d9f8ddf7d'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:42.822713 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:42.822713 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:42.826837 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:42.828048 np0000001565 nova-compute[98289]: INFO os_vif [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=d1c554f6-4c5e-4c94-b8dd-469ba0a41da8,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c554f6-4c')
May 27 23:01:42.922119 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73378b39-c436-4704-81ef-d151dcc1d6ab tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.681s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:43.038573 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:43.217688 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:43.218000 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:43.218000 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:43.220392 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No VIF found with MAC fa:16:3e:d4:38:82, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:43.260279 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fe318b39-cc73-47e8-b26c-c7e4cf69c733 tempest-VolumesAssistedSnapshotsTest-2130592567 tempest-VolumesAssistedSnapshotsTest-2130592567-project-admin] Lock "3438591d-5ed5-45ed-8875-256372fc8333" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.840s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:43.315369 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.588s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:43.315881 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:01:43.319988 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.547s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:43.814143 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "a0070282-e138-405c-b6c8-3478991d03f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:43.814344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:43.814578 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "a0070282-e138-405c-b6c8-3478991d03f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:43.814730 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:43.814875 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:43.817283 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Terminating instance
May 27 23:01:43.832278 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:43.833557 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:43.837089 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:01:43.839010 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:01:43.844079 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:01:43.845667 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:43.845894 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:01:43.847104 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:43.942509 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6037b0819a94463e8e45d96f834c4341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818a7ed096346eb92128648c4280071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:01:44.313857 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Successfully created port: 434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:01:44.326074 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:01:44.341350 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Detaching volume 2b0df7c7-3fbf-4f3e-8213-6586f551a9b0
May 27 23:01:44.341350 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:01:44.350723 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:01:44.363351 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:44.385931 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:44.385931 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:44.385931 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No VIF found with MAC fa:16:3e:47:f0:45, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:44.386888 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Using config drive
May 27 23:01:44.415723 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:44.431285 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Attempting to driver detach volume 2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 from mountpoint /dev/vdb
May 27 23:01:44.443167 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Found disk vdb by alias ua-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:01:44.444583 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Found disk vdb by alias ua-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:01:44.444681 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Attempting to detach device vdb from instance 13686e4c-ae8e-4837-a71f-2d710575ab33 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:01:44.445002 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:01:44.445002 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:44.445002 np0000001565 nova-compute[98289]:   <alias name="ua-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0"/>
May 27 23:01:44.445002 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:01:44.445002 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:44.445002 np0000001565 nova-compute[98289]:   <serial>2b0df7c7-3fbf-4f3e-8213-6586f551a9b0</serial>
May 27 23:01:44.445002 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 23:01:44.445002 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:44.445002 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:44.447640 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:44.447771 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:44.451771 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Successfully detached device vdb from instance 13686e4c-ae8e-4837-a71f-2d710575ab33 from the persistent domain config.
May 27 23:01:44.451939 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] (1/8): Attempting to detach device vdb with device alias ua-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 from instance 13686e4c-ae8e-4837-a71f-2d710575ab33 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:01:44.453286 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:01:44.453286 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:44.453286 np0000001565 nova-compute[98289]:   <alias name="ua-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0"/>
May 27 23:01:44.453286 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:01:44.453286 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:44.453286 np0000001565 nova-compute[98289]:   <serial>2b0df7c7-3fbf-4f3e-8213-6586f551a9b0</serial>
May 27 23:01:44.453286 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 23:01:44.453286 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:44.453286 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:44.596862 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-beffa6e7-3b58-42ae-bdda-32e88104ff45 req-a26169a9-1fba-48bd-a5e3-aa37542696d5 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Received event network-vif-unplugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:44.597032 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-beffa6e7-3b58-42ae-bdda-32e88104ff45 req-a26169a9-1fba-48bd-a5e3-aa37542696d5 service nova] Acquiring lock "a0070282-e138-405c-b6c8-3478991d03f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:44.597235 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-beffa6e7-3b58-42ae-bdda-32e88104ff45 req-a26169a9-1fba-48bd-a5e3-aa37542696d5 service nova] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:44.597429 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-beffa6e7-3b58-42ae-bdda-32e88104ff45 req-a26169a9-1fba-48bd-a5e3-aa37542696d5 service nova] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:44.597872 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-beffa6e7-3b58-42ae-bdda-32e88104ff45 req-a26169a9-1fba-48bd-a5e3-aa37542696d5 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] No waiting events found dispatching network-vif-unplugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:44.598037 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-beffa6e7-3b58-42ae-bdda-32e88104ff45 req-a26169a9-1fba-48bd-a5e3-aa37542696d5 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Received event network-vif-unplugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:01:44.671788 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99960818999989 future=<Future at 0x726e587545c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:44.674200 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Instance destroyed successfully.
May 27 23:01:44.675221 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lazy-loading 'resources' on Instance uuid a0070282-e138-405c-b6c8-3478991d03f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:44.773484 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5de1239-750f-4ba3-86d9-754daa0f8df4 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.753s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:44.844699 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:01:44.888371 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.569s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:44.898109 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:44.926796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Acquiring lock "3438591d-5ed5-45ed-8875-256372fc8333" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:44.926796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "3438591d-5ed5-45ed-8875-256372fc8333" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:44.926796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Acquiring lock "3438591d-5ed5-45ed-8875-256372fc8333-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:44.926796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:44.926796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:44.926796 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Terminating instance
May 27 23:01:44.946936 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779922904.9464116, 13686e4c-ae8e-4837-a71f-2d710575ab33 => ua-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:01:44.948377 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Deleted allocations for instance 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a
May 27 23:01:44.950302 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 for instance 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:01:44.952515 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lazy-loading 'flavor' on Instance uuid f31ea991-4cf8-43e7-9d65-cfb193c3413a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:44.962616 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Successfully detached device vdb from instance 13686e4c-ae8e-4837-a71f-2d710575ab33 from the live domain config.
May 27 23:01:44.963700 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:01:44.963969 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:44.964142 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:44.964778 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:44.964778 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:01:44.964886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:01:44.994498 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:44.994498 np0000001565 nova-compute[98289]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:44.994498 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:44.994498 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:44.994498 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:44.994746 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:44.994746 np0000001565 nova-compute[98289]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:44.994746 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:44.994746 np0000001565 nova-compute[98289]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0 (non-flash)
May 27 23:01:44.994746 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:44.994883 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', '9')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:01:44.995132 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', '10')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:01:44.995968 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0', '9')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:01:44.996664 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e587f34c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:01:44.996846 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Removing multipathed devices sdg, sdh {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:01:44.997076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Flush multipath device 330000000d8aeda9b {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:01:45.027759 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:01:45.054833 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Creating config drive at /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.config
May 27 23:01:45.059469 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvnqfsba4 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:45.075392 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:01:45.103642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvnqfsba4" returned: 0 in 0.044s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:45.116056 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:01:45.118647 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Successfully updated port: 434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:01:45.120351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:01:45.120922 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:01:45.133797 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:01:45.134125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:01:45.144005 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:45.176059 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0, portal: 192.168.40.100,3260]
May 27 23:01:45.176059 np0000001565 nova-compute[98289]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0, portal: 192.168.40.100,3260] successful.
May 27 23:01:45.176059 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:45.178948 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1003707978',display_name='tempest-AttachSCSIVolumeTestJSON-server-1003707978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachscsivolumetestjson-server-1003707978',id=4,image_ref='cb03b116-09bf-4cbd-b55b-28b84e40d106',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMyf/XkZMCQHyXHzKyP4pq68sVrNxZvaLjJ5gGwn+Tjm2XE1xRp5nXR8DeEnP6sYCfWRmSG8PEgcxYSDkqiRAHb3SomPF1/kwFWLGmRzWmdljCM7zHld5hmPZTcvO8U7Q==',key_name='tempest-keypair-1982468598',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:44Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e563b54a24044564bd9f42d080e21b90',ramdisk_id='',reservation_id='r-g6rvsvrt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cb03b116-09bf-4cbd-b55b-28b84e40d106',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1209336345',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1209336345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:00:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d2e5dcd70eb4347bb621fac87c3c384',uuid=a0070282-e138-405c-b6c8-3478991d03f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "address": "fa:16:3e:f7:29:8e", "network": {"id": "dc1c8145-c753-4e29-8f29-a3eb6dad6e3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-218840385-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e563b54a24044564bd9f42d080e21b90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3cda67-ac", "ovs_interfaceid": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:01:45.179196 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Converting VIF {"id": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "address": "fa:16:3e:f7:29:8e", "network": {"id": "dc1c8145-c753-4e29-8f29-a3eb6dad6e3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-218840385-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e563b54a24044564bd9f42d080e21b90", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3cda67-ac", "ovs_interfaceid": "3d3cda67-acda-4008-ad58-dc64f4eb2c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:45.180118 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:29:8e,bridge_name='br-int',has_traffic_filtering=True,id=3d3cda67-acda-4008-ad58-dc64f4eb2c8b,network=Network(dc1c8145-c753-4e29-8f29-a3eb6dad6e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3cda67-ac') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:45.180662 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:29:8e,bridge_name='br-int',has_traffic_filtering=True,id=3d3cda67-acda-4008-ad58-dc64f4eb2c8b,network=Network(dc1c8145-c753-4e29-8f29-a3eb6dad6e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3cda67-ac') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:01:45.184110 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.184490 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d3cda67-ac, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:45.200089 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.200972 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:45.201693 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:45.207154 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.208197 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.208367 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0098dfc-0ae7-4a46-bfe2-e381846cab3e) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:45.209028 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.209518 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:45.213566 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:45.213941 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.217931 np0000001565 nova-compute[98289]: INFO os_vif [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:29:8e,bridge_name='br-int',has_traffic_filtering=True,id=3d3cda67-acda-4008-ad58-dc64f4eb2c8b,network=Network(dc1c8145-c753-4e29-8f29-a3eb6dad6e3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3cda67-ac')
May 27 23:01:45.217931 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Deleting instance files /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6_del
May 27 23:01:45.218278 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Deletion of /opt/stack/data/nova/instances/a0070282-e138-405c-b6c8-3478991d03f6_del complete
May 27 23:01:45.241315 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0, portal: 192.168.50.100,3260]
May 27 23:01:45.241315 np0000001565 nova-compute[98289]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-2b0df7c7-3fbf-4f3e-8213-6586f551a9b0, portal: 192.168.50.100,3260] successful.
May 27 23:01:45.241315 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:45.253865 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:45.254125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:45.254238 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] <== disconnect_volume: return (289ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:45.254369 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:01:45.432473 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:01:45.459168 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.464190 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.487140 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.505030 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.534731 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.578545 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.613218 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.621912 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "refresh_cache-efc3328c-5e17-4eb2-b8fb-e645a6805b0e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:45.622012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquired lock "refresh_cache-efc3328c-5e17-4eb2-b8fb-e645a6805b0e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:45.622145 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:01:45.708160 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.726097 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Took 1.40 seconds to destroy the instance on the hypervisor.
May 27 23:01:45.729308 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:01:45.729751 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:01:45.729886 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: a0070282-e138-405c-b6c8-3478991d03f6] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:01:45.730258 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:45.770599 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.774929 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:45.814857 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lazy-loading 'flavor' on Instance uuid 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:45.820609 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-99dd9cd0-958a-471c-b3ab-a4845a17d4d1 req-b7ae0f92-752b-42fc-8fb1-f9b735711bf8 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:45.820609 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999546508000094 future=<Future at 0x726e605fffb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:45.820609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-99dd9cd0-958a-471c-b3ab-a4845a17d4d1 req-b7ae0f92-752b-42fc-8fb1-f9b735711bf8 service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:45.820609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-99dd9cd0-958a-471c-b3ab-a4845a17d4d1 req-b7ae0f92-752b-42fc-8fb1-f9b735711bf8 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:45.820609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-99dd9cd0-958a-471c-b3ab-a4845a17d4d1 req-b7ae0f92-752b-42fc-8fb1-f9b735711bf8 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:45.820983 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-99dd9cd0-958a-471c-b3ab-a4845a17d4d1 req-b7ae0f92-752b-42fc-8fb1-f9b735711bf8 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Processing event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:01:45.825165 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Instance destroyed successfully.
May 27 23:01:45.825165 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lazy-loading 'resources' on Instance uuid 3438591d-5ed5-45ed-8875-256372fc8333 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:45.853165 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:01:45.854210 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:01:45.854498 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Creating image(s)
May 27 23:01:45.855321 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "/opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:45.855550 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:45.856119 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:45.856752 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:45.861676 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:45.863534 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:45.881554 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:45.950168 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:45.951761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:45.952382 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:45.952872 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:45.956612 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:45.957053 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:45.975075 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.527s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:45.982800 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-49c13f5e-af19-45f0-b647-fd5f4946eaf0 tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Lock "1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.926s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:46.037529 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.080s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:46.037800 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:46.076094 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk 1073741824" returned: 0 in 0.038s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:46.076666 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.124s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:46.077914 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:46.149674 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.071s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:46.150191 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:01:46.150555 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:46.227018 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:46.227693 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Cannot resize image /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:01:46.228301 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:01:46.228599 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Ensure instance console log exists: /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:01:46.228941 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:46.229254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:46.229588 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:46.237923 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:01:46.328187 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-230507400',display_name='tempest-VolumesAssistedSnapshotsTest-server-230507400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesassistedsnapshotstest-server-230507400',id=5,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6W+AHnJCWRdvMI1ffUFfBHWi+NyfDyxNd+AezgFMGg7XpukffnqOMmOjsIbph7uiuYEJ8DjO6wK782PfhaYiTz0uzYdUz+U6qVg7nWKp3j0j4CJYu8AAnMsWcMg/K6tg==',key_name='tempest-keypair-100102408',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:48Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b17fb0c9be4c4d30bd907eb08e2c5e3e',ramdisk_id='',reservation_id='r-sj4xugnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1424615901',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1424615901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84fd5efd52f1407cbb4aafaba4744bc3',uuid=3438591d-5ed5-45ed-8875-256372fc8333,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:01:46.328533 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Converting VIF {"id": "c75229d6-c711-4185-80fd-07e0cc9702c0", "address": "fa:16:3e:2e:13:8c", "network": {"id": "a9ddb0fe-77be-4735-8de1-47b3726a3696", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-488607944-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b17fb0c9be4c4d30bd907eb08e2c5e3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc75229d6-c7", "ovs_interfaceid": "c75229d6-c711-4185-80fd-07e0cc9702c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:46.329467 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:13:8c,bridge_name='br-int',has_traffic_filtering=True,id=c75229d6-c711-4185-80fd-07e0cc9702c0,network=Network(a9ddb0fe-77be-4735-8de1-47b3726a3696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75229d6-c7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:46.329807 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:13:8c,bridge_name='br-int',has_traffic_filtering=True,id=c75229d6-c711-4185-80fd-07e0cc9702c0,network=Network(a9ddb0fe-77be-4735-8de1-47b3726a3696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75229d6-c7') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:01:46.331825 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:46.332176 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc75229d6-c7, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:46.334903 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:46.334903 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:46.334903 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:46.336354 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:46.336354 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40255c93-7ee8-4f25-b1a6-4c4df190c335) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:46.340550 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:46.342211 np0000001565 nova-compute[98289]: INFO os_vif [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:13:8c,bridge_name='br-int',has_traffic_filtering=True,id=c75229d6-c711-4185-80fd-07e0cc9702c0,network=Network(a9ddb0fe-77be-4735-8de1-47b3726a3696),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc75229d6-c7')
May 27 23:01:46.342937 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Deleting instance files /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333_del
May 27 23:01:46.343324 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Deletion of /opt/stack/data/nova/instances/3438591d-5ed5-45ed-8875-256372fc8333_del complete
May 27 23:01:46.396954 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:46.532647 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922906.5323184, 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:46.533055 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] VM Started (Lifecycle Event)
May 27 23:01:46.534456 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:01:46.538668 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:01:46.542381 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Instance spawned successfully.
May 27 23:01:46.542381 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:01:46.553729 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Updating instance_info_cache with network_info: [{"id": "434bf486-9c62-458f-b5d4-2be60504d9fd", "address": "fa:16:3e:1a:5b:46", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap434bf486-9c", "ovs_interfaceid": "434bf486-9c62-458f-b5d4-2be60504d9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:46.841383 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:46.848793 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Took 1.42 seconds to destroy the instance on the hypervisor.
May 27 23:01:46.849464 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:01:46.851671 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:01:46.851671 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:01:46.851671 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:46.864565 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Received event network-vif-unplugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:46.865099 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Acquiring lock "a0070282-e138-405c-b6c8-3478991d03f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:46.865261 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:46.865854 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Lock "a0070282-e138-405c-b6c8-3478991d03f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:46.865978 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] No waiting events found dispatching network-vif-unplugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:46.866101 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Received event network-vif-unplugged-3d3cda67-acda-4008-ad58-dc64f4eb2c8b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:01:46.866211 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Received event network-changed-434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:46.866324 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Refreshing instance network info cache due to event network-changed-434bf486-9c62-458f-b5d4-2be60504d9fd. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:01:46.866522 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Acquiring lock "refresh_cache-efc3328c-5e17-4eb2-b8fb-e645a6805b0e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:46.937525 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:47.031678 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:47.031900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:47.032185 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Attaching volume ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f to /dev/vdb
May 27 23:01:47.036884 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:47.038178 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:47.049948 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:47.050202 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:47.050652 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:47.050912 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:47.051201 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:47.051634 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:47.056802 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Releasing lock "refresh_cache-efc3328c-5e17-4eb2-b8fb-e645a6805b0e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:47.057025 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Instance network_info: |[{"id": "434bf486-9c62-458f-b5d4-2be60504d9fd", "address": "fa:16:3e:1a:5b:46", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap434bf486-9c", "ovs_interfaceid": "434bf486-9c62-458f-b5d4-2be60504d9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:01:47.059947 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Start _get_guest_xml network_info=[{"id": "434bf486-9c62-458f-b5d4-2be60504d9fd", "address": "fa:16:3e:1a:5b:46", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap434bf486-9c", "ovs_interfaceid": "434bf486-9c62-458f-b5d4-2be60504d9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:01:47.064639 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Acquired lock "refresh_cache-efc3328c-5e17-4eb2-b8fb-e645a6805b0e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:47.065018 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Refreshing network info cache for port 434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:01:47.067577 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "interface-13686e4c-ae8e-4837-a71f-2d710575ab33-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:47.069103 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "interface-13686e4c-ae8e-4837-a71f-2d710575ab33-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:47.075219 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:01:47.075219 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1740959205', uuid='efc3328c-5e17-4eb2-b8fb-e645a6805b0e'), owner=OwnerMeta(userid='6037b0819a94463e8e45d96f834c4341', username='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member', projectid='9818a7ed096346eb92128648c4280071', projectname='tempest-ServerBootFromVolumeStableRescueTest-800872693'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "434bf486-9c62-458f-b5d4-2be60504d9fd", "address": "fa:16:3e:1a:5b:46", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap434bf486-9c", "ovs_interfaceid": "434bf486-9c62-458f-b5d4-2be60504d9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922907.0746317) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:01:47.079241 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:01:47.080909 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:01:47.085291 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:01:47.085523 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:01:47.086436 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:01:47.086812 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:01:47.086919 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:01:47.086974 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:01:47.087146 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:01:47.087200 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:01:47.087294 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:01:47.087501 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:01:47.087608 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:01:47.087723 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:01:47.087817 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:01:47.087924 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:01:47.098370 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1740959205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-1740959205',id=12,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-qw9738qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:01:45Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=efc3328c-5e17-4eb2-b8fb-e645a6805b0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "434bf486-9c62-458f-b5d4-2be60504d9fd", "address": "fa:16:3e:1a:5b:46", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap434bf486-9c", "ovs_interfaceid": "434bf486-9c62-458f-b5d4-2be60504d9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:01:47.098580 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "434bf486-9c62-458f-b5d4-2be60504d9fd", "address": "fa:16:3e:1a:5b:46", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap434bf486-9c", "ovs_interfaceid": "434bf486-9c62-458f-b5d4-2be60504d9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:47.099090 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:46,bridge_name='br-int',has_traffic_filtering=True,id=434bf486-9c62-458f-b5d4-2be60504d9fd,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434bf486-9c') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:47.099613 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'pci_devices' on Instance uuid efc3328c-5e17-4eb2-b8fb-e645a6805b0e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:47.110571 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:47.125713 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:01:47.163455 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:47.204378 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:01:47.204378 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:01:47.216733 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:01:47.218166 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe38:c53a', 'fe80::cc7a:76ff:fe01:2cc5', 'fe80::fc16:3eff:fecb:dbbd', 'fe80::b0f9:b0ff:fe67:8049', 'fe80::fc16:3eff:fed4:3882', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fec0:43c2', 'fe80::8cb0:efff:fe8f:244a', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe47:f045'] 
May 27 23:01:47.218300 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:01:47.218451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:01:47.218707 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:47.218974 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Updating existing volume attachment record: 007c910e-6393-4002-99bd-7cda5ebf7dfb {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:01:47.337934 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-085f3095-965b-49fc-adf9-6fbdb563dce7 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.505s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:47.343414 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Took 1.61 seconds to deallocate network for instance.
May 27 23:01:47.540541 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:01:47.540938 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922907.5407274, 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:47.541061 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] VM Paused (Lifecycle Event)
May 27 23:01:47.564275 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Took 7.26 seconds to spawn the instance on the hypervisor.
May 27 23:01:47.566795 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:47.572504 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:47.573731 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lazy-loading 'flavor' on Instance uuid 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:47.602533 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] End _get_guest_xml xml=<domain type="qemu">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <uuid>efc3328c-5e17-4eb2-b8fb-e645a6805b0e</uuid>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <name>instance-0000000c</name>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1740959205</nova:name>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:01:47</nova:creationTime>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:user uuid="6037b0819a94463e8e45d96f834c4341">tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member</nova:user>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:project uuid="9818a7ed096346eb92128648c4280071">tempest-ServerBootFromVolumeStableRescueTest-800872693</nova:project>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         <nova:port uuid="434bf486-9c62-458f-b5d4-2be60504d9fd">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <system>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <entry name="serial">efc3328c-5e17-4eb2-b8fb-e645a6805b0e</entry>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <entry name="uuid">efc3328c-5e17-4eb2-b8fb-e645a6805b0e</entry>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     </system>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <os>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   </os>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <features>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   </features>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   <devices>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk.config"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:1a:5b:46"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <target dev="tap434bf486-9c"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     </interface>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/console.log" append="off"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     </serial>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <video>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     </video>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     </rng>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:   </devices>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]: </domain>
May 27 23:01:47.602533 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:01:47.604961 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Preparing to wait for external event network-vif-plugged-434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:01:47.605157 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:47.605416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:47.605542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:47.606182 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1740959205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-1740959205',id=12,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-qw9738qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:01:45Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=efc3328c-5e17-4eb2-b8fb-e645a6805b0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "434bf486-9c62-458f-b5d4-2be60504d9fd", "address": "fa:16:3e:1a:5b:46", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap434bf486-9c", "ovs_interfaceid": "434bf486-9c62-458f-b5d4-2be60504d9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:01:47.606423 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "434bf486-9c62-458f-b5d4-2be60504d9fd", "address": "fa:16:3e:1a:5b:46", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap434bf486-9c", "ovs_interfaceid": "434bf486-9c62-458f-b5d4-2be60504d9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:47.607003 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:46,bridge_name='br-int',has_traffic_filtering=True,id=434bf486-9c62-458f-b5d4-2be60504d9fd,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434bf486-9c') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:47.607243 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:46,bridge_name='br-int',has_traffic_filtering=True,id=434bf486-9c62-458f-b5d4-2be60504d9fd,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434bf486-9c') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:01:47.607569 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:47.607865 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:47.608124 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:01:47.609139 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:47.609139 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96687868-4cd3-5106-b4ce-17b2e0bbbb3c', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:47.609983 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:47.610788 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:47.611422 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:47.613618 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:47.613780 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap434bf486-9c, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:47.614165 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap434bf486-9c, col_values=(('qos', UUID('a76ce677-03d1-40fa-9057-705b1e667977')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:47.614414 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap434bf486-9c, col_values=(('external_ids', {'iface-id': '434bf486-9c62-458f-b5d4-2be60504d9fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:5b:46', 'vm-uuid': 'efc3328c-5e17-4eb2-b8fb-e645a6805b0e'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:47.616516 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:47.623890 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:47.624843 np0000001565 nova-compute[98289]: INFO os_vif [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:46,bridge_name='br-int',has_traffic_filtering=True,id=434bf486-9c62-458f-b5d4-2be60504d9fd,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434bf486-9c')
May 27 23:01:47.779314 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:01:47.779793 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:01:47.780039 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:47.780489 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:47.780748 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:01:47.792186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:47.792987 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:01:47.793696 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:47.793696 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:01:47.794079 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:01:47.794298 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:47.804393 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:47.804393 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:01:47.808064 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:01:47.808064 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:47.817827 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:47.821457 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:47.829990 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:01:47.837087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:47.837087 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:47.837087 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:47.837087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:47.837087 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:47.837087 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:47.837087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.043s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:47.837087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:47.837087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] HCTL ('15', '0', '0', 0) found on session 12 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:47.837087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:47.844669 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:47.844669 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:47.844669 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:01:47.844669 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:47.844669 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:01:47.844669 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:01:47.844879 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.051s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:47.845039 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:01:47.845480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Searching for a device in session 12 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:47.845687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:47.846118 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] HCTL ('14', '0', '0', 0) found on session 11 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:01:47.846233 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:01:47.855236 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Searching for a device in session 11 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:01:47.855431 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:01:47.856728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:47.856890 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:47.911552 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-78805ded-1449-4d39-b1f6-ff3e0a057953 req-4b858f03-e147-4eaa-afe9-a3b61dda9336 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:47.911722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-78805ded-1449-4d39-b1f6-ff3e0a057953 req-4b858f03-e147-4eaa-afe9-a3b61dda9336 service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:47.911866 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-78805ded-1449-4d39-b1f6-ff3e0a057953 req-4b858f03-e147-4eaa-afe9-a3b61dda9336 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:47.911978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-78805ded-1449-4d39-b1f6-ff3e0a057953 req-4b858f03-e147-4eaa-afe9-a3b61dda9336 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:47.913021 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-78805ded-1449-4d39-b1f6-ff3e0a057953 req-4b858f03-e147-4eaa-afe9-a3b61dda9336 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:47.913209 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-78805ded-1449-4d39-b1f6-ff3e0a057953 req-4b858f03-e147-4eaa-afe9-a3b61dda9336 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received unexpected event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with vm_state active and task_state None.
May 27 23:01:47.913306 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-78805ded-1449-4d39-b1f6-ff3e0a057953 req-4b858f03-e147-4eaa-afe9-a3b61dda9336 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Received event network-vif-deleted-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:47.913532 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-78805ded-1449-4d39-b1f6-ff3e0a057953 req-4b858f03-e147-4eaa-afe9-a3b61dda9336 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Neutron deleted interface c75229d6-c711-4185-80fd-07e0cc9702c0; detaching it from the instance and deleting it from the info cache
May 27 23:01:47.918656 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-78805ded-1449-4d39-b1f6-ff3e0a057953 req-4b858f03-e147-4eaa-afe9-a3b61dda9336 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Detach interface failed, port_id=c75229d6-c711-4185-80fd-07e0cc9702c0, reason: Instance 3438591d-5ed5-45ed-8875-256372fc8333 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:01:47.944124 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:48.000460 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:48.040203 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:48.046356 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:48.047999 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922908.0477238, 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:48.048289 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] VM Resumed (Lifecycle Event)
May 27 23:01:48.079442 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1581082659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1581082659',id=3,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbXJ25uvRq+YEKR1kzxedf9FvXb2eZ7io19cQ3tAnPpWU1tiaY+f+xttFfQpCrSUW1ryPIO60u8KO1pLzAlayI1KKlUoQpfHOPvHJtzvGfeubKnVhz74qMUmiGcKUUEGw==',key_name='tempest-keypair-853654392',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:42Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3864f7301d84dbdbbb57d5a3ff0d764',ramdisk_id='',reservation_id='r-2wuc69yq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-637545634',owner_user_name='tempest-TaggedAttachmentsTest-637545634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7581bdc53e7e463a8b5951ed443d106a',uuid=13686e4c-ae8e-4837-a71f-2d710575ab33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:01:48.080040 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converting VIF {"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:48.080458 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:48.081135 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Took 13.04 seconds to build instance.
May 27 23:01:48.082200 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:43:c2"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2627f66f-f8"/></interface> {{(pid=98289) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 23:01:48.083377 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:43:c2"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2627f66f-f8"/></interface> {{(pid=98289) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 23:01:48.086550 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Attempting to detach device tap2627f66f-f8 from instance 13686e4c-ae8e-4837-a71f-2d710575ab33 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:01:48.086550 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] detach device xml: <interface type="ethernet">
May 27 23:01:48.086550 np0000001565 nova-compute[98289]:   <mac address="fa:16:3e:c0:43:c2"/>
May 27 23:01:48.086550 np0000001565 nova-compute[98289]:   <model type="virtio"/>
May 27 23:01:48.086550 np0000001565 nova-compute[98289]:   <driver name="qemu"/>
May 27 23:01:48.086550 np0000001565 nova-compute[98289]:   <mtu size="1372"/>
May 27 23:01:48.086550 np0000001565 nova-compute[98289]:   <target dev="tap2627f66f-f8"/>
May 27 23:01:48.086550 np0000001565 nova-compute[98289]: </interface>
May 27 23:01:48.086550 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:48.091303 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:43:c2"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2627f66f-f8"/></interface> {{(pid=98289) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 23:01:48.094286 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c0:43:c2"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2627f66f-f8"/></interface>not found in domain: <domain type='qemu' id='3'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <name>instance-00000003</name>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <uuid>13686e4c-ae8e-4837-a71f-2d710575ab33</uuid>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <nova:package version="33.1.0"/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <nova:name>tempest-device-tagging-server-1581082659</nova:name>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <nova:creationTime>2026-05-27 23:01:29</nova:creationTime>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <nova:flavor name="m1.nano" id="42">
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:memory>192</nova:memory>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:disk>1</nova:disk>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:swap>0</nova:swap>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:vcpus>1</nova:vcpus>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:extraSpecs>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </nova:extraSpecs>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   </nova:flavor>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:minDisk>1</nova:minDisk>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:minRam>0</nova:minRam>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:properties>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </nova:properties>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   </nova:image>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <nova:owner>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:user uuid="7581bdc53e7e463a8b5951ed443d106a">tempest-TaggedAttachmentsTest-637545634-project-member</nova:user>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:project uuid="a3864f7301d84dbdbbb57d5a3ff0d764">tempest-TaggedAttachmentsTest-637545634</nova:project>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   </nova:owner>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <nova:ports>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:port uuid="7faf9be9-b21d-441b-9e09-9c236e1f9fb5">
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </nova:port>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <nova:port uuid="2627f66f-f8cf-4fcc-b9c3-a66c97b6111a">
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </nova:port>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   </nova:ports>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]: </nova:instance>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <memory unit='KiB'>196608</memory>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <currentMemory unit='KiB'>196608</currentMemory>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <vcpu placement='static'>1</vcpu>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <resource>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <partition>/machine</partition>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   </resource>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <sysinfo type='smbios'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <system>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <entry name='product'>OpenStack Nova</entry>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <entry name='version'>33.1.0</entry>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <entry name='serial'>13686e4c-ae8e-4837-a71f-2d710575ab33</entry>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <entry name='uuid'>13686e4c-ae8e-4837-a71f-2d710575ab33</entry>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <entry name='family'>Virtual Machine</entry>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </system>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <os>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <boot dev='hd'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <smbios mode='sysinfo'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   </os>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <features>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <vmcoreinfo state='on'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <tb-cache unit='KiB'>131072</tb-cache>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   </features>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <cpu mode='custom' match='exact' check='full'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <model fallback='forbid'>Nehalem</model>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <feature policy='require' name='hypervisor'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <clock offset='utc'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <on_poweroff>destroy</on_poweroff>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <on_reboot>restart</on_reboot>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <on_crash>destroy</on_crash>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:   <devices>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <disk type='file' device='disk'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <driver name='qemu' type='qcow2' cache='none'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <source file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk' index='2'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <backingStore type='file' index='3'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:         <format type='raw'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:         <source file='/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:         <backingStore/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       </backingStore>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <target dev='vda' bus='virtio'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <alias name='virtio-disk0'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <disk type='file' device='cdrom'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <driver name='qemu' type='raw' cache='none'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <source file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk.config' index='1'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <backingStore/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <target dev='hda' bus='ide'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <readonly/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <alias name='ide0-0-0'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <controller type='usb' index='0' model='none'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <alias name='usb'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <controller type='pci' index='0' model='pci-root'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <alias name='pci.0'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <controller type='ide' index='0'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <alias name='ide'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <interface type='ethernet'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <mac address='fa:16:3e:38:c5:3a'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <target dev='tap7faf9be9-b2'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <model type='virtio'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <driver name='qemu'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <mtu size='1372'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <alias name='net0'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </interface>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <interface type='ethernet'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <mac address='fa:16:3e:c0:43:c2'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <target dev='tap2627f66f-f8'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <model type='virtio'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <driver name='qemu'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <mtu size='1372'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <alias name='net1'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </interface>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <serial type='pty'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <source path='/dev/pts/2'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <log file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/console.log' append='off'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <target type='isa-serial' port='0'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:         <model name='isa-serial'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       </target>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <alias name='serial0'/>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     </serial>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:     <console type='pty' tty='/dev/pts/2'>
May 27 23:01:48.094286 np0000001565 nova-compute[98289]:       <source path='/dev/pts/2'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <log file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/console.log' append='off'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <target type='serial' port='0'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <alias name='serial0'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     </console>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     <input type='mouse' bus='ps2'>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <alias name='input0'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     </input>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     <input type='keyboard' bus='ps2'>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <alias name='input1'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     </input>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <listen type='address' address='0.0.0.0'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     </graphics>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     <audio id='1' type='none'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     <video>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <model type='virtio' heads='1' primary='yes'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <alias name='video0'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     </video>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <stats period='10'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <alias name='balloon0'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     <rng model='virtio'>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <backend model='random'>/dev/urandom</backend>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <alias name='rng0'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     </rng>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:   </devices>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     <label>libvirt-13686e4c-ae8e-4837-a71f-2d710575ab33</label>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     <imagelabel>libvirt-13686e4c-ae8e-4837-a71f-2d710575ab33</imagelabel>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:   </seclabel>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     <label>+64055:+993</label>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:     <imagelabel>+64055:+993</imagelabel>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:   </seclabel>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]: </domain>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:  {{(pid=98289) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 27 23:01:48.099456 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Successfully detached device tap2627f66f-f8 from instance 13686e4c-ae8e-4837-a71f-2d710575ab33 from the persistent domain config.
May 27 23:01:48.099456 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] (1/8): Attempting to detach device tap2627f66f-f8 with device alias net1 from instance 13686e4c-ae8e-4837-a71f-2d710575ab33 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:01:48.099456 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] detach device xml: <interface type="ethernet">
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:   <mac address="fa:16:3e:c0:43:c2"/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:   <model type="virtio"/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:   <driver name="qemu"/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:   <mtu size="1372"/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:   <target dev="tap2627f66f-f8"/>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]: </interface>
May 27 23:01:48.099456 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:48.145772 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Updated VIF entry in instance network info cache for port 434bf486-9c62-458f-b5d4-2be60504d9fd. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:01:48.147740 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Updating instance_info_cache with network_info: [{"id": "434bf486-9c62-458f-b5d4-2be60504d9fd", "address": "fa:16:3e:1a:5b:46", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap434bf486-9c", "ovs_interfaceid": "434bf486-9c62-458f-b5d4-2be60504d9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:48.448972 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:01:48.449116 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:01:48.502487 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Took 1.65 seconds to deallocate network for instance.
May 27 23:01:48.551228 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:48.553478 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:48.588028 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b0ba01d-ca2f-4ab5-9bb8-ccb5c6d1b3ab tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.557s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Releasing lock "refresh_cache-efc3328c-5e17-4eb2-b8fb-e645a6805b0e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Received event network-vif-unplugged-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Acquiring lock "3438591d-5ed5-45ed-8875-256372fc8333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] No waiting events found dispatching network-vif-unplugged-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Received event network-vif-unplugged-c75229d6-c711-4185-80fd-07e0cc9702c0 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Received event network-vif-unplugged-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Acquiring lock "3438591d-5ed5-45ed-8875-256372fc8333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] Lock "3438591d-5ed5-45ed-8875-256372fc8333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] No waiting events found dispatching network-vif-unplugged-c75229d6-c711-4185-80fd-07e0cc9702c0 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Received event network-vif-unplugged-c75229d6-c711-4185-80fd-07e0cc9702c0 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:01:48.653011 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Received event network-vif-deleted-3d3cda67-acda-4008-ad58-dc64f4eb2c8b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:48.653495 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Neutron deleted interface 3d3cda67-acda-4008-ad58-dc64f4eb2c8b; detaching it from the instance and deleting it from the info cache
May 27 23:01:48.654264 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf6acaee-dd37-40f7-8d38-ec5962ee316b req-561cba29-ea92-4e66-b3a7-6f7d54184053 service nova] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Detach interface failed, port_id=3d3cda67-acda-4008-ad58-dc64f4eb2c8b, reason: Instance a0070282-e138-405c-b6c8-3478991d03f6 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:01:48.794222 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:01:48.951882 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:01:49.010155 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:49.080177 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:49.083242 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:49.093769 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779922909.0934014, 13686e4c-ae8e-4837-a71f-2d710575ab33 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:01:49.094505 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Start waiting for the detach event from libvirt for device tap2627f66f-f8 with device alias net1 for instance 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:01:49.094956 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:43:c2"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2627f66f-f8"/></interface> {{(pid=98289) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 23:01:49.098165 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c0:43:c2"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2627f66f-f8"/></interface>not found in domain: <domain type='qemu' id='3'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <name>instance-00000003</name>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <uuid>13686e4c-ae8e-4837-a71f-2d710575ab33</uuid>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <nova:package version="33.1.0"/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <nova:name>tempest-device-tagging-server-1581082659</nova:name>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <nova:creationTime>2026-05-27 23:01:29</nova:creationTime>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <nova:flavor name="m1.nano" id="42">
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:memory>192</nova:memory>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:disk>1</nova:disk>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:swap>0</nova:swap>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:vcpus>1</nova:vcpus>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:extraSpecs>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </nova:extraSpecs>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   </nova:flavor>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:minDisk>1</nova:minDisk>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:minRam>0</nova:minRam>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:properties>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </nova:properties>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   </nova:image>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <nova:owner>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:user uuid="7581bdc53e7e463a8b5951ed443d106a">tempest-TaggedAttachmentsTest-637545634-project-member</nova:user>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:project uuid="a3864f7301d84dbdbbb57d5a3ff0d764">tempest-TaggedAttachmentsTest-637545634</nova:project>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   </nova:owner>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <nova:ports>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:port uuid="7faf9be9-b21d-441b-9e09-9c236e1f9fb5">
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </nova:port>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <nova:port uuid="2627f66f-f8cf-4fcc-b9c3-a66c97b6111a">
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </nova:port>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   </nova:ports>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]: </nova:instance>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <memory unit='KiB'>196608</memory>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <currentMemory unit='KiB'>196608</currentMemory>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <vcpu placement='static'>1</vcpu>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <resource>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <partition>/machine</partition>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   </resource>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <sysinfo type='smbios'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <system>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <entry name='product'>OpenStack Nova</entry>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <entry name='version'>33.1.0</entry>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <entry name='serial'>13686e4c-ae8e-4837-a71f-2d710575ab33</entry>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <entry name='uuid'>13686e4c-ae8e-4837-a71f-2d710575ab33</entry>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <entry name='family'>Virtual Machine</entry>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </system>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <os>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <boot dev='hd'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <smbios mode='sysinfo'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   </os>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <features>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <vmcoreinfo state='on'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <tb-cache unit='KiB'>131072</tb-cache>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   </features>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <cpu mode='custom' match='exact' check='full'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <model fallback='forbid'>Nehalem</model>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <feature policy='require' name='hypervisor'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <clock offset='utc'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <on_poweroff>destroy</on_poweroff>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <on_reboot>restart</on_reboot>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <on_crash>destroy</on_crash>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:   <devices>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <disk type='file' device='disk'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <driver name='qemu' type='qcow2' cache='none'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <source file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk' index='2'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <backingStore type='file' index='3'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:         <format type='raw'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:         <source file='/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:         <backingStore/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       </backingStore>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <target dev='vda' bus='virtio'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <alias name='virtio-disk0'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <disk type='file' device='cdrom'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <driver name='qemu' type='raw' cache='none'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <source file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk.config' index='1'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <backingStore/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <target dev='hda' bus='ide'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <readonly/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <alias name='ide0-0-0'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <controller type='usb' index='0' model='none'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <alias name='usb'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <controller type='pci' index='0' model='pci-root'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <alias name='pci.0'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <controller type='ide' index='0'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <alias name='ide'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <interface type='ethernet'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <mac address='fa:16:3e:38:c5:3a'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <target dev='tap7faf9be9-b2'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <model type='virtio'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <driver name='qemu'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <mtu size='1372'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <alias name='net0'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </interface>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <serial type='pty'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <source path='/dev/pts/2'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <log file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/console.log' append='off'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <target type='isa-serial' port='0'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:         <model name='isa-serial'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       </target>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <alias name='serial0'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </serial>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <console type='pty' tty='/dev/pts/2'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <source path='/dev/pts/2'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <log file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/console.log' append='off'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <target type='serial' port='0'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <alias name='serial0'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </console>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <input type='mouse' bus='ps2'>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:       <alias name='input0'/>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     </input>
May 27 23:01:49.098165 np0000001565 nova-compute[98289]:     <input type='keyboard' bus='ps2'>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:       <alias name='input1'/>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     </input>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:       <listen type='address' address='0.0.0.0'/>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     </graphics>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     <audio id='1' type='none'/>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     <video>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:       <model type='virtio' heads='1' primary='yes'/>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:       <alias name='video0'/>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     </video>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:       <stats period='10'/>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:       <alias name='balloon0'/>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     <rng model='virtio'>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:       <backend model='random'>/dev/urandom</backend>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:       <alias name='rng0'/>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     </rng>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:   </devices>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     <label>libvirt-13686e4c-ae8e-4837-a71f-2d710575ab33</label>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     <imagelabel>libvirt-13686e4c-ae8e-4837-a71f-2d710575ab33</imagelabel>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:   </seclabel>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     <label>+64055:+993</label>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:     <imagelabel>+64055:+993</imagelabel>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:   </seclabel>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]: </domain>
May 27 23:01:49.102733 np0000001565 nova-compute[98289]:  {{(pid=98289) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 27 23:01:49.102733 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Successfully detached device tap2627f66f-f8 from instance 13686e4c-ae8e-4837-a71f-2d710575ab33 from the live domain config.
May 27 23:01:49.102733 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1581082659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1581082659',id=3,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbXJ25uvRq+YEKR1kzxedf9FvXb2eZ7io19cQ3tAnPpWU1tiaY+f+xttFfQpCrSUW1ryPIO60u8KO1pLzAlayI1KKlUoQpfHOPvHJtzvGfeubKnVhz74qMUmiGcKUUEGw==',key_name='tempest-keypair-853654392',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:42Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3864f7301d84dbdbbb57d5a3ff0d764',ramdisk_id='',reservation_id='r-2wuc69yq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-637545634',owner_user_name='tempest-TaggedAttachmentsTest-637545634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7581bdc53e7e463a8b5951ed443d106a',uuid=13686e4c-ae8e-4837-a71f-2d710575ab33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:01:49.103731 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converting VIF {"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:49.103731 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:49.103731 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:01:49.106714 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:49.107637 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2627f66f-f8, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:49.108679 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:49.112045 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:49.114989 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:49.116504 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:49.116687 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80d9e705-e72c-484e-bddc-af110abb0ace) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:49.117178 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:49.117709 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:49.138035 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:49.138941 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:49.140727 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:49.140923 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:49.140996 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No VIF found with MAC fa:16:3e:1a:5b:46, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:49.141492 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Using config drive
May 27 23:01:49.144257 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:49.154680 np0000001565 nova-compute[98289]: INFO os_vif [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8')
May 27 23:01:49.157859 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1581082659', uuid='13686e4c-ae8e-4837-a71f-2d710575ab33'), owner=OwnerMeta(userid='7581bdc53e7e463a8b5951ed443d106a', username='tempest-TaggedAttachmentsTest-637545634-project-member', projectid='a3864f7301d84dbdbbb57d5a3ff0d764', projectname='tempest-TaggedAttachmentsTest-637545634'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922909.157453) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:01:49.158859 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   <nova:package version="33.1.0"/>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   <nova:name>tempest-device-tagging-server-1581082659</nova:name>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   <nova:creationTime>2026-05-27 23:01:49</nova:creationTime>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   <nova:flavor name="m1.nano" id="42">
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:memory>192</nova:memory>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:disk>1</nova:disk>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:swap>0</nova:swap>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:vcpus>1</nova:vcpus>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:extraSpecs>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     </nova:extraSpecs>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   </nova:flavor>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:minDisk>1</nova:minDisk>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:minRam>0</nova:minRam>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:properties>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     </nova:properties>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   </nova:image>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   <nova:owner>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:user uuid="7581bdc53e7e463a8b5951ed443d106a">tempest-TaggedAttachmentsTest-637545634-project-member</nova:user>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:project uuid="a3864f7301d84dbdbbb57d5a3ff0d764">tempest-TaggedAttachmentsTest-637545634</nova:project>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   </nova:owner>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   <nova:ports>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     <nova:port uuid="7faf9be9-b21d-441b-9e09-9c236e1f9fb5">
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:       <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:     </nova:port>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:   </nova:ports>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]: </nova:instance>
May 27 23:01:49.158859 np0000001565 nova-compute[98289]:  {{(pid=98289) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 27 23:01:49.164931 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:49.164931 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:49.297353 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cd9b127b-ade5-49d7-94cd-a7f9b95b9389 req-5b95aa6b-b8b8-4bbb-be46-89bb5b722293 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-vif-unplugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:49.297353 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cd9b127b-ade5-49d7-94cd-a7f9b95b9389 req-5b95aa6b-b8b8-4bbb-be46-89bb5b722293 service nova] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:49.297353 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cd9b127b-ade5-49d7-94cd-a7f9b95b9389 req-5b95aa6b-b8b8-4bbb-be46-89bb5b722293 service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:49.297353 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cd9b127b-ade5-49d7-94cd-a7f9b95b9389 req-5b95aa6b-b8b8-4bbb-be46-89bb5b722293 service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:49.297353 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cd9b127b-ade5-49d7-94cd-a7f9b95b9389 req-5b95aa6b-b8b8-4bbb-be46-89bb5b722293 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] No waiting events found dispatching network-vif-unplugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:49.297353 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-cd9b127b-ade5-49d7-94cd-a7f9b95b9389 req-5b95aa6b-b8b8-4bbb-be46-89bb5b722293 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received unexpected event network-vif-unplugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a for instance with vm_state active and task_state None.
May 27 23:01:49.462215 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.603s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:49.463790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.451s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:49.531029 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Deleted allocations for instance a0070282-e138-405c-b6c8-3478991d03f6
May 27 23:01:49.611411 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-vif-deleted-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:49.611966 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Neutron deleted interface 2627f66f-f8cf-4fcc-b9c3-a66c97b6111a; detaching it from the instance and deleting it from the info cache
May 27 23:01:49.613527 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] Lazy-loading 'system_metadata' on Instance uuid 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:49.646002 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:49.792070 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Creating config drive at /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk.config
May 27 23:01:49.795682 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmnhlfydt {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:49.811111 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Found WWN 3300000004d095082 for multipath device dm-3 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:01:49.812448 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.032s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:01:49.812642 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] <== connect_volume: return (2032ms) {'type': 'block', 'scsi_wwn': '3300000004d095082', 'path': '/dev/dm-3', 'multipath_id': '3300000004d095082'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:01:49.812882 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004d095082', 'path': '/dev/dm-3', 'multipath_id': '3300000004d095082'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:01:49.817072 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lazy-loading 'flavor' on Instance uuid f31ea991-4cf8-43e7-9d65-cfb193c3413a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:49.844039 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmnhlfydt" returned: 0 in 0.048s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:49.928636 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:01:49.928937 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:01:49.980485 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-038ac898-aaee-4d17-bf27-fd49ab031889 req-dc6495e8-eceb-4d00-af23-2555b623cb86 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-changed-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:49.980691 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-038ac898-aaee-4d17-bf27-fd49ab031889 req-dc6495e8-eceb-4d00-af23-2555b623cb86 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Refreshing instance network info cache due to event network-changed-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:01:49.980872 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-038ac898-aaee-4d17-bf27-fd49ab031889 req-dc6495e8-eceb-4d00-af23-2555b623cb86 service nova] Acquiring lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:49.980966 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-038ac898-aaee-4d17-bf27-fd49ab031889 req-dc6495e8-eceb-4d00-af23-2555b623cb86 service nova] Acquired lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:49.981097 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-038ac898-aaee-4d17-bf27-fd49ab031889 req-dc6495e8-eceb-4d00-af23-2555b623cb86 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Refreshing network info cache for port d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:01:50.116171 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] Lazy-loading 'flavor' on Instance uuid 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:50.271282 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:50.285988 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:01:50.286279 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:01:50.286440 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:01:50.286593 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:01:50.286752 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:01:50.286924 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:01:50.287078 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:01:50.287428 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:01:50.287535 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:01:50.287692 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:01:50.294981 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:50.300182 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:50.321908 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Attempting to attach volume ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:01:50.322926 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:01:50.322926 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:50.322926 np0000001565 nova-compute[98289]:   <alias name="ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f"/>
May 27 23:01:50.322926 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:01:50.322926 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:50.322926 np0000001565 nova-compute[98289]:   <serial>ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f</serial>
May 27 23:01:50.322926 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:01:50.322926 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:50.322926 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:01:50.388417 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:50.432537 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:01:50.484259 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-038ac898-aaee-4d17-bf27-fd49ab031889 req-dc6495e8-eceb-4d00-af23-2555b623cb86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:50.541069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-573bd1b4-3be6-4243-9046-74dd178f0de4 tempest-AttachSCSIVolumeTestJSON-1209336345 tempest-AttachSCSIVolumeTestJSON-1209336345-project-member] Lock "a0070282-e138-405c-b6c8-3478991d03f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.727s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:50.619483 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] Object Instance<13686e4c-ae8e-4837-a71f-2d710575ab33> lazy-loaded attributes: system_metadata,flavor {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:01:50.620221 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1581082659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1581082659',id=3,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbXJ25uvRq+YEKR1kzxedf9FvXb2eZ7io19cQ3tAnPpWU1tiaY+f+xttFfQpCrSUW1ryPIO60u8KO1pLzAlayI1KKlUoQpfHOPvHJtzvGfeubKnVhz74qMUmiGcKUUEGw==',key_name='tempest-keypair-853654392',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:42Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001565',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3864f7301d84dbdbbb57d5a3ff0d764',ramdisk_id='',reservation_id='r-2wuc69yq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-637545634',owner_user_name='tempest-TaggedAttachmentsTest-637545634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7581bdc53e7e463a8b5951ed443d106a',uuid=13686e4c-ae8e-4837-a71f-2d710575ab33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:01:50.621299 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] Converting VIF {"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:50.621299 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:50.625604 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:43:c2"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2627f66f-f8"/></interface> {{(pid=98289) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 23:01:50.630137 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c0:43:c2"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2627f66f-f8"/></interface>not found in domain: <domain type='qemu' id='3'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <name>instance-00000003</name>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <uuid>13686e4c-ae8e-4837-a71f-2d710575ab33</uuid>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <nova:package version="33.1.0"/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <nova:name>tempest-device-tagging-server-1581082659</nova:name>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <nova:creationTime>2026-05-27 23:01:49</nova:creationTime>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <nova:flavor name="m1.nano" id="42">
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:memory>192</nova:memory>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:disk>1</nova:disk>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:swap>0</nova:swap>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:vcpus>1</nova:vcpus>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:extraSpecs>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </nova:extraSpecs>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   </nova:flavor>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:minDisk>1</nova:minDisk>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:minRam>0</nova:minRam>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:properties>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </nova:properties>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   </nova:image>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <nova:owner>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:user uuid="7581bdc53e7e463a8b5951ed443d106a">tempest-TaggedAttachmentsTest-637545634-project-member</nova:user>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:project uuid="a3864f7301d84dbdbbb57d5a3ff0d764">tempest-TaggedAttachmentsTest-637545634</nova:project>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   </nova:owner>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <nova:ports>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <nova:port uuid="7faf9be9-b21d-441b-9e09-9c236e1f9fb5">
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </nova:port>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   </nova:ports>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]: </nova:instance>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <memory unit='KiB'>196608</memory>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <currentMemory unit='KiB'>196608</currentMemory>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <vcpu placement='static'>1</vcpu>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <resource>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <partition>/machine</partition>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   </resource>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <sysinfo type='smbios'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <system>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <entry name='product'>OpenStack Nova</entry>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <entry name='version'>33.1.0</entry>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <entry name='serial'>13686e4c-ae8e-4837-a71f-2d710575ab33</entry>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <entry name='uuid'>13686e4c-ae8e-4837-a71f-2d710575ab33</entry>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <entry name='family'>Virtual Machine</entry>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </system>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <os>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <boot dev='hd'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <smbios mode='sysinfo'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   </os>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <features>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <vmcoreinfo state='on'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <tb-cache unit='KiB'>131072</tb-cache>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   </features>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <cpu mode='custom' match='exact' check='full'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <model fallback='forbid'>Nehalem</model>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <feature policy='require' name='hypervisor'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <clock offset='utc'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <on_poweroff>destroy</on_poweroff>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <on_reboot>restart</on_reboot>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <on_crash>destroy</on_crash>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:   <devices>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <disk type='file' device='disk'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <driver name='qemu' type='qcow2' cache='none'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <source file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk' index='2'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <backingStore type='file' index='3'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:         <format type='raw'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:         <source file='/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:         <backingStore/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       </backingStore>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <target dev='vda' bus='virtio'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <alias name='virtio-disk0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <disk type='file' device='cdrom'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <driver name='qemu' type='raw' cache='none'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <source file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk.config' index='1'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <backingStore/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <target dev='hda' bus='ide'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <readonly/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <alias name='ide0-0-0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <controller type='usb' index='0' model='none'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <alias name='usb'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <controller type='pci' index='0' model='pci-root'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <alias name='pci.0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <controller type='ide' index='0'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <alias name='ide'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <interface type='ethernet'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <mac address='fa:16:3e:38:c5:3a'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <target dev='tap7faf9be9-b2'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <model type='virtio'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <driver name='qemu'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <mtu size='1372'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <alias name='net0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </interface>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <serial type='pty'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <source path='/dev/pts/2'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <log file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/console.log' append='off'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <target type='isa-serial' port='0'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:         <model name='isa-serial'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       </target>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <alias name='serial0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </serial>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <console type='pty' tty='/dev/pts/2'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <source path='/dev/pts/2'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <log file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/console.log' append='off'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <target type='serial' port='0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <alias name='serial0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </console>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <input type='mouse' bus='ps2'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <alias name='input0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </input>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <input type='keyboard' bus='ps2'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <alias name='input1'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </input>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:       <listen type='address' address='0.0.0.0'/>
May 27 23:01:50.630137 np0000001565 nova-compute[98289]:     </graphics>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:     <audio id='1' type='none'/>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:     <video>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:       <model type='virtio' heads='1' primary='yes'/>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:       <alias name='video0'/>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:     </video>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:       <stats period='10'/>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:       <alias name='balloon0'/>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:     <rng model='virtio'>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:       <backend model='random'>/dev/urandom</backend>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:       <alias name='rng0'/>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:     </rng>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:   </devices>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:     <label>libvirt-13686e4c-ae8e-4837-a71f-2d710575ab33</label>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:     <imagelabel>libvirt-13686e4c-ae8e-4837-a71f-2d710575ab33</imagelabel>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:   </seclabel>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:     <label>+64055:+993</label>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:     <imagelabel>+64055:+993</imagelabel>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:   </seclabel>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]: </domain>
May 27 23:01:50.632595 np0000001565 nova-compute[98289]:  {{(pid=98289) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 27 23:01:50.632595 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:43:c2"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2627f66f-f8"/></interface> {{(pid=98289) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 23:01:50.639897 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:50.644450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c0:43:c2"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap2627f66f-f8"/></interface>not found in domain: <domain type='qemu' id='3'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <name>instance-00000003</name>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <uuid>13686e4c-ae8e-4837-a71f-2d710575ab33</uuid>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <nova:package version="33.1.0"/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <nova:name>tempest-device-tagging-server-1581082659</nova:name>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <nova:creationTime>2026-05-27 23:01:49</nova:creationTime>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <nova:flavor name="m1.nano" id="42">
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:memory>192</nova:memory>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:disk>1</nova:disk>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:swap>0</nova:swap>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:vcpus>1</nova:vcpus>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:extraSpecs>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </nova:extraSpecs>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   </nova:flavor>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:minDisk>1</nova:minDisk>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:minRam>0</nova:minRam>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:properties>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </nova:properties>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   </nova:image>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <nova:owner>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:user uuid="7581bdc53e7e463a8b5951ed443d106a">tempest-TaggedAttachmentsTest-637545634-project-member</nova:user>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:project uuid="a3864f7301d84dbdbbb57d5a3ff0d764">tempest-TaggedAttachmentsTest-637545634</nova:project>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   </nova:owner>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <nova:ports>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <nova:port uuid="7faf9be9-b21d-441b-9e09-9c236e1f9fb5">
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </nova:port>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   </nova:ports>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]: </nova:instance>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <memory unit='KiB'>196608</memory>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <currentMemory unit='KiB'>196608</currentMemory>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <vcpu placement='static'>1</vcpu>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <resource>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <partition>/machine</partition>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   </resource>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <sysinfo type='smbios'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <system>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <entry name='product'>OpenStack Nova</entry>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <entry name='version'>33.1.0</entry>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <entry name='serial'>13686e4c-ae8e-4837-a71f-2d710575ab33</entry>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <entry name='uuid'>13686e4c-ae8e-4837-a71f-2d710575ab33</entry>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <entry name='family'>Virtual Machine</entry>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </system>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <os>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <boot dev='hd'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <smbios mode='sysinfo'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   </os>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <features>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <vmcoreinfo state='on'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <tb-cache unit='KiB'>131072</tb-cache>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   </features>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <cpu mode='custom' match='exact' check='full'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <model fallback='forbid'>Nehalem</model>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <feature policy='require' name='hypervisor'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <clock offset='utc'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <on_poweroff>destroy</on_poweroff>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <on_reboot>restart</on_reboot>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <on_crash>destroy</on_crash>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:   <devices>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <disk type='file' device='disk'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <driver name='qemu' type='qcow2' cache='none'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <source file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk' index='2'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <backingStore type='file' index='3'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:         <format type='raw'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:         <source file='/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:         <backingStore/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       </backingStore>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <target dev='vda' bus='virtio'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <alias name='virtio-disk0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <disk type='file' device='cdrom'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <driver name='qemu' type='raw' cache='none'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <source file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk.config' index='1'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <backingStore/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <target dev='hda' bus='ide'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <readonly/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <alias name='ide0-0-0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </disk>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <controller type='usb' index='0' model='none'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <alias name='usb'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <controller type='pci' index='0' model='pci-root'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <alias name='pci.0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <controller type='ide' index='0'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <alias name='ide'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </controller>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <interface type='ethernet'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <mac address='fa:16:3e:38:c5:3a'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <target dev='tap7faf9be9-b2'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <model type='virtio'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <driver name='qemu'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <mtu size='1372'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <alias name='net0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </interface>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <serial type='pty'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <source path='/dev/pts/2'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <log file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/console.log' append='off'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <target type='isa-serial' port='0'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:         <model name='isa-serial'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       </target>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <alias name='serial0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </serial>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <console type='pty' tty='/dev/pts/2'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <source path='/dev/pts/2'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <log file='/opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/console.log' append='off'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <target type='serial' port='0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <alias name='serial0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </console>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <input type='mouse' bus='ps2'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <alias name='input0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </input>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <input type='keyboard' bus='ps2'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <alias name='input1'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </input>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:       <listen type='address' address='0.0.0.0'/>
May 27 23:01:50.644450 np0000001565 nova-compute[98289]:     </graphics>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:     <audio id='1' type='none'/>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:     <video>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:       <model type='virtio' heads='1' primary='yes'/>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:       <alias name='video0'/>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:     </video>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:       <stats period='10'/>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:       <alias name='balloon0'/>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:     <rng model='virtio'>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:       <backend model='random'>/dev/urandom</backend>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:       <alias name='rng0'/>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:     </rng>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:   </devices>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:     <label>libvirt-13686e4c-ae8e-4837-a71f-2d710575ab33</label>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:     <imagelabel>libvirt-13686e4c-ae8e-4837-a71f-2d710575ab33</imagelabel>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:   </seclabel>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:     <label>+64055:+993</label>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:     <imagelabel>+64055:+993</imagelabel>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:   </seclabel>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]: </domain>
May 27 23:01:50.646801 np0000001565 nova-compute[98289]:  {{(pid=98289) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 27 23:01:50.646801 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Detaching interface fa:16:3e:c0:43:c2 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2627f66f-f8' not found.
May 27 23:01:50.646801 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1581082659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1581082659',id=3,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbXJ25uvRq+YEKR1kzxedf9FvXb2eZ7io19cQ3tAnPpWU1tiaY+f+xttFfQpCrSUW1ryPIO60u8KO1pLzAlayI1KKlUoQpfHOPvHJtzvGfeubKnVhz74qMUmiGcKUUEGw==',key_name='tempest-keypair-853654392',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:42Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001565',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3864f7301d84dbdbbb57d5a3ff0d764',ramdisk_id='',reservation_id='r-2wuc69yq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-637545634',owner_user_name='tempest-TaggedAttachmentsTest-637545634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7581bdc53e7e463a8b5951ed443d106a',uuid=13686e4c-ae8e-4837-a71f-2d710575ab33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:01:50.647424 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] Converting VIF {"id": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "address": "fa:16:3e:c0:43:c2", "network": {"id": "118f7628-4e5f-4311-8dab-2058676045c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-945481186", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2627f66f-f8", "ovs_interfaceid": "2627f66f-f8cf-4fcc-b9c3-a66c97b6111a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:50.647424 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:50.647424 np0000001565 nova-compute[98289]: DEBUG os_vif [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:01:50.649756 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:50.649844 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:50.652683 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2627f66f-f8, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:50.652683 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:01:50.654991 np0000001565 nova-compute[98289]: INFO os_vif [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:43:c2,bridge_name='br-int',has_traffic_filtering=True,id=2627f66f-f8cf-4fcc-b9c3-a66c97b6111a,network=Network(118f7628-4e5f-4311-8dab-2058676045c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2627f66f-f8')
May 27 23:01:50.655909 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1581082659', uuid='13686e4c-ae8e-4837-a71f-2d710575ab33'), owner=OwnerMeta(userid='7581bdc53e7e463a8b5951ed443d106a', username='tempest-TaggedAttachmentsTest-637545634-project-member', projectid='a3864f7301d84dbdbbb57d5a3ff0d764', projectname='tempest-TaggedAttachmentsTest-637545634'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922910.6555555) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:01:50.656490 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   <nova:package version="33.1.0"/>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   <nova:name>tempest-device-tagging-server-1581082659</nova:name>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   <nova:creationTime>2026-05-27 23:01:50</nova:creationTime>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   <nova:flavor name="m1.nano" id="42">
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:memory>192</nova:memory>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:disk>1</nova:disk>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:swap>0</nova:swap>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:ephemeral>0</nova:ephemeral>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:vcpus>1</nova:vcpus>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:extraSpecs>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     </nova:extraSpecs>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   </nova:flavor>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:minDisk>1</nova:minDisk>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:minRam>0</nova:minRam>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:properties>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     </nova:properties>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   </nova:image>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   <nova:owner>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:user uuid="7581bdc53e7e463a8b5951ed443d106a">tempest-TaggedAttachmentsTest-637545634-project-member</nova:user>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:project uuid="a3864f7301d84dbdbbb57d5a3ff0d764">tempest-TaggedAttachmentsTest-637545634</nova:project>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   </nova:owner>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   <nova:ports>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     <nova:port uuid="7faf9be9-b21d-441b-9e09-9c236e1f9fb5">
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:       <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:     </nova:port>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:   </nova:ports>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]: </nova:instance>
May 27 23:01:50.656490 np0000001565 nova-compute[98289]:  {{(pid=98289) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 27 23:01:50.665290 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3b8a9cb9-0562-4ff1-a6e0-ddc65f6c64e6 req-02890148-ff7c-4db9-a536-3df2afa31d08 service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Updating instance_info_cache with network_info: [{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:50.675605 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:50.796420 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:50.941122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.480s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:50.942584 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.146s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:50.943479 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:50.943613 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:01:50.968951 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-038ac898-aaee-4d17-bf27-fd49ab031889 req-dc6495e8-eceb-4d00-af23-2555b623cb86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:51.013671 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Deleted allocations for instance 3438591d-5ed5-45ed-8875-256372fc8333
May 27 23:01:51.057274 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:01:51.057415 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquired lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:01:51.057536 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:01:51.213125 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-038ac898-aaee-4d17-bf27-fd49ab031889 req-dc6495e8-eceb-4d00-af23-2555b623cb86 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updated VIF entry in instance network info cache for port d1c554f6-4c5e-4c94-b8dd-469ba0a41da8. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:01:51.213339 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-038ac898-aaee-4d17-bf27-fd49ab031889 req-dc6495e8-eceb-4d00-af23-2555b623cb86 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updating instance_info_cache with network_info: [{"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:51.347663 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-vif-unplugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:51.347886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:51.348062 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:51.348228 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:51.348379 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] No waiting events found dispatching network-vif-unplugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:51.348539 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received unexpected event network-vif-unplugged-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a for instance with vm_state active and task_state None.
May 27 23:01:51.348671 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Received event network-vif-plugged-434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:51.348830 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] Acquiring lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:51.349004 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:51.349174 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:51.349284 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Processing event network-vif-plugged-434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:01:51.349630 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Received event network-vif-plugged-434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:51.349777 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] Acquiring lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:51.351400 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:51.352589 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:51.352589 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] No waiting events found dispatching network-vif-plugged-434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:01:51.352589 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e15921e0-d830-4770-8c30-e3cab43ca4b7 req-d684f5f9-3fb8-4acb-908d-e7991fc22d6b service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Received unexpected event network-vif-plugged-434bf486-9c62-458f-b5d4-2be60504d9fd for instance with vm_state building and task_state spawning.
May 27 23:01:51.357002 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922911.3568068, efc3328c-5e17-4eb2-b8fb-e645a6805b0e => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:51.357445 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] VM Started (Lifecycle Event)
May 27 23:01:51.358686 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:01:51.361848 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:01:51.363852 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Instance spawned successfully.
May 27 23:01:51.364132 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:01:51.560270 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:51.715099 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-038ac898-aaee-4d17-bf27-fd49ab031889 req-dc6495e8-eceb-4d00-af23-2555b623cb86 service nova] Releasing lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:51.861751 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:51.863975 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:51.871571 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:51.871791 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:51.872261 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:51.872797 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:51.873157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:51.873684 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:01:51.988094 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:51.996675 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:52.034239 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b0f08183-fa5c-46c9-929a-9ae151c07715 tempest-VolumesAssistedSnapshotsTest-1424615901 tempest-VolumesAssistedSnapshotsTest-1424615901-project-member] Lock "3438591d-5ed5-45ed-8875-256372fc8333" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.113s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:52.069431 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:52.069648 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:52.069648 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:01:52.069870 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] No VIF found with MAC fa:16:3e:cb:db:bd, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:01:52.101937 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:52.102690 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:52.184849 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Updating instance_info_cache with network_info: [{"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:52.201134 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:52.204346 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:01:52.213093 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:52.324978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:52.328355 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:52.370823 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:01:52.371282 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922912.371026, efc3328c-5e17-4eb2-b8fb-e645a6805b0e => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:52.371421 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] VM Paused (Lifecycle Event)
May 27 23:01:52.387141 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Took 6.53 seconds to spawn the instance on the hypervisor.
May 27 23:01:52.387771 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:52.405018 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:52.411465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:52.510117 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json" returned: 0 in 0.100s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:52.511041 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:52.590770 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:52.593184 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:52.679454 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:52.680036 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:52.692720 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Releasing lock "refresh_cache-13686e4c-ae8e-4837-a71f-2d710575ab33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:01:52.767230 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:52.769894 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:52.849654 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:52.850635 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:52.876802 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:52.879615 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922912.8792906, efc3328c-5e17-4eb2-b8fb-e645a6805b0e => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:52.880214 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] VM Resumed (Lifecycle Event)
May 27 23:01:52.904378 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Took 12.22 seconds to build instance.
May 27 23:01:52.921111 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0024015569999846775 future=<Future at 0x726e6056bd70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:52.921250 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:52.921323 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.74998742899993 future=<Future at 0x726e587545c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:52.921463 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.7498672120000265 future=<Future at 0x726e587545c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:52.921896 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Emitting event <LifecycleEvent: 1779922897.9185977, 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:52.922115 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] VM Stopped (Lifecycle Event)
May 27 23:01:52.940669 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:52.941033 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:01:52.947197 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:53.022929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:53.023633 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:53.046409 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:53.121288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:53.122579 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:53.205958 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-76f8087f-1498-439f-8aaf-3aad3394177d tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "interface-13686e4c-ae8e-4837-a71f-2d710575ab33-2627f66f-f8cf-4fcc-b9c3-a66c97b6111a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.136s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:53.210269 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:53.210269 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:53.270386 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:53.296357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:53.299703 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:53.384954 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:53.394530 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:01:53.405478 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:53.405478 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:53.419467 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.743s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:53.429821 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e5dd3f9e-acfd-49ff-b56b-c310c0af5e06 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 1f83c76b-a3b1-46a9-a2c0-15ac7cb2d90a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:53.493629 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:53.512808 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:53.515686 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:01:53.518416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:53.551622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.034s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:53.552057 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=12671MB free_disk=74.56781005859375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:01:53.552292 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:53.552690 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:53.670124 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3171f925-3815-4289-ad79-96a6e6b7d033 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.638s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:54.118616 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:54.582447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:54.582693 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:54.633395 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 119d02f0-0974-4fa4-9d6a-ecfefe01e029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:01:54.633575 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 489adb12-811c-408c-af3f-24edcfc9d4bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:01:54.639628 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 13686e4c-ae8e-4837-a71f-2d710575ab33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:01:54.639792 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance f31ea991-4cf8-43e7-9d65-cfb193c3413a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:01:54.639943 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance aee84b65-41d8-427d-96d0-cd328e4863ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:01:54.640107 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:01:54.640256 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance efc3328c-5e17-4eb2-b8fb-e645a6805b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:01:54.640510 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:01:54.640690 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:01:53 up 30 min,  2 users,  load average: 8.40, 4.18, 1.90\n', 'num_instances': '7', 'num_vm_active': '6', 'num_task_None': '7', 'num_os_type_None': '7', 'num_proj_7efe372c67374c55bd40d7757474f80a': '3', 'io_workload': '0', 'num_vm_rescued': '1', 'num_proj_a3864f7301d84dbdbbb57d5a3ff0d764': '1', 'num_proj_88e334950e7c432ca356cbe67e72c44d': '2', 'num_proj_9818a7ed096346eb92128648c4280071': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:01:55.004827 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:55.005004 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:55.005203 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:55.005377 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:55.005509 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:55.012121 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Terminating instance
May 27 23:01:55.085540 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Detaching volume ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f
May 27 23:01:55.107499 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:01:55.107834 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:01:55.156645 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Attempting to driver detach volume ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f from mountpoint /dev/vdb
May 27 23:01:55.166757 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Found disk vdb by alias ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:01:55.168353 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Found disk vdb by alias ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:01:55.168555 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Attempting to detach device vdb from instance f31ea991-4cf8-43e7-9d65-cfb193c3413a from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:01:55.168888 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:01:55.168888 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:55.168888 np0000001565 nova-compute[98289]:   <alias name="ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f"/>
May 27 23:01:55.168888 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:01:55.168888 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:55.168888 np0000001565 nova-compute[98289]:   <serial>ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f</serial>
May 27 23:01:55.168888 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:01:55.168888 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:01:55.168888 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:55.168888 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:55.180081 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Successfully detached device vdb from instance f31ea991-4cf8-43e7-9d65-cfb193c3413a from the persistent domain config.
May 27 23:01:55.181127 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] (1/8): Attempting to detach device vdb with device alias ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f from instance f31ea991-4cf8-43e7-9d65-cfb193c3413a from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:01:55.181605 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:01:55.181605 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:55.181605 np0000001565 nova-compute[98289]:   <alias name="ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f"/>
May 27 23:01:55.181605 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:01:55.181605 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:55.181605 np0000001565 nova-compute[98289]:   <serial>ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f</serial>
May 27 23:01:55.181605 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:01:55.181605 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:01:55.181605 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:55.181605 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:55.192646 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:55.303420 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:55.524293 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:01:55.548979 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:55.552126 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:55.574278 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:55.586647 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:55.613604 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:01:55.620464 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:55.960713 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:55.970083 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:56.106958 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779922916.1066165, f31ea991-4cf8-43e7-9d65-cfb193c3413a => ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:01:56.113218 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f for instance f31ea991-4cf8-43e7-9d65-cfb193c3413a {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:01:56.121033 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Successfully detached device vdb from instance f31ea991-4cf8-43e7-9d65-cfb193c3413a from the live domain config.
May 27 23:01:56.123273 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999172872000145 future=<Future at 0x726e605c8b90 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:56.134013 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:01:56.134279 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.582s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:56.136875 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:01:56.141271 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Instance destroyed successfully.
May 27 23:01:56.146084 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lazy-loading 'resources' on Instance uuid 13686e4c-ae8e-4837-a71f-2d710575ab33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:56.652023 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1581082659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1581082659',id=3,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbXJ25uvRq+YEKR1kzxedf9FvXb2eZ7io19cQ3tAnPpWU1tiaY+f+xttFfQpCrSUW1ryPIO60u8KO1pLzAlayI1KKlUoQpfHOPvHJtzvGfeubKnVhz74qMUmiGcKUUEGw==',key_name='tempest-keypair-853654392',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:42Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3864f7301d84dbdbbb57d5a3ff0d764',ramdisk_id='',reservation_id='r-2wuc69yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-637545634',owner_user_name='tempest-TaggedAttachmentsTest-637545634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7581bdc53e7e463a8b5951ed443d106a',uuid=13686e4c-ae8e-4837-a71f-2d710575ab33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:01:56.652707 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converting VIF {"id": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "address": "fa:16:3e:38:c5:3a", "network": {"id": "63487ad6-2950-4acd-82d9-2e79cefe2d34", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-406066793-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3864f7301d84dbdbbb57d5a3ff0d764", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7faf9be9-b2", "ovs_interfaceid": "7faf9be9-b21d-441b-9e09-9c236e1f9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:01:56.653218 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:c5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7faf9be9-b21d-441b-9e09-9c236e1f9fb5,network=Network(63487ad6-2950-4acd-82d9-2e79cefe2d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7faf9be9-b2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:01:56.653596 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:c5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7faf9be9-b21d-441b-9e09-9c236e1f9fb5,network=Network(63487ad6-2950-4acd-82d9-2e79cefe2d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7faf9be9-b2') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:01:56.655408 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:56.655664 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7faf9be9-b2, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:56.668931 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:56.670370 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:56.672990 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:56.676812 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:56.676812 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c653b299-f4d9-49bc-b9c5-cd651c863221) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:01:56.676812 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:56.677253 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:01:56.677803 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:56.680992 np0000001565 nova-compute[98289]: INFO os_vif [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:c5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7faf9be9-b21d-441b-9e09-9c236e1f9fb5,network=Network(63487ad6-2950-4acd-82d9-2e79cefe2d34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7faf9be9-b2')
May 27 23:01:56.682589 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Deleting instance files /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33_del
May 27 23:01:56.683968 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Deletion of /opt/stack/data/nova/instances/13686e4c-ae8e-4837-a71f-2d710575ab33_del complete
May 27 23:01:56.708300 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Detected multiple connections on this host for volume: ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f, skipping target disconnect.
May 27 23:01:57.200950 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Took 1.68 seconds to destroy the instance on the hypervisor.
May 27 23:01:57.201639 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:01:57.205423 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:01:57.205423 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:01:57.205423 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:57.300918 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lazy-loading 'flavor' on Instance uuid f31ea991-4cf8-43e7-9d65-cfb193c3413a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:01:57.312101 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:01:57.379727 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:01:57.896000 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] instance snapshotting
May 27 23:01:57.921017 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-af9a39f0-48c2-4b25-ac59-b00487c6f8d2 req-2441b693-302c-473b-b098-cacf81cfe0dc service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Received event network-vif-deleted-7faf9be9-b21d-441b-9e09-9c236e1f9fb5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:01:57.921581 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-af9a39f0-48c2-4b25-ac59-b00487c6f8d2 req-2441b693-302c-473b-b098-cacf81cfe0dc service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Neutron deleted interface 7faf9be9-b21d-441b-9e09-9c236e1f9fb5; detaching it from the instance and deleting it from the info cache
May 27 23:01:57.924461 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-af9a39f0-48c2-4b25-ac59-b00487c6f8d2 req-2441b693-302c-473b-b098-cacf81cfe0dc service nova] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Detach interface failed, port_id=7faf9be9-b21d-441b-9e09-9c236e1f9fb5, reason: Instance 13686e4c-ae8e-4837-a71f-2d710575ab33 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:01:58.005489 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Beginning live snapshot process
May 27 23:01:58.044535 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:58.311731 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e581c6ae-dd5b-45e7-b147-3b8343a45a3b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.729s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:01:58.334655 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:01:58.436719 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:58.821600 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:01:58.840962 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Took 1.64 seconds to deallocate network for instance.
May 27 23:01:59.167867 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:59.168293 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:59.350083 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:01:59.350262 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:01:59.522226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json -f qcow2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:59.604252 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json -f qcow2" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:59.604726 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json -f qcow2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:59.671617 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Detaching volume ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f
May 27 23:01:59.675684 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0031239429999914137 future=<Future at 0x726e587545c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:59.675684 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:59.675684 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=1.1433008370001971 future=<Future at 0x726e605fffb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:59.675684 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=1.1431943950001369 future=<Future at 0x726e605fffb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:01:59.676631 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Emitting event <LifecycleEvent: 1779922904.6712444, a0070282-e138-405c-b6c8-3478991d03f6 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:01:59.676784 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] VM Stopped (Lifecycle Event)
May 27 23:01:59.720295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json -f qcow2" returned: 0 in 0.115s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:59.722693 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:59.726558 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:01:59.726558 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:59.769943 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Attempting to driver detach volume ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f from mountpoint /dev/vdb
May 27 23:01:59.779077 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Found disk vdb by alias ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:01:59.780236 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Found disk vdb by alias ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:01:59.780404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Attempting to detach device vdb from instance aee84b65-41d8-427d-96d0-cd328e4863ba from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:01:59.780992 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:01:59.780992 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:59.780992 np0000001565 nova-compute[98289]:   <alias name="ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f"/>
May 27 23:01:59.780992 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:01:59.780992 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:59.780992 np0000001565 nova-compute[98289]:   <serial>ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f</serial>
May 27 23:01:59.780992 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:01:59.780992 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:01:59.780992 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:59.780992 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:59.788689 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Successfully detached device vdb from instance aee84b65-41d8-427d-96d0-cd328e4863ba from the persistent domain config.
May 27 23:01:59.788887 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] (1/8): Attempting to detach device vdb with device alias ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f from instance aee84b65-41d8-427d-96d0-cd328e4863ba from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:01:59.789172 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:01:59.789172 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:01:59.789172 np0000001565 nova-compute[98289]:   <alias name="ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f"/>
May 27 23:01:59.789172 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:01:59.789172 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:01:59.789172 np0000001565 nova-compute[98289]:   <serial>ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f</serial>
May 27 23:01:59.789172 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:01:59.789172 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:01:59.789172 np0000001565 nova-compute[98289]: </disk>
May 27 23:01:59.789172 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:01:59.834660 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.108s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:59.835775 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9tgl3jtx/f636a0fbea8142f18a36499884e9249c.delta 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:01:59.857298 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:01:59.857724 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:01:59.892813 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9tgl3jtx/f636a0fbea8142f18a36499884e9249c.delta 1073741824" returned: 0 in 0.057s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:01:59.893429 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Quiescing instance not available: QEMU guest agent is not enabled.
May 27 23:02:00.183418 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: a0070282-e138-405c-b6c8-3478991d03f6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:00.214801 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98289) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 23:02:00.216834 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Skipping quiescing instance: QEMU guest agent is not enabled.
May 27 23:02:00.279942 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:02:00.280864 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9tgl3jtx/f636a0fbea8142f18a36499884e9249c.delta /opt/stack/data/nova/instances/snapshots/tmp9tgl3jtx/f636a0fbea8142f18a36499884e9249c {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:00.368315 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:00.418897 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9tgl3jtx/f636a0fbea8142f18a36499884e9249c.delta /opt/stack/data/nova/instances/snapshots/tmp9tgl3jtx/f636a0fbea8142f18a36499884e9249c" returned: 0 in 0.136s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:00.419709 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Snapshot extracted, beginning image upload
May 27 23:02:00.657665 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:00.820302 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0013713369999095448 future=<Future at 0x726e605fffb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:00.820302 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:00.820475 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.301948624000033 future=<Future at 0x726e605c8b90 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:00.820555 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.301849756000138 future=<Future at 0x726e605c8b90 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:00.822161 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779922905.8187246, 3438591d-5ed5-45ed-8875-256372fc8333 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:00.822161 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] VM Stopped (Lifecycle Event)
May 27 23:02:00.884588 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.534s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:00.974655 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Deleted allocations for instance 13686e4c-ae8e-4837-a71f-2d710575ab33
May 27 23:02:01.327300 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0fa7227-657f-40d6-9894-8939434b5ffe None None] [instance: 3438591d-5ed5-45ed-8875-256372fc8333] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:01.678053 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:01.989025 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0daa5704-bf1f-4cf1-909e-b64cabf6e1f0 tempest-TaggedAttachmentsTest-637545634 tempest-TaggedAttachmentsTest-637545634-project-member] Lock "13686e4c-ae8e-4837-a71f-2d710575ab33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.984s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:02.442815 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779922922.442388, aee84b65-41d8-427d-96d0-cd328e4863ba => ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:02:02.444743 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f for instance aee84b65-41d8-427d-96d0-cd328e4863ba {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:02:02.449078 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Successfully detached device vdb from instance aee84b65-41d8-427d-96d0-cd328e4863ba from the live domain config.
May 27 23:02:02.480691 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:02:02.483513 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:02:02.483752 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:02.485370 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:02.485370 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:02:02.485370 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:02:02.512883 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:02:02.512883 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:02:02.512883 np0000001565 nova-compute[98289]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e8d623-2999-4e57-8e73-51a479d36bba (non-flash)
May 27 23:02:02.512883 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:02.513067 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:02:02.513067 np0000001565 nova-compute[98289]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f (non-flash)
May 27 23:02:02.513067 np0000001565 nova-compute[98289]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e8d623-2999-4e57-8e73-51a479d36bba (non-flash)
May 27 23:02:02.513067 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:02.513145 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e8d623-2999-4e57-8e73-51a479d36bba', '13')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:02:02.513225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', '12')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:02:02.513964 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f', '11')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:02:02.514587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e605efb00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f'): ({'sdi'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:02:02.514789 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Removing multipathed devices sdi, sdj {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:02:02.515001 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Flush multipath device 3300000004d095082 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:02:02.549631 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:02:02.600193 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:02:02.655434 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Checking to see if SCSI volumes sdi, sdj have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:02:02.655626 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] SCSI volumes sdi, sdj have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:02:02.656736 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Checking to see if device paths {'sdi', 'sdj'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:02:02.674720 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Device paths {'sdi', 'sdj'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:02:02.676189 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:02:02.686621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:02.716735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f, portal: 192.168.40.100,3260]
May 27 23:02:02.716735 np0000001565 nova-compute[98289]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f, portal: 192.168.40.100,3260] successful.
May 27 23:02:02.716735 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:02.731812 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:02.745005 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:02.779806 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f, portal: 192.168.50.100,3260]
May 27 23:02:02.779806 np0000001565 nova-compute[98289]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-ed8f1eb4-f575-4bfc-b840-1b7e60b53f9f, portal: 192.168.50.100,3260] successful.
May 27 23:02:02.779806 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:02.794312 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:02.794672 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:02.794877 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] <== disconnect_volume: return (311ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:02:02.795103 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:02:03.046598 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:03.391729 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lazy-loading 'flavor' on Instance uuid aee84b65-41d8-427d-96d0-cd328e4863ba {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:04.047646 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Snapshot image upload complete
May 27 23:02:04.048009 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-aa09fbfa-f9b0-4932-96e7-75e8ae999035 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Took 6.15 seconds to snapshot the instance on the hypervisor.
May 27 23:02:04.401817 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8048e50d-dde7-4ce8-9803-e2b5e6b204a0 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.234s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:04.637643 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:04.637977 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:04.638438 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:04.639365 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:04.640049 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:04.647206 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Terminating instance
May 27 23:02:04.764121 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:04.764766 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:04.765569 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:04.766359 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:04.767071 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:04.773372 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Terminating instance
May 27 23:02:05.151500 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:02:05.170721 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:05.175293 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:05.196821 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:05.282923 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:02:05.325315 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:05.328018 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:05.360562 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:05.368638 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:05.379462 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:05.400709 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:05.438065 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:05.489613 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99964209299992 future=<Future at 0x726e601b1cd0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:05.494025 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Instance destroyed successfully.
May 27 23:02:05.494587 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lazy-loading 'resources' on Instance uuid f31ea991-4cf8-43e7-9d65-cfb193c3413a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:05.532793 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4f77b3dd-c31e-40bd-b03d-3cf5fed015f6 req-ef081834-fb6b-4d22-bffc-7dc940874a71 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received event network-vif-unplugged-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:05.533072 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4f77b3dd-c31e-40bd-b03d-3cf5fed015f6 req-ef081834-fb6b-4d22-bffc-7dc940874a71 service nova] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:05.533237 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4f77b3dd-c31e-40bd-b03d-3cf5fed015f6 req-ef081834-fb6b-4d22-bffc-7dc940874a71 service nova] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:05.533414 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4f77b3dd-c31e-40bd-b03d-3cf5fed015f6 req-ef081834-fb6b-4d22-bffc-7dc940874a71 service nova] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:05.533599 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4f77b3dd-c31e-40bd-b03d-3cf5fed015f6 req-ef081834-fb6b-4d22-bffc-7dc940874a71 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] No waiting events found dispatching network-vif-unplugged-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:05.533761 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4f77b3dd-c31e-40bd-b03d-3cf5fed015f6 req-ef081834-fb6b-4d22-bffc-7dc940874a71 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received event network-vif-unplugged-1f508337-775f-4120-a399-7a785fa5a827 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:02:05.627938 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999726015000078 future=<Future at 0x726e60499280 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:05.629746 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Instance destroyed successfully.
May 27 23:02:05.630172 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lazy-loading 'resources' on Instance uuid aee84b65-41d8-427d-96d0-cd328e4863ba {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:06.000397 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1584029026-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testmultiattachvolumeswap-server-1584029026-1',id=6,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcyph/lzlfPzwzF2ik9TBAMRhykzkfSsaBTCiun/k+rxSvdcGAJypfCitS229KGkPzuKR0UrBeAKUFkzl8AnmQHHuOHIPUmIwa8nEyoNXRxQIaqq+TBt0S9ALq+N/gyug==',key_name='tempest-keypair-167177011',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:00:49Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88e334950e7c432ca356cbe67e72c44d',ramdisk_id='',reservation_id='r-owzn0iqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-611409375',owner_user_name='tempest-TestMultiAttachVolumeSwap-611409375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:00:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6f43a4e43324b67b74b5a65d12cbcea',uuid=f31ea991-4cf8-43e7-9d65-cfb193c3413a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:02:06.000677 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converting VIF {"id": "1f508337-775f-4120-a399-7a785fa5a827", "address": "fa:16:3e:cb:db:bd", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f508337-77", "ovs_interfaceid": "1f508337-775f-4120-a399-7a785fa5a827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:06.002488 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f508337-775f-4120-a399-7a785fa5a827,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f508337-77') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:06.002488 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f508337-775f-4120-a399-7a785fa5a827,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f508337-77') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:02:06.003478 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.003747 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f508337-77, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:06.004959 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.005689 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:06.013179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.014292 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.014569 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a1b0001-dd9e-46ac-b59e-5e251c7436ba) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:06.015345 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.015917 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:06.023028 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.024583 np0000001565 nova-compute[98289]: INFO os_vif [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f508337-775f-4120-a399-7a785fa5a827,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f508337-77')
May 27 23:02:06.024967 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Deleting instance files /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a_del
May 27 23:02:06.025955 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Deletion of /opt/stack/data/nova/instances/f31ea991-4cf8-43e7-9d65-cfb193c3413a_del complete
May 27 23:02:06.132750 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1584029026-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testmultiattachvolumeswap-server-1584029026-2',id=7,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcyph/lzlfPzwzF2ik9TBAMRhykzkfSsaBTCiun/k+rxSvdcGAJypfCitS229KGkPzuKR0UrBeAKUFkzl8AnmQHHuOHIPUmIwa8nEyoNXRxQIaqq+TBt0S9ALq+N/gyug==',key_name='tempest-keypair-167177011',keypairs=<?>,launch_index=1,launched_at=2026-05-27T23:00:51Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88e334950e7c432ca356cbe67e72c44d',ramdisk_id='',reservation_id='r-owzn0iqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-611409375',owner_user_name='tempest-TestMultiAttachVolumeSwap-611409375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6f43a4e43324b67b74b5a65d12cbcea',uuid=aee84b65-41d8-427d-96d0-cd328e4863ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:02:06.132981 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converting VIF {"id": "899734d7-d351-4e8e-9021-71e58ffa2734", "address": "fa:16:3e:d4:38:82", "network": {"id": "dc0ac06a-c192-4276-a062-7c83f091adf0", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-66944703-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e334950e7c432ca356cbe67e72c44d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap899734d7-d3", "ovs_interfaceid": "899734d7-d351-4e8e-9021-71e58ffa2734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:06.133577 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:38:82,bridge_name='br-int',has_traffic_filtering=True,id=899734d7-d351-4e8e-9021-71e58ffa2734,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap899734d7-d3') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:06.133841 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:38:82,bridge_name='br-int',has_traffic_filtering=True,id=899734d7-d351-4e8e-9021-71e58ffa2734,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap899734d7-d3') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:02:06.135865 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.135865 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap899734d7-d3, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:06.137098 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.138752 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:06.139662 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.139662 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32cad4e5-1793-42ff-b837-5bd9e94dd1c2) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:06.140476 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.141943 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.143533 np0000001565 nova-compute[98289]: INFO os_vif [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:38:82,bridge_name='br-int',has_traffic_filtering=True,id=899734d7-d351-4e8e-9021-71e58ffa2734,network=Network(dc0ac06a-c192-4276-a062-7c83f091adf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap899734d7-d3')
May 27 23:02:06.143915 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Deleting instance files /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba_del
May 27 23:02:06.145195 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Deletion of /opt/stack/data/nova/instances/aee84b65-41d8-427d-96d0-cd328e4863ba_del complete
May 27 23:02:06.410604 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.532710 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 23:02:06.533264 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:02:06.533802 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:02:06.533802 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:02:06.534089 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:06.651703 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Took 1.37 seconds to destroy the instance on the hypervisor.
May 27 23:02:06.652016 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:02:06.652362 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:02:06.652555 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:02:06.652843 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:06.693812 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:06.769827 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:06.845484 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:07.612972 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received event network-vif-unplugged-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:07.613541 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] Acquiring lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:07.613843 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:07.614084 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:07.614307 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] No waiting events found dispatching network-vif-unplugged-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:07.614717 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received event network-vif-unplugged-1f508337-775f-4120-a399-7a785fa5a827 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:02:07.614919 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received event network-vif-unplugged-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:07.615157 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:07.615430 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:07.615583 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:07.615854 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] No waiting events found dispatching network-vif-unplugged-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:07.616509 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received event network-vif-unplugged-899734d7-d351-4e8e-9021-71e58ffa2734 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:02:07.616646 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received event network-vif-unplugged-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:07.616772 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] Acquiring lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:07.616900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:07.617005 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:07.617531 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] No waiting events found dispatching network-vif-unplugged-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:07.617686 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received event network-vif-unplugged-899734d7-d351-4e8e-9021-71e58ffa2734 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:02:07.618130 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Received event network-vif-deleted-1f508337-775f-4120-a399-7a785fa5a827 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:07.618300 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Neutron deleted interface 1f508337-775f-4120-a399-7a785fa5a827; detaching it from the instance and deleting it from the info cache
May 27 23:02:07.619816 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b64e0fee-2ec2-4068-b8d2-7f99d8857d91 req-a0701460-8079-41fa-8908-9be10257aff3 service nova] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Detach interface failed, port_id=1f508337-775f-4120-a399-7a785fa5a827, reason: Instance f31ea991-4cf8-43e7-9d65-cfb193c3413a could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:02:07.842607 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:08.053132 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:08.345412 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Took 1.81 seconds to deallocate network for instance.
May 27 23:02:08.361941 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:08.684481 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ca92a7f6-e87c-413f-af6f-92398771fe16 req-c3bf5d0e-fde1-4e52-b167-e34de476d752 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Received event network-vif-deleted-899734d7-d351-4e8e-9021-71e58ffa2734 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:08.684481 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-ca92a7f6-e87c-413f-af6f-92398771fe16 req-c3bf5d0e-fde1-4e52-b167-e34de476d752 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Neutron deleted interface 899734d7-d351-4e8e-9021-71e58ffa2734; detaching it from the instance and deleting it from the info cache
May 27 23:02:08.688746 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ca92a7f6-e87c-413f-af6f-92398771fe16 req-c3bf5d0e-fde1-4e52-b167-e34de476d752 service nova] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Detach interface failed, port_id=899734d7-d351-4e8e-9021-71e58ffa2734, reason: Instance aee84b65-41d8-427d-96d0-cd328e4863ba could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:02:08.736819 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:02:08.859465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:08.859726 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:09.097446 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:09.183430 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:09.183430 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:09.313157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:02:09.313460 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:02:09.472758 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:09.601903 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Took 2.95 seconds to deallocate network for instance.
May 27 23:02:09.686036 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:02:09.816360 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:10.109468 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:10.233059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:10.312201 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:10.322341 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.463s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:10.323856 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.215s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:10.394277 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Deleted allocations for instance f31ea991-4cf8-43e7-9d65-cfb193c3413a
May 27 23:02:10.744128 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:02:10.744557 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:02:11.123196 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004059069999584608 future=<Future at 0x726e605c8b90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:11.123196 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:11.123196 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.36612520299991 future=<Future at 0x726e601b1cd0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:11.123196 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.366057719999844 future=<Future at 0x726e601b1cd0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:11.123610 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] Emitting event <LifecycleEvent: 1779922916.1223166, 13686e4c-ae8e-4837-a71f-2d710575ab33 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:11.123727 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] VM Stopped (Lifecycle Event)
May 27 23:02:11.140724 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:11.161172 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:11.246976 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:11.405012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e33343a8-6fca-41b3-9792-af972f54b27b tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "f31ea991-4cf8-43e7-9d65-cfb193c3413a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.767s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:11.626274 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b4d70477-63b9-41c1-a59c-4532821f5986 tempest-DeleteServersTestJSON-932935839 tempest-DeleteServersTestJSON-932935839-project-member] [instance: 13686e4c-ae8e-4837-a71f-2d710575ab33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:11.757794 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.434s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:11.760185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.525s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:11.764137 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:02:11.764137 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Claim successful on node np0000001565
May 27 23:02:11.815583 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Deleted allocations for instance aee84b65-41d8-427d-96d0-cd328e4863ba
May 27 23:02:11.836789 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "f47a00cc-da92-40c9-a668-9a160670addd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:11.837419 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "f47a00cc-da92-40c9-a668-9a160670addd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:12.339602 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:02:12.752501 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "3eb890c1-c528-489f-8109-4b7870bfcf33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:12.752726 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:12.824506 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-24a4c341-d88a-4533-8b87-cb136e892a87 tempest-TestMultiAttachVolumeSwap-611409375 tempest-TestMultiAttachVolumeSwap-611409375-project-member] Lock "aee84b65-41d8-427d-96d0-cd328e4863ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.060s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:12.928461 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:13.055503 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:13.147522 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:02:13.147771 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:02:13.257137 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:02:13.650021 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:13.812384 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:14.155981 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.398s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:14.156556 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:02:14.158876 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.231s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:14.161905 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:02:14.163061 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Claim successful on node np0000001565
May 27 23:02:14.662920 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:02:14.663137 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:02:14.663474 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:14.663758 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:14.764641 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6037b0819a94463e8e45d96f834c4341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818a7ed096346eb92128648c4280071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:02:15.064206 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:15.064412 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:15.170095 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:02:15.277397 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Successfully created port: fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:02:15.547081 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:02:15.547270 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:02:15.566078 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:02:15.674671 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:02:15.769875 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Successfully updated port: fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:02:15.842262 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-96bb26f6-8faa-4086-a567-a2c18dd7ab45 req-f64091f9-d782-4a46-a1e6-685ca908d25e service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-changed-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:15.842419 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-96bb26f6-8faa-4086-a567-a2c18dd7ab45 req-f64091f9-d782-4a46-a1e6-685ca908d25e service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Refreshing instance network info cache due to event network-changed-fe17e03b-0353-4478-8ccb-48bb8622d814. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:02:15.842618 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-96bb26f6-8faa-4086-a567-a2c18dd7ab45 req-f64091f9-d782-4a46-a1e6-685ca908d25e service nova] Acquiring lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:15.842665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-96bb26f6-8faa-4086-a567-a2c18dd7ab45 req-f64091f9-d782-4a46-a1e6-685ca908d25e service nova] Acquired lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:15.842790 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-96bb26f6-8faa-4086-a567-a2c18dd7ab45 req-f64091f9-d782-4a46-a1e6-685ca908d25e service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Refreshing network info cache for port fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:02:15.859174 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:16.049925 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:16.115447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:16.143918 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:16.179612 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Booting with blank volume at /dev/vda
May 27 23:02:16.278168 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:16.344767 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-96bb26f6-8faa-4086-a567-a2c18dd7ab45 req-f64091f9-d782-4a46-a1e6-685ca908d25e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:16.424804 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-96bb26f6-8faa-4086-a567-a2c18dd7ab45 req-f64091f9-d782-4a46-a1e6-685ca908d25e service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:16.556371 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-96bb26f6-8faa-4086-a567-a2c18dd7ab45 req-f64091f9-d782-4a46-a1e6-685ca908d25e service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:16.557061 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.398s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:16.557913 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.746s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:16.558106 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:02:16.562848 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:02:16.563003 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Claim successful on node np0000001565
May 27 23:02:17.057865 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-96bb26f6-8faa-4086-a567-a2c18dd7ab45 req-f64091f9-d782-4a46-a1e6-685ca908d25e service nova] Releasing lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:17.058249 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquired lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:17.058457 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:02:17.064507 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:02:17.068127 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:02:17.069393 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:17.071458 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:17.154744 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c6d94c1e6da4237aa5dd517c31e03d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec877dc7b2240969ac89c13673f8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:02:17.422829 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:17.576834 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:02:17.631897 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Successfully created port: 409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:02:17.660744 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:17.903351 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:18.057143 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:18.073163 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Updating instance_info_cache with network_info: [{"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:18.086610 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:02:18.154718 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:02:18.155005 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:02:18.265157 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Successfully updated port: 409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:02:18.315891 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c177b32a-8811-4c37-a5c6-d02125c9509c req-4bfc6e29-c206-48a6-a77a-782a34f6cd20 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Received event network-changed-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:18.316627 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c177b32a-8811-4c37-a5c6-d02125c9509c req-4bfc6e29-c206-48a6-a77a-782a34f6cd20 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Refreshing instance network info cache due to event network-changed-409f0bf7-c0d0-4da5-97f5-9608b91ea67c. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:02:18.316890 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c177b32a-8811-4c37-a5c6-d02125c9509c req-4bfc6e29-c206-48a6-a77a-782a34f6cd20 service nova] Acquiring lock "refresh_cache-f47a00cc-da92-40c9-a668-9a160670addd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:18.317061 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c177b32a-8811-4c37-a5c6-d02125c9509c req-4bfc6e29-c206-48a6-a77a-782a34f6cd20 service nova] Acquired lock "refresh_cache-f47a00cc-da92-40c9-a668-9a160670addd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:18.317233 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c177b32a-8811-4c37-a5c6-d02125c9509c req-4bfc6e29-c206-48a6-a77a-782a34f6cd20 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Refreshing network info cache for port 409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:02:18.574221 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Releasing lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:18.574643 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Instance network_info: |[{"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:02:18.588541 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Booting with volume 5040d323-2b77-4acd-90da-38f38e2680f1 at /dev/vda
May 27 23:02:18.628421 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:02:18.640180 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:02:18.662069 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:18.669148 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:18.699417 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:02:18.699999 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:02:18.708509 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:02:18.709871 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe47:f045', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9'] 
May 27 23:02:18.710132 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:02:18.710205 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:02:18.710799 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:02:18.710879 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Updating existing volume attachment record: ee30d885-0095-430c-a144-e25d87d7449d {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:02:18.767835 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-f47a00cc-da92-40c9-a668-9a160670addd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:18.819305 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-c177b32a-8811-4c37-a5c6-d02125c9509c req-4bfc6e29-c206-48a6-a77a-782a34f6cd20 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:18.879361 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c177b32a-8811-4c37-a5c6-d02125c9509c req-4bfc6e29-c206-48a6-a77a-782a34f6cd20 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:19.067872 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c177b32a-8811-4c37-a5c6-d02125c9509c req-4bfc6e29-c206-48a6-a77a-782a34f6cd20 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:19.169685 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.612s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:19.170204 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:02:19.175077 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.060s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:19.180459 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:02:19.180459 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Claim successful on node np0000001565
May 27 23:02:19.280468 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:19.548530 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:02:19.563101 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:02:19.570952 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c177b32a-8811-4c37-a5c6-d02125c9509c req-4bfc6e29-c206-48a6-a77a-782a34f6cd20 service nova] Releasing lock "refresh_cache-f47a00cc-da92-40c9-a668-9a160670addd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:19.571888 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-f47a00cc-da92-40c9-a668-9a160670addd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:19.572041 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:02:19.587014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:19.618671 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:02:19.619064 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:02:19.627141 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:02:19.628436 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe47:f045', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9'] 
May 27 23:02:19.628436 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:02:19.628564 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:02:19.628734 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:02:19.628935 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Updating existing volume attachment record: ff092818-71ae-4a12-bb7d-e99244f31543 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:02:19.682543 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:02:19.682917 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:02:19.683462 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:19.689412 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:19.776501 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f0d298d70064eac8ffd4fe25b1e203b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f15f51479c4e37ab880af2031170be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:02:20.198421 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:02:20.277785 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Successfully created port: a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:02:20.310453 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:20.490678 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0005447670000648941 future=<Future at 0x726e601b1cd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:20.490678 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Emitting event <LifecycleEvent: 1779922925.4890606, f31ea991-4cf8-43e7-9d65-cfb193c3413a => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:20.491017 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:20.491443 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] VM Stopped (Lifecycle Event)
May 27 23:02:20.493465 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.13418961200000012 future=<Future at 0x726e60499280 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:20.493699 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.13397610599986365 future=<Future at 0x726e60499280 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:20.628029 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003385160000561882 future=<Future at 0x726e60499280 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:20.628550 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] Emitting event <LifecycleEvent: 1779922925.6275725, aee84b65-41d8-427d-96d0-cd328e4863ba => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:20.628550 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:20.628718 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] VM Stopped (Lifecycle Event)
May 27 23:02:20.701196 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:02:20.736896 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:02:20.737395 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:02:20.776793 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:20.827139 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:02:20.827507 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:02:20.827727 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Creating image(s)
May 27 23:02:20.827965 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:02:20.828070 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Ensure instance console log exists: /opt/stack/data/nova/instances/f47a00cc-da92-40c9-a668-9a160670addd/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:02:20.828288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:20.828454 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:20.828578 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:20.996103 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: f31ea991-4cf8-43e7-9d65-cfb193c3413a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:21.017677 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Successfully updated port: a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:02:21.088814 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-67c8b761-0e90-4e7a-bd50-2b21beaccd3c req-76f8a7fc-aeff-4867-aab8-92dba8d76c69 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Received event network-changed-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:21.089821 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-67c8b761-0e90-4e7a-bd50-2b21beaccd3c req-76f8a7fc-aeff-4867-aab8-92dba8d76c69 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Refreshing instance network info cache due to event network-changed-a94e67a9-7aeb-4935-b3f6-a13811736551. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:02:21.090041 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-67c8b761-0e90-4e7a-bd50-2b21beaccd3c req-76f8a7fc-aeff-4867-aab8-92dba8d76c69 service nova] Acquiring lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:21.090182 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-67c8b761-0e90-4e7a-bd50-2b21beaccd3c req-76f8a7fc-aeff-4867-aab8-92dba8d76c69 service nova] Acquired lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:21.090351 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-67c8b761-0e90-4e7a-bd50-2b21beaccd3c req-76f8a7fc-aeff-4867-aab8-92dba8d76c69 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Refreshing network info cache for port a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:02:21.131076 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57135c0b-c5b7-47ec-8cda-198e02e13e1f tempest-ServersNegativeTestJSON-1019668163 tempest-ServersNegativeTestJSON-1019668163-project-member] [instance: aee84b65-41d8-427d-96d0-cd328e4863ba] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:21.146220 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:21.240237 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:21.299531 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:21.513211 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Updating instance_info_cache with network_info: [{"id": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "address": "fa:16:3e:94:3e:4d", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap409f0bf7-c0", "ovs_interfaceid": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:21.522851 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:21.592965 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-67c8b761-0e90-4e7a-bd50-2b21beaccd3c req-76f8a7fc-aeff-4867-aab8-92dba8d76c69 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:21.670370 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-67c8b761-0e90-4e7a-bd50-2b21beaccd3c req-76f8a7fc-aeff-4867-aab8-92dba8d76c69 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:21.710772 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:02:21.713416 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:02:21.713416 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Creating image(s)
May 27 23:02:21.713416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "/opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:21.713416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "/opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:21.714366 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "/opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:21.715014 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:21.722479 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:21.723833 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:21.752125 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.575s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:21.752125 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:02:21.770376 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:02:21.771893 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:02:21.772083 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Creating image(s)
May 27 23:02:21.772503 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:02:21.772662 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Ensure instance console log exists: /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:02:21.772880 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:21.773075 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:21.773216 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:21.773864 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Start _get_guest_xml network_info=[{"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ff092818-71ae-4a12-bb7d-e99244f31543', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7cb7c255-4b3c-493e-9a31-e554576a0525', 'attached_at': '', 'detached_at': '', 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'serial': '7b3985f1-9dc4-481b-9837-6caf308cc632'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:02:21.777364 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:02:21.778101 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-652051971', uuid='7cb7c255-4b3c-493e-9a31-e554576a0525'), owner=OwnerMeta(userid='6037b0819a94463e8e45d96f834c4341', username='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member', projectid='9818a7ed096346eb92128648c4280071', projectname='tempest-ServerBootFromVolumeStableRescueTest-800872693'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922941.7778008) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:02:21.779022 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:02:21.779320 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:02:21.780018 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:02:21.780167 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:02:21.781005 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:02:21.781269 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:02:21.781413 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:02:21.781506 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:02:21.781640 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:02:21.781720 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:02:21.781810 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:02:21.781949 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:02:21.782052 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:02:21.782159 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:02:21.782259 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:02:21.782395 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:02:21.796086 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:02:21.796086 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:02:21.796086 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:21.796475 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:21.796747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:02:21.811086 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:21.811086 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:21.811685 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:21.813345 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:21.813705 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:02:21.814031 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:02:21.817623 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:21.818152 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:21.819098 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:21.820391 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:21.826235 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:21.828525 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:21.835456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:02:21.835456 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:21.835456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:02:21.835456 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:21.852873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632] added
May 27 23:02:21.852873 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:02:21.852873 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:21.852873 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:21.852873 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:21.852873 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:21.852873 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:21.853227 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632] added
May 27 23:02:21.853227 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:02:21.853227 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:21.853227 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:21.853227 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:21.853227 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:21.853227 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:21.853546 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:02:21.855247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:02:21.855247 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0407(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:02:21.855371 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0411(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:02:21.855699 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:02:21.855964 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:02:21.870357 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:21.924937 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.096s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:21.925321 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:21.960003 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-67c8b761-0e90-4e7a-bd50-2b21beaccd3c req-76f8a7fc-aeff-4867-aab8-92dba8d76c69 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:21.973865 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk 1073741824" returned: 0 in 0.048s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:21.974406 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:21.974862 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:22.016580 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-f47a00cc-da92-40c9-a668-9a160670addd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:22.017213 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Instance network_info: |[{"id": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "address": "fa:16:3e:94:3e:4d", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap409f0bf7-c0", "ovs_interfaceid": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:02:22.018899 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Start _get_guest_xml network_info=[{"id": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "address": "fa:16:3e:94:3e:4d", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap409f0bf7-c0", "ovs_interfaceid": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ee30d885-0095-430c-a144-e25d87d7449d', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5040d323-2b77-4acd-90da-38f38e2680f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f47a00cc-da92-40c9-a668-9a160670addd', 'attached_at': '', 'detached_at': '', 'volume_id': '5040d323-2b77-4acd-90da-38f38e2680f1', 'serial': '5040d323-2b77-4acd-90da-38f38e2680f1', 'multiattach': True}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:02:22.023061 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:02:22.023061 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-120023004', uuid='f47a00cc-da92-40c9-a668-9a160670addd'), owner=OwnerMeta(userid='2c6d94c1e6da4237aa5dd517c31e03d7', username='tempest-AttachVolumeMultiAttachTest-781715127-project-member', projectid='0ec877dc7b2240969ac89c13673f8799', projectname='tempest-AttachVolumeMultiAttachTest-781715127'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "address": "fa:16:3e:94:3e:4d", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap409f0bf7-c0", "ovs_interfaceid": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922942.022297) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:02:22.024348 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:02:22.024824 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:02:22.027184 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:02:22.027467 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:02:22.028846 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:02:22.029262 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:02:22.029464 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:02:22.029653 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:02:22.029824 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:02:22.029924 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:02:22.030002 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:02:22.030200 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:02:22.030352 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:02:22.034960 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:02:22.034960 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:02:22.034960 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:02:22.052019 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:02:22.052514 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5040d323-2b77-4acd-90da-38f38e2680f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:02:22.052886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:22.071739 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.097s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:22.072238 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:02:22.072631 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:22.164956 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:22.166737 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Cannot resize image /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:02:22.167206 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:02:22.167472 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Ensure instance console log exists: /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:02:22.167921 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:22.168165 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:22.168356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:22.268305 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:02:22.268488 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:02:22.268928 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:22.270027 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:22.403761 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fb24b22559e4715a196b40ce9948d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbf5952ce9242a38d3c1881a1604223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:02:22.463692 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-67c8b761-0e90-4e7a-bd50-2b21beaccd3c req-76f8a7fc-aeff-4867-aab8-92dba8d76c69 service nova] Releasing lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:22.464291 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquired lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:22.464561 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:02:22.771736 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:02:22.856230 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:02:22.856783 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:02:22.867242 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:02:22.867242 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:02:22.874400 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:02:22.874400 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:22.878717 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Successfully created port: 61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:02:22.881782 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:22.887818 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:22.894036 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:02:22.894036 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:22.894163 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:02:22.894163 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:22.894276 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:02:22.894276 np0000001565 nova-compute[98289]: 
May 27 23:02:22.900806 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:02:22.900806 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:22.900962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:02:22.900962 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:22.901021 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:02:22.901021 np0000001565 nova-compute[98289]: 
May 27 23:02:23.060655 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:23.076325 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:23.274774 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:02:23.375288 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Successfully updated port: 61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:02:23.411908 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:23.443535 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-839085e1-4064-477c-a4c7-74eb62dc3da5 req-e5a7b349-9450-4d7a-a6d3-da305687c72a service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-changed-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:23.443698 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-839085e1-4064-477c-a4c7-74eb62dc3da5 req-e5a7b349-9450-4d7a-a6d3-da305687c72a service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Refreshing instance network info cache due to event network-changed-61892495-669a-42b8-9d49-04d6990d3b8f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:02:23.443843 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-839085e1-4064-477c-a4c7-74eb62dc3da5 req-e5a7b349-9450-4d7a-a6d3-da305687c72a service nova] Acquiring lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:23.443957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-839085e1-4064-477c-a4c7-74eb62dc3da5 req-e5a7b349-9450-4d7a-a6d3-da305687c72a service nova] Acquired lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:23.444375 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-839085e1-4064-477c-a4c7-74eb62dc3da5 req-e5a7b349-9450-4d7a-a6d3-da305687c72a service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Refreshing network info cache for port 61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:02:23.525108 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:23.726377 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Updating instance_info_cache with network_info: [{"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:23.822153 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:23.877530 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:23.928204 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632, portal: 192.168.50.100,3260]
May 27 23:02:23.928204 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632, portal: 192.168.50.100,3260] successful.
May 27 23:02:23.928204 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:23.930929 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632, portal: 192.168.40.100,3260]
May 27 23:02:23.930929 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632, portal: 192.168.40.100,3260] successful.
May 27 23:02:23.930929 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:23.939914 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:23.944196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:23.947533 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-839085e1-4064-477c-a4c7-74eb62dc3da5 req-e5a7b349-9450-4d7a-a6d3-da305687c72a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:23.952868 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:23.952868 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:23.952868 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:23.953046 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:23.953046 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:23.953046 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:23.953388 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.142s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:23.953553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:02:23.954188 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] HCTL ('7', '-', '-', 0) found on session 16 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:02:23.954321 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:02:23.954807 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:23.954807 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:23.954807 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:23.954928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:23.954928 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:23.954928 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:23.955169 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.143s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:23.955257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:02:23.955890 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] HCTL ('8', '-', '-', 0) found on session 17 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:02:23.955890 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:02:23.973075 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching for a device in session 16 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:02:23.973075 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:02:23.984153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching for a device in session 17 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:02:23.984153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:02:24.022684 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-839085e1-4064-477c-a4c7-74eb62dc3da5 req-e5a7b349-9450-4d7a-a6d3-da305687c72a service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:24.173020 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-839085e1-4064-477c-a4c7-74eb62dc3da5 req-e5a7b349-9450-4d7a-a6d3-da305687c72a service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:24.228636 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Releasing lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:24.228971 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Instance network_info: |[{"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:02:24.231530 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Start _get_guest_xml network_info=[{"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:02:24.233536 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:02:24.234894 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-577068969', uuid='3eb890c1-c528-489f-8109-4b7870bfcf33'), owner=OwnerMeta(userid='8f0d298d70064eac8ffd4fe25b1e203b', username='tempest-ServerActionsTestOtherA-1786604563-project-member', projectid='d6f15f51479c4e37ab880af2031170be', projectname='tempest-ServerActionsTestOtherA-1786604563'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922944.234528) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:02:24.236346 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:02:24.236346 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:02:24.240399 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:02:24.256196 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-577068969',display_name='tempest-ServerActionsTestOtherA-server-577068969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestothera-server-577068969',id=15,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDbaj3DPBwSZJeJkSnhSxE7m4eskg4J4EL3Q2BBe+Q8XlC97E7Cxe9kHqz6aAye5+4WemBw1vcR74IA2SLmGxwKECL2TR/u5JVPPAw/fcZ9wwGfIrFs+wKKcahPL14eOA==',key_name='tempest-keypair-729756855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-o9ri1w6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=3eb890c1-c528-489f-8109-4b7870bfcf33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:02:24.256702 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:24.257641 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:51:12,bridge_name='br-int',has_traffic_filtering=True,id=a94e67a9-7aeb-4935-b3f6-a13811736551,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94e67a9-7a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:24.258432 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'pci_devices' on Instance uuid 3eb890c1-c528-489f-8109-4b7870bfcf33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:24.289015 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:02:24.289965 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:02:24.290174 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Creating image(s)
May 27 23:02:24.290602 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:24.290754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:24.291195 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:24.292479 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:24.295016 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:24.296131 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:24.383361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:24.383361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:24.383361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:24.383361 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:24.385015 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:24.386384 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:24.458280 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.073s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:24.459061 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:24.504447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk 1073741824" returned: 0 in 0.045s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:24.505166 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.123s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:24.505561 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:24.580235 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.074s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:24.580755 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:02:24.581017 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:24.660449 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:24.660838 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Cannot resize image /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:02:24.661214 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:02:24.661445 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Ensure instance console log exists: /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:02:24.661766 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:24.661943 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:24.662098 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:24.675179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-839085e1-4064-477c-a4c7-74eb62dc3da5 req-e5a7b349-9450-4d7a-a6d3-da305687c72a service nova] Releasing lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:24.675698 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquired lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:24.675960 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:02:24.764435 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] End _get_guest_xml xml=<domain type="qemu">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <uuid>3eb890c1-c528-489f-8109-4b7870bfcf33</uuid>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <name>instance-0000000f</name>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerActionsTestOtherA-server-577068969</nova:name>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:02:24</nova:creationTime>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:user uuid="8f0d298d70064eac8ffd4fe25b1e203b">tempest-ServerActionsTestOtherA-1786604563-project-member</nova:user>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:project uuid="d6f15f51479c4e37ab880af2031170be">tempest-ServerActionsTestOtherA-1786604563</nova:project>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         <nova:port uuid="a94e67a9-7aeb-4935-b3f6-a13811736551">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <system>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <entry name="serial">3eb890c1-c528-489f-8109-4b7870bfcf33</entry>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <entry name="uuid">3eb890c1-c528-489f-8109-4b7870bfcf33</entry>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     </system>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <os>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   </os>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <features>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   </features>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   <devices>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk.config"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:97:51:12"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <target dev="tapa94e67a9-7a"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     </interface>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/console.log" append="off"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     </serial>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <video>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     </video>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     </rng>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:   </devices>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]: </domain>
May 27 23:02:24.764435 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:02:24.764435 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Preparing to wait for external event network-vif-plugged-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:02:24.770140 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:24.770140 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:24.770140 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:24.770140 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-577068969',display_name='tempest-ServerActionsTestOtherA-server-577068969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestothera-server-577068969',id=15,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDbaj3DPBwSZJeJkSnhSxE7m4eskg4J4EL3Q2BBe+Q8XlC97E7Cxe9kHqz6aAye5+4WemBw1vcR74IA2SLmGxwKECL2TR/u5JVPPAw/fcZ9wwGfIrFs+wKKcahPL14eOA==',key_name='tempest-keypair-729756855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-o9ri1w6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=3eb890c1-c528-489f-8109-4b7870bfcf33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:02:24.770473 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:24.770473 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:51:12,bridge_name='br-int',has_traffic_filtering=True,id=a94e67a9-7aeb-4935-b3f6-a13811736551,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94e67a9-7a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:24.770473 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:51:12,bridge_name='br-int',has_traffic_filtering=True,id=a94e67a9-7aeb-4935-b3f6-a13811736551,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94e67a9-7a') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:02:24.770473 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:24.770701 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:24.770848 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:02:24.771661 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:24.771815 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e97ade6-d90a-52e9-a530-96a18efa1d11', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:24.782684 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:24.783501 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:24.785739 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:24.785922 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa94e67a9-7a, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:24.786241 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa94e67a9-7a, col_values=(('qos', UUID('7a85029e-3ff5-4460-9785-bb30178bc150')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:24.786434 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa94e67a9-7a, col_values=(('external_ids', {'iface-id': 'a94e67a9-7aeb-4935-b3f6-a13811736551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:51:12', 'vm-uuid': '3eb890c1-c528-489f-8109-4b7870bfcf33'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:24.787189 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:24.788311 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:24.794861 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:24.795525 np0000001565 nova-compute[98289]: INFO os_vif [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:51:12,bridge_name='br-int',has_traffic_filtering=True,id=a94e67a9-7aeb-4935-b3f6-a13811736551,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94e67a9-7a')
May 27 23:02:24.813655 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:02:25.106119 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:25.106563 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:25.248369 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:25.413296 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:25.515857 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Received event network-vif-unplugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:25.516123 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] Acquiring lock "f47a00cc-da92-40c9-a668-9a160670addd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:25.516482 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:25.516482 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:25.516617 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] No waiting events found dispatching network-vif-unplugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:25.516814 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Received unexpected event network-vif-unplugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c for instance with vm_state building and task_state spawning.
May 27 23:02:25.516904 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:25.517074 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:25.517222 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:25.517398 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:25.517693 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] No waiting events found dispatching network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:25.517693 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-19365b94-a0a6-423b-8ffd-18a94535302c req-2f2d52b0-5ecc-4ee6-a95e-a23771529954 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received unexpected event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f for instance with vm_state building and task_state spawning.
May 27 23:02:25.562171 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating instance_info_cache with network_info: [{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:25.609966 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'flavor' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:25.831517 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Found WWN 330000000f76b9838 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:02:25.831929 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.035s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:25.832260 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] <== connect_volume: return (4036ms) {'type': 'block', 'scsi_wwn': '330000000f76b9838', 'path': '/dev/dm-0', 'multipath_id': '330000000f76b9838'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:02:25.832598 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f76b9838', 'path': '/dev/dm-0', 'multipath_id': '330000000f76b9838'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:02:25.832928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.780s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:25.833153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5040d323-2b77-4acd-90da-38f38e2680f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:02:25.846103 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:25.846628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:25.846815 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:02:25.847663 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:25.850251 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:25.850251 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:02:25.856088 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:02:25.856088 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:25.861883 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:02:25.861883 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:25.865870 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1] added
May 27 23:02:25.865870 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:02:25.865870 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:25.865870 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:25.865870 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:25.865870 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:25.865870 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:25.866061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:02:25.866221 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0194(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:02:25.866399 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:02:25.871733 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1] added
May 27 23:02:25.871733 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:02:25.871733 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:25.871733 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:25.871733 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:25.871733 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:25.871733 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:25.872006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:02:25.872006 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0224(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:02:25.872078 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:02:26.065113 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Releasing lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:26.065350 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance network_info: |[{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:02:26.067195 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Start _get_guest_xml network_info=[{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:02:26.068912 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:02:26.070021 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-373770128', uuid='80c6eabe-0192-4030-a194-2d87bb638464'), owner=OwnerMeta(userid='6fb24b22559e4715a196b40ce9948d74', username='tempest-ServerActionsTestOtherB-1638868194-project-member', projectid='9dbf5952ce9242a38d3c1881a1604223', projectname='tempest-ServerActionsTestOtherB-1638868194'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922946.0696974) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:02:26.071063 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:02:26.071478 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:02:26.072198 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:02:26.072448 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:02:26.073494 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:02:26.073707 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:02:26.073845 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:02:26.073931 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:02:26.074073 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:02:26.074164 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:02:26.074265 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:02:26.074485 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:02:26.074543 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:02:26.074628 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:02:26.074777 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:02:26.074836 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:02:26.086755 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-373770128',display_name='tempest-ServerActionsTestOtherB-server-373770128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestotherb-server-373770128',id=16,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkuCpnXkvttUUkvybNqerRfpglzcntgI2LbNRFPS1WvoMpreQBqFxBf2ldcA5vcM/zSM/QMd+MwRw2lJY1injdu+2h30nJE+SFIeu7eI9MVi5k22eYdTlR/lcnOcp4shQ==',key_name='tempest-keypair-47837674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dbf5952ce9242a38d3c1881a1604223',ramdisk_id='',reservation_id='r-qn417ctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1638868194',owner_user_name='tempest-ServerActionsTestOtherB-1638868194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb24b22559e4715a196b40ce9948d74',uuid=80c6eabe-0192-4030-a194-2d87bb638464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:02:26.086898 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converting VIF {"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:26.087351 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:26.087865 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lazy-loading 'pci_devices' on Instance uuid 80c6eabe-0192-4030-a194-2d87bb638464 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:26.316690 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:26.317065 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:26.317065 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No VIF found with MAC fa:16:3e:97:51:12, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:02:26.317351 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Using config drive
May 27 23:02:26.338672 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-652051971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-652051971',id=13,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-k00lkx6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:16Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=7cb7c255-4b3c-493e-9a31-e554576a0525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:02:26.338886 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:26.339378 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ff:85,bridge_name='br-int',has_traffic_filtering=True,id=fe17e03b-0353-4478-8ccb-48bb8622d814,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe17e03b-03') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:26.339851 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:26.590802 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] End _get_guest_xml xml=<domain type="qemu">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <uuid>80c6eabe-0192-4030-a194-2d87bb638464</uuid>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <name>instance-00000010</name>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerActionsTestOtherB-server-373770128</nova:name>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:02:26</nova:creationTime>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:user uuid="6fb24b22559e4715a196b40ce9948d74">tempest-ServerActionsTestOtherB-1638868194-project-member</nova:user>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:project uuid="9dbf5952ce9242a38d3c1881a1604223">tempest-ServerActionsTestOtherB-1638868194</nova:project>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         <nova:port uuid="61892495-669a-42b8-9d49-04d6990d3b8f">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <system>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <entry name="serial">80c6eabe-0192-4030-a194-2d87bb638464</entry>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <entry name="uuid">80c6eabe-0192-4030-a194-2d87bb638464</entry>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     </system>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <os>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   </os>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <features>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   </features>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   <devices>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:c3:7f:1b"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <target dev="tap61892495-66"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     </interface>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/console.log" append="off"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     </serial>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <video>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     </video>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     </rng>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:   </devices>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]: </domain>
May 27 23:02:26.590802 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:02:26.592718 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Preparing to wait for external event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:02:26.592718 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:26.592718 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:26.592718 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:26.592718 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-373770128',display_name='tempest-ServerActionsTestOtherB-server-373770128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestotherb-server-373770128',id=16,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkuCpnXkvttUUkvybNqerRfpglzcntgI2LbNRFPS1WvoMpreQBqFxBf2ldcA5vcM/zSM/QMd+MwRw2lJY1injdu+2h30nJE+SFIeu7eI9MVi5k22eYdTlR/lcnOcp4shQ==',key_name='tempest-keypair-47837674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dbf5952ce9242a38d3c1881a1604223',ramdisk_id='',reservation_id='r-qn417ctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1638868194',owner_user_name='tempest-ServerActionsTestOtherB-1638868194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb24b22559e4715a196b40ce9948d74',uuid=80c6eabe-0192-4030-a194-2d87bb638464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:02:26.593087 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converting VIF {"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:26.593179 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:26.593467 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:02:26.593728 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.593930 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:26.594142 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:02:26.594810 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.595143 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0c4fd31-295a-5627-9c1c-b82a07e8038a', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:26.596018 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.596824 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:26.601465 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.603791 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.604014 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61892495-66, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:26.604320 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61892495-66, col_values=(('qos', UUID('900e8bc6-4abf-4db9-bd20-cd8631e9a7cc')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:26.604570 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61892495-66, col_values=(('external_ids', {'iface-id': '61892495-669a-42b8-9d49-04d6990d3b8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:7f:1b', 'vm-uuid': '80c6eabe-0192-4030-a194-2d87bb638464'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:26.605452 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.607038 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:26.615380 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:26.616623 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.617876 np0000001565 nova-compute[98289]: INFO os_vif [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66')
May 27 23:02:26.822257 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:26.842751 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] End _get_guest_xml xml=<domain type="qemu">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <uuid>7cb7c255-4b3c-493e-9a31-e554576a0525</uuid>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <name>instance-0000000d</name>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-652051971</nova:name>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:02:21</nova:creationTime>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:user uuid="6037b0819a94463e8e45d96f834c4341">tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member</nova:user>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:project uuid="9818a7ed096346eb92128648c4280071">tempest-ServerBootFromVolumeStableRescueTest-800872693</nova:project>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         <nova:port uuid="fe17e03b-0353-4478-8ccb-48bb8622d814">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <system>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <entry name="serial">7cb7c255-4b3c-493e-9a31-e554576a0525</entry>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <entry name="uuid">7cb7c255-4b3c-493e-9a31-e554576a0525</entry>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     </system>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <os>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   </os>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <features>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   </features>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   <devices>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.config"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <alias name="ua-7b3985f1-9dc4-481b-9837-6caf308cc632"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <serial>7b3985f1-9dc4-481b-9837-6caf308cc632</serial>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:a8:ff:85"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <target dev="tapfe17e03b-03"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     </interface>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/console.log" append="off"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     </serial>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <video>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     </video>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     </rng>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:   </devices>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]: </domain>
May 27 23:02:26.842751 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:02:26.845926 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Preparing to wait for external event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:02:26.845926 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:26.845926 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:26.845926 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:26.845926 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-652051971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-652051971',id=13,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-k00lkx6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:16Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=7cb7c255-4b3c-493e-9a31-e554576a0525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:02:26.846366 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:26.846366 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ff:85,bridge_name='br-int',has_traffic_filtering=True,id=fe17e03b-0353-4478-8ccb-48bb8622d814,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe17e03b-03') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:26.846366 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ff:85,bridge_name='br-int',has_traffic_filtering=True,id=fe17e03b-0353-4478-8ccb-48bb8622d814,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe17e03b-03') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:02:26.846366 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.846366 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:26.847212 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:02:26.847294 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.847679 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69dbb438-0f07-564c-9ed6-9481a4e3969b', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:26.850739 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.851421 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:26.858992 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.861736 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.862360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe17e03b-03, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:26.862360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe17e03b-03, col_values=(('qos', UUID('4c47e2b2-d17b-4fb5-b51a-cb85404ce7d1')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:26.862360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe17e03b-03, col_values=(('external_ids', {'iface-id': 'fe17e03b-0353-4478-8ccb-48bb8622d814', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:ff:85', 'vm-uuid': '7cb7c255-4b3c-493e-9a31-e554576a0525'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:26.863123 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.864202 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:26.866938 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:02:26.872658 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:02:26.880362 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:26.880362 np0000001565 nova-compute[98289]: INFO os_vif [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ff:85,bridge_name='br-int',has_traffic_filtering=True,id=fe17e03b-0353-4478-8ccb-48bb8622d814,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe17e03b-03')
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:02:26.881061 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:02:26.881061 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:02:26.886445 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:02:26.886445 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:26.893022 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:26.904779 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:26.911086 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.911086 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.911086 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:26.911232 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.911232 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.911232 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:26.919480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.919480 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.919480 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:26.919480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.919480 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.919480 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:26.951836 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1, portal: 192.168.40.100,3260]
May 27 23:02:26.951836 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1, portal: 192.168.40.100,3260] successful.
May 27 23:02:26.951836 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:26.961119 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Creating config drive at /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk.config
May 27 23:02:26.963839 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1, portal: 192.168.50.100,3260]
May 27 23:02:26.963839 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1, portal: 192.168.50.100,3260] successful.
May 27 23:02:26.963839 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:26.967761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj9izs2xv {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:26.981217 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:26.982244 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:26.998133 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.998133 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.998133 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:26.998133 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:26.998133 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:26.998133 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.998133 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:26.998133 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:26.998133 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:26.998133 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:27.001278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:27.001278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:02:27.001278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('9', '-', '-', 0) found on session 18 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:02:27.001278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:02:27.001278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:27.001278 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:27.001278 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:27.001278 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:27.001278 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:27.002790 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:27.002790 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:27.002790 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:27.002790 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:27.002790 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:27.002790 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:27.002790 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:02:27.003157 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('10', '-', '-', 0) found on session 19 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:02:27.003372 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:02:27.011660 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj9izs2xv" returned: 0 in 0.044s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:27.017910 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 18 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:02:27.020489 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5040d323-2b77-4acd-90da-38f38e2680f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:02:27.028653 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 19 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:02:27.028653 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5040d323-2b77-4acd-90da-38f38e2680f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:02:27.442828 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:27.477177 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:27.477977 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:27.549349 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:27.724662 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:27.725294 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:27.725294 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Attaching volume 34cb2b43-4dd5-4c09-90bb-1915fc834e97 to /dev/vdb
May 27 23:02:27.726684 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:27.737151 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:27.739378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:27.762571 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:27.770567 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:02:27.771753 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:27.787884 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:02:27.809211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:27.840632 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:02:27.840991 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:02:27.850247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:02:27.850247 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe47:f045', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b'] 
May 27 23:02:27.851229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:02:27.851484 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:02:27.854676 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:02:27.854676 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updating existing volume attachment record: d4291004-d8e9-4045-8726-d73d18e03f1e {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:02:27.855318 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:02:28.100635 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:28.139591 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:28.139754 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:28.139906 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] No VIF found with MAC fa:16:3e:c3:7f:1b, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:02:28.140548 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Using config drive
May 27 23:02:28.210852 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922948.2104897, 3eb890c1-c528-489f-8109-4b7870bfcf33 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:28.212161 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] VM Started (Lifecycle Event)
May 27 23:02:28.397777 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:02:28.398095 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:02:28.398252 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:28.402936 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:28.403031 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:28.403126 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No VIF found with MAC fa:16:3e:a8:ff:85, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:02:28.403564 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Using config drive
May 27 23:02:28.652528 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:28.713886 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:28.715264 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922948.7150064, 3eb890c1-c528-489f-8109-4b7870bfcf33 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:28.715325 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] VM Paused (Lifecycle Event)
May 27 23:02:28.810834 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Creating config drive at /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config
May 27 23:02:28.814233 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3k1v_60o {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:28.856601 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3e0235ae-eca7-46ef-9a87-df1805bb9715 req-ed652c95-3365-46d7-be38-27d8b54df598 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Received event network-vif-plugged-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:28.856601 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e0235ae-eca7-46ef-9a87-df1805bb9715 req-ed652c95-3365-46d7-be38-27d8b54df598 service nova] Acquiring lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:28.856601 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e0235ae-eca7-46ef-9a87-df1805bb9715 req-ed652c95-3365-46d7-be38-27d8b54df598 service nova] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:28.858393 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e0235ae-eca7-46ef-9a87-df1805bb9715 req-ed652c95-3365-46d7-be38-27d8b54df598 service nova] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:28.859392 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3k1v_60o" returned: 0 in 0.044s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:28.859752 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3e0235ae-eca7-46ef-9a87-df1805bb9715 req-ed652c95-3365-46d7-be38-27d8b54df598 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Processing event network-vif-plugged-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:02:28.862865 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:02:28.866272 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:02:28.869647 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Instance spawned successfully.
May 27 23:02:28.869933 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:02:28.878065 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found WWN 3300000004bdaf1bd for multipath device dm-1 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:02:28.878493 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:28.878751 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== connect_volume: return (6825ms) {'type': 'block', 'scsi_wwn': '3300000004bdaf1bd', 'path': '/dev/dm-1', 'multipath_id': '3300000004bdaf1bd'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:02:28.878845 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004bdaf1bd', 'path': '/dev/dm-1', 'multipath_id': '3300000004bdaf1bd'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:02:28.881096 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.483s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:28.881344 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:02:28.903372 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:28.903845 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:28.904604 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:28.905187 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:02:28.905754 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:28.915558 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:28.918531 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:02:28.927229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:02:28.927229 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:28.933643 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:02:28.933643 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:28.942290 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97] added
May 27 23:02:28.942290 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:02:28.942290 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:28.942290 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:28.942290 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:28.942290 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:28.942290 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:28.942290 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:02:28.943072 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0369(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:02:28.943314 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:02:28.945631 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97] added
May 27 23:02:28.945631 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:02:28.945631 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:28.945631 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:28.945631 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:02:28.945631 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:02:28.945631 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:28.945862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:02:28.946450 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:02:28.946450 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:02:29.178450 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Creating config drive at /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.config
May 27 23:02:29.181729 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3m1_nvj_ {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:29.219789 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:29.220687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3m1_nvj_" returned: 0 in 0.039s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:29.223802 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922949.2234902, 3eb890c1-c528-489f-8109-4b7870bfcf33 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:29.223952 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] VM Resumed (Lifecycle Event)
May 27 23:02:29.324963 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.359732 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.380391 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:29.380482 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:29.380790 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:29.380993 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:29.381243 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:29.381673 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:29.388076 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-120023004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumemultiattachtest-server-120023004',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-gn4el310',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:18Z,user_data=None,user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=f47a00cc-da92-40c9-a668-9a160670addd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "address": "fa:16:3e:94:3e:4d", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap409f0bf7-c0", "ovs_interfaceid": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:02:29.388259 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "address": "fa:16:3e:94:3e:4d", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap409f0bf7-c0", "ovs_interfaceid": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:29.388834 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=409f0bf7-c0d0-4da5-97f5-9608b91ea67c,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409f0bf7-c0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:29.390606 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'pci_devices' on Instance uuid f47a00cc-da92-40c9-a668-9a160670addd {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:29.626526 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.686777 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.697910 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.702218 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.731268 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:29.732931 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.737203 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:29.741009 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.866382 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.895879 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Took 8.18 seconds to spawn the instance on the hypervisor.
May 27 23:02:29.896064 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:29.896953 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.898926 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] End _get_guest_xml xml=<domain type="qemu">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <uuid>f47a00cc-da92-40c9-a668-9a160670addd</uuid>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <name>instance-0000000e</name>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-120023004</nova:name>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:02:22</nova:creationTime>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:user uuid="2c6d94c1e6da4237aa5dd517c31e03d7">tempest-AttachVolumeMultiAttachTest-781715127-project-member</nova:user>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:project uuid="0ec877dc7b2240969ac89c13673f8799">tempest-AttachVolumeMultiAttachTest-781715127</nova:project>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         <nova:port uuid="409f0bf7-c0d0-4da5-97f5-9608b91ea67c">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <system>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <entry name="serial">f47a00cc-da92-40c9-a668-9a160670addd</entry>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <entry name="uuid">f47a00cc-da92-40c9-a668-9a160670addd</entry>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     </system>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <os>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   </os>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <features>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   </features>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   <devices>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/f47a00cc-da92-40c9-a668-9a160670addd/disk.config"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <alias name="ua-5040d323-2b77-4acd-90da-38f38e2680f1"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-1"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <serial>5040d323-2b77-4acd-90da-38f38e2680f1</serial>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <shareable/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:94:3e:4d"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <target dev="tap409f0bf7-c0"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     </interface>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/f47a00cc-da92-40c9-a668-9a160670addd/console.log" append="off"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     </serial>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <video>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     </video>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     </rng>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:   </devices>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]: </domain>
May 27 23:02:29.898926 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:02:29.902243 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Preparing to wait for external event network-vif-plugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:02:29.902243 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "f47a00cc-da92-40c9-a668-9a160670addd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:29.902243 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:29.902243 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:29.902243 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-120023004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumemultiattachtest-server-120023004',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-gn4el310',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:18Z,user_data=None,user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=f47a00cc-da92-40c9-a668-9a160670addd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "address": "fa:16:3e:94:3e:4d", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap409f0bf7-c0", "ovs_interfaceid": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:02:29.902670 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "address": "fa:16:3e:94:3e:4d", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap409f0bf7-c0", "ovs_interfaceid": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:29.902670 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=409f0bf7-c0d0-4da5-97f5-9608b91ea67c,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409f0bf7-c0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:29.902670 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=409f0bf7-c0d0-4da5-97f5-9608b91ea67c,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409f0bf7-c0') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:02:29.902670 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.902670 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:29.902670 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:02:29.908176 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.908176 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f901acd6-2a63-55e7-8706-43bb127e922c', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:29.910188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.911253 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:29.915277 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.915277 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap409f0bf7-c0, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:29.915584 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap409f0bf7-c0, col_values=(('qos', UUID('40940519-6253-4f06-8383-f9debca9ed98')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:29.915757 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap409f0bf7-c0, col_values=(('external_ids', {'iface-id': '409f0bf7-c0d0-4da5-97f5-9608b91ea67c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:3e:4d', 'vm-uuid': 'f47a00cc-da92-40c9-a668-9a160670addd'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:29.916718 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.918413 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:29.923467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:29.924823 np0000001565 nova-compute[98289]: INFO os_vif [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=409f0bf7-c0d0-4da5-97f5-9608b91ea67c,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409f0bf7-c0')
May 27 23:02:29.943763 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:02:29.946999 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:02:29.961950 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:02:29.961950 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:02:29.965876 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:02:29.965876 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:29.974994 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:29.980514 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:29.989942 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:29.989942 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:29.989942 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:29.989942 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:29.989942 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:29.990108 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:29.990108 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:29.990108 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:29.990108 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:29.990108 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:29.999225 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:30.002490 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.002490 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.002490 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.002490 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.002490 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:30.002683 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.002683 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.002683 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.002683 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.002683 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:30.026877 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97, portal: 192.168.40.100,3260]
May 27 23:02:30.026877 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97, portal: 192.168.40.100,3260] successful.
May 27 23:02:30.026877 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:30.030064 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:30.039105 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:30.046955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97, portal: 192.168.50.100,3260]
May 27 23:02:30.046955 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97, portal: 192.168.50.100,3260] successful.
May 27 23:02:30.046955 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:30.047667 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:30.061580 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:30.061580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:02:30.062121 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] HCTL ('11', '-', '-', 0) found on session 20 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:02:30.062313 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:02:30.063027 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:30.083596 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.083596 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.083596 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.083596 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.083596 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:30.083596 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:30.083596 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:30.083909 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.083909 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:30.083909 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.083909 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:30.083909 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:30.083909 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:30.083909 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:30.084372 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:30.084625 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:02:30.085282 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] HCTL ('12', '-', '-', 0) found on session 21 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:02:30.085636 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:02:30.094044 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching for a device in session 20 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:02:30.094044 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:02:30.102888 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching for a device in session 21 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:02:30.102888 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:02:30.126848 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:30.241377 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:02:30.414091 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Took 16.65 seconds to build instance.
May 27 23:02:30.735995 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922950.7356987, 80c6eabe-0192-4030-a194-2d87bb638464 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:30.736298 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] VM Started (Lifecycle Event)
May 27 23:02:30.908581 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:02:30.915888 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.163s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:30.927162 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Received event network-vif-plugged-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:30.927345 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] Acquiring lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:30.928175 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:30.928317 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:30.928453 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] No waiting events found dispatching network-vif-plugged-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:30.929352 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Received unexpected event network-vif-plugged-a94e67a9-7aeb-4935-b3f6-a13811736551 for instance with vm_state active and task_state None.
May 27 23:02:30.929352 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:30.929352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:30.929352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:30.929352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:30.929352 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Processing event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:02:30.930063 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:30.930844 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:02:30.930996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:30.931166 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:30.931926 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:30.931926 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] No waiting events found dispatching network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:30.931926 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-97ebb890-5e2b-47f7-9b55-4e461d832f6b req-11743d6d-e4fa-452b-8f41-b7ec4a52fdd1 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received unexpected event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 for instance with vm_state building and task_state spawning.
May 27 23:02:30.934064 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:02:30.938559 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Instance spawned successfully.
May 27 23:02:30.938559 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:02:31.241175 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:31.244428 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922951.2441318, 80c6eabe-0192-4030-a194-2d87bb638464 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:31.244569 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] VM Paused (Lifecycle Event)
May 27 23:02:31.445226 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:31.445340 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:31.445633 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:31.445842 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:31.446113 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:31.446347 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:31.450997 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:31.451131 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:31.451239 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:94:3e:4d, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:02:31.451595 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Using config drive
May 27 23:02:31.523315 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4f59c669-1e9b-4fe6-aab7-a94bfd2ef227 req-dbf1c945-02fd-4ecd-b6be-fe609bd79ad6 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Received event network-changed-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:31.523843 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4f59c669-1e9b-4fe6-aab7-a94bfd2ef227 req-dbf1c945-02fd-4ecd-b6be-fe609bd79ad6 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Refreshing instance network info cache due to event network-changed-a94e67a9-7aeb-4935-b3f6-a13811736551. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:02:31.524056 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4f59c669-1e9b-4fe6-aab7-a94bfd2ef227 req-dbf1c945-02fd-4ecd-b6be-fe609bd79ad6 service nova] Acquiring lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:31.524205 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4f59c669-1e9b-4fe6-aab7-a94bfd2ef227 req-dbf1c945-02fd-4ecd-b6be-fe609bd79ad6 service nova] Acquired lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:31.524389 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4f59c669-1e9b-4fe6-aab7-a94bfd2ef227 req-dbf1c945-02fd-4ecd-b6be-fe609bd79ad6 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Refreshing network info cache for port a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:02:31.747098 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:31.748388 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:31.922691 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Found WWN 3300000006d839091 for multipath device dm-4 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:02:31.922970 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:31.923160 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] <== connect_volume: return (3524ms) {'type': 'block', 'scsi_wwn': '3300000006d839091', 'path': '/dev/dm-4', 'multipath_id': '3300000006d839091'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:02:31.923288 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d839091', 'path': '/dev/dm-4', 'multipath_id': '3300000006d839091'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:02:31.924963 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'flavor' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:31.951704 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Took 10.18 seconds to spawn the instance on the hypervisor.
May 27 23:02:31.951821 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:31.956594 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:32.027205 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4f59c669-1e9b-4fe6-aab7-a94bfd2ef227 req-dbf1c945-02fd-4ecd-b6be-fe609bd79ad6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:32.084002 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Creating config drive at /opt/stack/data/nova/instances/f47a00cc-da92-40c9-a668-9a160670addd/disk.config
May 27 23:02:32.088512 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f47a00cc-da92-40c9-a668-9a160670addd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphxtmweyt {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:32.131151 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f47a00cc-da92-40c9-a668-9a160670addd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphxtmweyt" returned: 0 in 0.042s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:32.250861 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:02:32.251202 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922952.2509985, 7cb7c255-4b3c-493e-9a31-e554576a0525 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:32.251309 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] VM Started (Lifecycle Event)
May 27 23:02:32.429801 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4f59c669-1e9b-4fe6-aab7-a94bfd2ef227 req-dbf1c945-02fd-4ecd-b6be-fe609bd79ad6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:32.433278 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Attempting to attach volume 34cb2b43-4dd5-4c09-90bb-1915fc834e97 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:02:32.436924 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:02:32.436924 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:02:32.436924 np0000001565 nova-compute[98289]:   <alias name="ua-34cb2b43-4dd5-4c09-90bb-1915fc834e97"/>
May 27 23:02:32.436924 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-4"/>
May 27 23:02:32.436924 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:02:32.436924 np0000001565 nova-compute[98289]:   <serial>34cb2b43-4dd5-4c09-90bb-1915fc834e97</serial>
May 27 23:02:32.436924 np0000001565 nova-compute[98289]: </disk>
May 27 23:02:32.436924 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:02:32.467377 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Took 22.28 seconds to build instance.
May 27 23:02:32.586315 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4f59c669-1e9b-4fe6-aab7-a94bfd2ef227 req-dbf1c945-02fd-4ecd-b6be-fe609bd79ad6 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Updated VIF entry in instance network info cache for port a94e67a9-7aeb-4935-b3f6-a13811736551. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:02:32.586650 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4f59c669-1e9b-4fe6-aab7-a94bfd2ef227 req-dbf1c945-02fd-4ecd-b6be-fe609bd79ad6 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Updating instance_info_cache with network_info: [{"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:32.743038 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:32.756048 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:32.761487 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:32.776867 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:32.780974 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:32.864708 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:32.969112 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.786s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:33.089096 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4f59c669-1e9b-4fe6-aab7-a94bfd2ef227 req-dbf1c945-02fd-4ecd-b6be-fe609bd79ad6 service nova] Releasing lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:33.109206 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:33.172814 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:33.223127 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:33.226896 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:33.250128 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:33.252210 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:33.263004 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922953.2627192, 7cb7c255-4b3c-493e-9a31-e554576a0525 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:33.263132 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] VM Paused (Lifecycle Event)
May 27 23:02:33.767592 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:33.769067 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922953.7688565, 7cb7c255-4b3c-493e-9a31-e554576a0525 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:33.769538 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] VM Resumed (Lifecycle Event)
May 27 23:02:34.034271 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Rescuing
May 27 23:02:34.034501 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:34.034638 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquired lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:34.034787 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:02:34.271809 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:34.274278 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:34.289316 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:34.289426 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:34.290104 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:34.290472 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No VIF found with MAC fa:16:3e:47:f0:45, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:02:34.537116 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:34.777035 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] During sync_power_state the instance has a pending task (rescuing). Skip.
May 27 23:02:34.777504 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922954.7771516, f47a00cc-da92-40c9-a668-9a160670addd => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:34.777504 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f47a00cc-da92-40c9-a668-9a160670addd] VM Started (Lifecycle Event)
May 27 23:02:34.864900 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:34.918094 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:34.934645 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:35.009371 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Updating instance_info_cache with network_info: [{"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:35.279757 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:35.281025 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922955.2808511, f47a00cc-da92-40c9-a668-9a160670addd => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:35.281127 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f47a00cc-da92-40c9-a668-9a160670addd] VM Paused (Lifecycle Event)
May 27 23:02:35.513815 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Releasing lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:35.726878 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c761e32d-a9a6-4106-9f97-c82a66850f6c req-276ff08f-a05c-4460-b4ad-4e0aa80d1b36 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:35.727412 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c761e32d-a9a6-4106-9f97-c82a66850f6c req-276ff08f-a05c-4460-b4ad-4e0aa80d1b36 service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:35.727576 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c761e32d-a9a6-4106-9f97-c82a66850f6c req-276ff08f-a05c-4460-b4ad-4e0aa80d1b36 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:35.727704 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c761e32d-a9a6-4106-9f97-c82a66850f6c req-276ff08f-a05c-4460-b4ad-4e0aa80d1b36 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:35.727822 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c761e32d-a9a6-4106-9f97-c82a66850f6c req-276ff08f-a05c-4460-b4ad-4e0aa80d1b36 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Processing event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:02:35.728193 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:02:35.731028 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:02:35.732808 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance spawned successfully.
May 27 23:02:35.733152 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:02:35.783651 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:35.786428 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:35.853501 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-09e39693-4a4c-4822-8032-f15954e21126 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.128s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:36.245354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:36.245354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:36.245354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:36.245354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:36.245354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:36.245354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:36.288531 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f47a00cc-da92-40c9-a668-9a160670addd] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:02:36.288825 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922956.2886162, 80c6eabe-0192-4030-a194-2d87bb638464 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:36.288974 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] VM Resumed (Lifecycle Event)
May 27 23:02:36.681284 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Rescuing
May 27 23:02:36.681513 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:36.681680 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquired lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:36.681845 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:02:36.752065 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Took 12.46 seconds to spawn the instance on the hypervisor.
May 27 23:02:36.752288 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:36.793079 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:36.794756 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:37.130262 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:37.133657 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:37.162633 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:37.184146 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:37.264856 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Took 21.19 seconds to build instance.
May 27 23:02:37.339372 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:37.345297 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:37.429351 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:37.444012 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:37.461164 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999582996000072 future=<Future at 0x726e601eb410 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:37.461970 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998787167000046 future=<Future at 0x726e601eb410 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:37.462130 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998576817999947 future=<Future at 0x726e601eb410 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:37.464077 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Instance destroyed successfully.
May 27 23:02:37.464515 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'numa_topology' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:37.564943 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:37.702094 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updating instance_info_cache with network_info: [{"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:37.766585 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d9b6237-c029-4ec3-9a1f-a358ec7ff766 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.702s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:37.812309 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:37.812886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:37.812886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:37.813096 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:37.813096 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] No waiting events found dispatching network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:37.813413 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received unexpected event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f for instance with vm_state active and task_state None.
May 27 23:02:37.813511 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Received event network-vif-plugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:37.813945 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] Acquiring lock "f47a00cc-da92-40c9-a668-9a160670addd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:37.814352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:37.814352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:37.814493 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Processing event network-vif-plugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:02:37.814646 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Received event network-vif-plugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:37.814802 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] Acquiring lock "f47a00cc-da92-40c9-a668-9a160670addd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:37.815141 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:37.815250 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:37.815824 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] No waiting events found dispatching network-vif-plugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:37.816067 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9a5cf96a-852b-4d82-87b0-3f30cd8f6e23 req-c8f2ee3b-825a-4fcc-ac99-3425b1df2cde service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Received unexpected event network-vif-plugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c for instance with vm_state building and task_state spawning.
May 27 23:02:37.816831 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:02:37.825285 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922957.8237164, f47a00cc-da92-40c9-a668-9a160670addd => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:37.825285 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:02:37.825285 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f47a00cc-da92-40c9-a668-9a160670addd] VM Resumed (Lifecycle Event)
May 27 23:02:37.829996 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Instance spawned successfully.
May 27 23:02:37.830448 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:02:37.969916 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Attempting a stable device rescue
May 27 23:02:38.088704 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98289) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 23:02:38.093183 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Instance directory exists: not creating {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 23:02:38.093340 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Creating image(s)
May 27 23:02:38.093941 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:38.094081 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:38.094596 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:38.094782 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:38.122764 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:38.204159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Releasing lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:38.327624 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:38.329998 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:38.338627 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:38.339093 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:38.339093 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:38.339390 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:38.339731 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:38.340026 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:38.535764 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6c1265e9-e24e-4287-a5bb-85e8a7700b02 req-64cef3f7-ca3a-452a-880b-5356cfd0535b service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-changed-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:38.535915 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6c1265e9-e24e-4287-a5bb-85e8a7700b02 req-64cef3f7-ca3a-452a-880b-5356cfd0535b service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Refreshing instance network info cache due to event network-changed-61892495-669a-42b8-9d49-04d6990d3b8f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:02:38.536309 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6c1265e9-e24e-4287-a5bb-85e8a7700b02 req-64cef3f7-ca3a-452a-880b-5356cfd0535b service nova] Acquiring lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:38.536500 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6c1265e9-e24e-4287-a5bb-85e8a7700b02 req-64cef3f7-ca3a-452a-880b-5356cfd0535b service nova] Acquired lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:38.536865 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6c1265e9-e24e-4287-a5bb-85e8a7700b02 req-64cef3f7-ca3a-452a-880b-5356cfd0535b service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Refreshing network info cache for port 61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:02:38.598365 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<7cb7c255-4b3c-493e-9a31-e554576a0525> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:38.598365 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "e011a015d7cca9cc8457183c4b0426c4a4833291" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:38.598365 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "e011a015d7cca9cc8457183c4b0426c4a4833291" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:38.725110 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:38.833472 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f47a00cc-da92-40c9-a668-9a160670addd] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:02:38.845886 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Took 18.02 seconds to spawn the instance on the hypervisor.
May 27 23:02:38.846121 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:39.042400 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-6c1265e9-e24e-4287-a5bb-85e8a7700b02 req-64cef3f7-ca3a-452a-880b-5356cfd0535b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:39.362456 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Took 26.52 seconds to build instance.
May 27 23:02:39.390705 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:39.393479 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:39.393832 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291.part --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:39.509713 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291.part --force-share --output=json" returned: 0 in 0.115s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:39.510159 np0000001565 nova-compute[98289]: DEBUG nova.virt.images [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] 86e025ad-e918-4946-8ca9-a304df8b63a4 was qcow2, converting to raw {{(pid=98289) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 23:02:39.510829 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:02:39.511130 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291.part /opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291.converted {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:39.586186 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291.part /opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291.converted" returned: 0 in 0.075s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:39.592132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291.converted --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:39.676261 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291.converted --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:39.676940 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "e011a015d7cca9cc8457183c4b0426c4a4833291" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.079s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:39.677193 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:39.679940 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:39.681010 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "e011a015d7cca9cc8457183c4b0426c4a4833291" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:39.681428 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "e011a015d7cca9cc8457183c4b0426c4a4833291" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:39.681635 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:39.684033 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:39.684325 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:39.701369 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-6c1265e9-e24e-4287-a5bb-85e8a7700b02 req-64cef3f7-ca3a-452a-880b-5356cfd0535b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:39.783918 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291 --force-share --output=json" returned: 0 in 0.099s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:39.784358 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291,backing_fmt=raw /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.rescue {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:39.829249 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e011a015d7cca9cc8457183c4b0426c4a4833291,backing_fmt=raw /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.rescue" returned: 0 in 0.045s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:39.829631 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "e011a015d7cca9cc8457183c4b0426c4a4833291" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:39.829917 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'migration_context' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:39.864023 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:39.866894 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "f47a00cc-da92-40c9-a668-9a160670addd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.029s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:39.870438 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:39.892483 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:39.924581 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:39.946471 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6c1265e9-e24e-4287-a5bb-85e8a7700b02 req-64cef3f7-ca3a-452a-880b-5356cfd0535b service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updated VIF entry in instance network info cache for port 61892495-669a-42b8-9d49-04d6990d3b8f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:02:39.947755 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6c1265e9-e24e-4287-a5bb-85e8a7700b02 req-64cef3f7-ca3a-452a-880b-5356cfd0535b service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating instance_info_cache with network_info: [{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:40.058450 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:40.072696 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:40.234427 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999588986999925 future=<Future at 0x726e60179220 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:40.236072 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Instance destroyed successfully.
May 27 23:02:40.236616 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'numa_topology' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:40.333762 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<7cb7c255-4b3c-493e-9a31-e554576a0525> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:40.334105 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:02:40.334974 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Start _get_guest_xml network_info=[{"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "vif_mac": "fa:16:3e:a8:ff:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '86e025ad-e918-4946-8ca9-a304df8b63a4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ff092818-71ae-4a12-bb7d-e99244f31543', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '7cb7c255-4b3c-493e-9a31-e554576a0525', 'attached_at': '', 'detached_at': '', 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'serial': '7b3985f1-9dc4-481b-9837-6caf308cc632'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:02:40.335178 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'resources' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:40.451926 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6c1265e9-e24e-4287-a5bb-85e8a7700b02 req-64cef3f7-ca3a-452a-880b-5356cfd0535b service nova] Releasing lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:40.732587 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:40.741844 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Attempting rescue
May 27 23:02:40.742960 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98289) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 23:02:40.749609 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Instance directory exists: not creating {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 23:02:40.750059 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Creating image(s)
May 27 23:02:40.751018 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:40.751599 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:40.752542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:40.752880 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'trusted_certs' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:40.837976 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<7cb7c255-4b3c-493e-9a31-e554576a0525> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:40.840572 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:02:40.843621 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-652051971', uuid='7cb7c255-4b3c-493e-9a31-e554576a0525'), owner=OwnerMeta(userid='6037b0819a94463e8e45d96f834c4341', username='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member', projectid='9818a7ed096346eb92128648c4280071', projectname='tempest-ServerBootFromVolumeStableRescueTest-800872693'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "vif_mac": "fa:16:3e:a8:ff:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922960.842168) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:02:40.845362 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:02:40.845772 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:02:40.847366 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:02:40.847583 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:02:40.848644 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:02:40.848976 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:02:40.849082 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:02:40.849200 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:02:40.849250 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:02:40.849341 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:02:40.849614 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:02:40.849711 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:02:40.849833 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:02:40.849931 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:02:40.850031 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:02:40.850139 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:02:40.850269 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:41.255466 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<602b3e68-4ea1-48f7-a212-af3d9f8ddf7d> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:41.255969 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:41.261027 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:41.261896 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:41.262852 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:41.262852 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:41.266000 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:41.266373 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:41.348884 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:41.351499 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.rescue {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:41.364936 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<7cb7c255-4b3c-493e-9a31-e554576a0525> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:41.386267 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:41.399118 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.rescue" returned: 0 in 0.047s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:41.400098 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.138s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:41.400736 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'migration_context' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:41.470411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.config --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:41.471796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:41.471796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:41.472117 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:41.472682 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:02:41.473201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:02:41.473441 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:41.473883 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:41.474186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:02:41.491968 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:41.492998 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:02:41.494252 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:41.494252 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:02:41.494609 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:02:41.494804 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:02:41.511710 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:02:41.511710 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:02:41.516656 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:02:41.516656 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:41.528435 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:41.545841 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:41.545841 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:41.545841 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:41.545841 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:41.545841 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:41.545841 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:41.545841 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:41.546169 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:41.546169 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:41.546169 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:41.546169 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:41.546169 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:41.546169 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:41.546169 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:41.546291 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.053s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:41.546363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:02:41.547144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] HCTL ('8', '0', '0', 0) found on session 17 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:02:41.548196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:02:41.548196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:02:41.558379 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching for a device in session 17 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:02:41.558587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:02:41.571301 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:41.571301 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:41.571301 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:41.571301 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:41.571301 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:41.571301 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:41.571301 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:02:41.571583 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:41.571583 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:02:41.571583 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:41.571583 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:02:41.571583 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:41.571583 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:02:41.571583 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:02:41.571855 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.077s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:41.571998 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:02:41.572920 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] HCTL ('7', '0', '0', 0) found on session 16 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:02:41.573038 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:02:41.586934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching for a device in session 16 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:02:41.587085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:02:41.905598 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<602b3e68-4ea1-48f7-a212-af3d9f8ddf7d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:41.905855 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:02:41.909630 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Start _get_guest_xml network_info=[{"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:47:f0:45"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:02:41.910904 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'resources' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:42.081316 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-40fe0293-624c-41cf-b8dc-368ed9945f21 req-7a8d178f-4f74-4848-a9c7-f29b8bf18469 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:42.081532 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40fe0293-624c-41cf-b8dc-368ed9945f21 req-7a8d178f-4f74-4848-a9c7-f29b8bf18469 service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:42.081686 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40fe0293-624c-41cf-b8dc-368ed9945f21 req-7a8d178f-4f74-4848-a9c7-f29b8bf18469 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:42.082738 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40fe0293-624c-41cf-b8dc-368ed9945f21 req-7a8d178f-4f74-4848-a9c7-f29b8bf18469 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:42.083028 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-40fe0293-624c-41cf-b8dc-368ed9945f21 req-7a8d178f-4f74-4848-a9c7-f29b8bf18469 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] No waiting events found dispatching network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:42.083617 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-40fe0293-624c-41cf-b8dc-368ed9945f21 req-7a8d178f-4f74-4848-a9c7-f29b8bf18469 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received unexpected event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 for instance with vm_state active and task_state rescuing.
May 27 23:02:42.413415 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<602b3e68-4ea1-48f7-a212-af3d9f8ddf7d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:42.415519 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:02:42.422511 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1387169604', uuid='602b3e68-4ea1-48f7-a212-af3d9f8ddf7d'), owner=OwnerMeta(userid='8d33b630152d4b96949f3afbb65d7115', username='tempest-ServerRescueNegativeTestJSON-550001831-project-member', projectid='7efe372c67374c55bd40d7757474f80a', projectname='tempest-ServerRescueNegativeTestJSON-550001831'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:47:f0:45"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922962.4199631) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:02:42.434443 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:02:42.434443 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:02:42.435285 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:02:42.435517 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:02:42.436453 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:02:42.436825 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:02:42.437194 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:02:42.437293 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:02:42.437745 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:02:42.437832 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:02:42.437940 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:02:42.438091 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:02:42.438189 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:02:42.438355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:02:42.438480 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:02:42.438662 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:02:42.438829 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'vcpu_model' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:42.446437 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Acquiring lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:42.446683 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:42.494957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:02:42.940789 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<602b3e68-4ea1-48f7-a212-af3d9f8ddf7d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:42.955697 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:02:42.970740 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387169604',display_name='tempest-ServerRescueNegativeTestJSON-server-1387169604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-1387169604',id=11,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMm+yhSwEok+0ExtQUX/N7Mp2wWehXO06JZkCmX7PNpDkKIgB3aEsU6fo/i2atzPjbTEkDy8zEdL4FI+9I32CVR1gqa6cI1Wn0i/uB7WDgHSVop9ymnZE7TmYqrtE4yC3w==',key_name='tempest-keypair-1375101173',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:01:47Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-nkhrldeb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d33b630152d4b96949f3afbb65d7115',uuid=602b3e68-4ea1-48f7-a212-af3d9f8ddf7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:47:f0:45"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:02:42.970936 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "vif_mac": "fa:16:3e:47:f0:45"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:42.971659 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=d1c554f6-4c5e-4c94-b8dd-469ba0a41da8,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c554f6-4c') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:42.972301 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'pci_devices' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:43.040598 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6a99f05a-6544-4994-9a1a-d98c320d088a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:43.040722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:43.126919 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:02:43.127080 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 27 23:02:43.129244 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:43.474143 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<602b3e68-4ea1-48f7-a212-af3d9f8ddf7d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:43.475564 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] End _get_guest_xml xml=<domain type="qemu">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <uuid>602b3e68-4ea1-48f7-a212-af3d9f8ddf7d</uuid>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <name>instance-0000000b</name>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1387169604</nova:name>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:02:42</nova:creationTime>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:user uuid="8d33b630152d4b96949f3afbb65d7115">tempest-ServerRescueNegativeTestJSON-550001831-project-member</nova:user>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:project uuid="7efe372c67374c55bd40d7757474f80a">tempest-ServerRescueNegativeTestJSON-550001831</nova:project>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         <nova:port uuid="d1c554f6-4c5e-4c94-b8dd-469ba0a41da8">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <system>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <entry name="serial">602b3e68-4ea1-48f7-a212-af3d9f8ddf7d</entry>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <entry name="uuid">602b3e68-4ea1-48f7-a212-af3d9f8ddf7d</entry>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     </system>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <os>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   </os>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <features>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   </features>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   <devices>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.rescue"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.config.rescue"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:47:f0:45"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <target dev="tapd1c554f6-4c"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     </interface>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/console.log" append="off"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     </serial>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <video>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     </video>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     </rng>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:   </devices>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]: </domain>
May 27 23:02:43.475564 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:02:43.479461 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Instance destroyed successfully.
May 27 23:02:43.510938 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Found WWN 330000000f76b9838 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:02:43.511962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:02:43.511962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] <== connect_volume: return (2037ms) {'type': 'block', 'scsi_wwn': '330000000f76b9838', 'path': '/dev/dm-0', 'multipath_id': '330000000f76b9838'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:02:43.511962 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f76b9838', 'path': '/dev/dm-0', 'multipath_id': '330000000f76b9838'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:02:43.533051 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:43.533276 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:43.535876 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:02:43.536015 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Claim successful on node np0000001565
May 27 23:02:43.546235 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:02:43.630989 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] There are 0 instances to clean {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 27 23:02:43.632954 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:02:43.632954 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98289) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 27 23:02:44.019395 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-652051971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-652051971',id=13,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:02:31Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-k00lkx6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:32Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=7cb7c255-4b3c-493e-9a31-e554576a0525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "vif_mac": "fa:16:3e:a8:ff:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:02:44.019395 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "vif_mac": "fa:16:3e:a8:ff:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:44.019395 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ff:85,bridge_name='br-int',has_traffic_filtering=True,id=fe17e03b-0353-4478-8ccb-48bb8622d814,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe17e03b-03') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:44.019694 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:44.126413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:44.134938 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:02:44.154217 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:44.154455 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:44.154603 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:44.154686 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:44.154762 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] No waiting events found dispatching network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:44.154895 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received unexpected event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 for instance with vm_state active and task_state rescuing.
May 27 23:02:44.155018 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:44.155122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:44.155245 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:44.156713 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:44.156892 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:44.156995 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received unexpected event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with vm_state active and task_state rescuing.
May 27 23:02:44.157072 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:44.157194 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:44.157297 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:44.157430 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:44.157523 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:44.157652 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-04b93d40-37fd-41cd-b453-c71c2f486d34 req-6bab3ebc-18ea-4c32-ae71-24c6882ee464 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received unexpected event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with vm_state active and task_state rescuing.
May 27 23:02:44.522463 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<7cb7c255-4b3c-493e-9a31-e554576a0525> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:44.522463 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] End _get_guest_xml xml=<domain type="qemu">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <uuid>7cb7c255-4b3c-493e-9a31-e554576a0525</uuid>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <name>instance-0000000d</name>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-652051971</nova:name>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:02:40</nova:creationTime>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:user uuid="6037b0819a94463e8e45d96f834c4341">tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member</nova:user>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:project uuid="9818a7ed096346eb92128648c4280071">tempest-ServerBootFromVolumeStableRescueTest-800872693</nova:project>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         <nova:port uuid="fe17e03b-0353-4478-8ccb-48bb8622d814">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <system>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <entry name="serial">7cb7c255-4b3c-493e-9a31-e554576a0525</entry>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <entry name="uuid">7cb7c255-4b3c-493e-9a31-e554576a0525</entry>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     </system>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <os>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   </os>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <features>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   </features>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   <devices>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.config"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <alias name="ua-7b3985f1-9dc4-481b-9837-6caf308cc632"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <serial>7b3985f1-9dc4-481b-9837-6caf308cc632</serial>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.rescue"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <boot order="1"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:a8:ff:85"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <target dev="tapfe17e03b-03"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     </interface>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/console.log" append="off"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     </serial>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <video>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     </video>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     </rng>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:   </devices>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]: </domain>
May 27 23:02:44.522463 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:02:44.530471 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Instance destroyed successfully.
May 27 23:02:44.639977 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:02:44.926277 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:44.995290 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:44.995583 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:44.995583 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:44.995726 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] No VIF found with MAC fa:16:3e:47:f0:45, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:02:44.996167 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Using config drive
May 27 23:02:45.124457 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:02:45.124654 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:02:45.504709 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'ec2_ids' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:45.629856 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:46.010207 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<602b3e68-4ea1-48f7-a212-af3d9f8ddf7d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:46.010435 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'keypairs' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:46.049568 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:46.049770 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:46.049770 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:46.049889 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No VIF found with MAC fa:16:3e:a8:ff:85, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:02:46.050524 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Using config drive
May 27 23:02:46.136614 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.603s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:46.137601 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.012s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:46.137779 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:02:46.142223 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:02:46.142452 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Claim successful on node np0000001565
May 27 23:02:46.513118 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<602b3e68-4ea1-48f7-a212-af3d9f8ddf7d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:46.518160 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:46.556964 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'ec2_ids' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:46.630877 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:02:46.631473 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:02:46.631473 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:02:46.643647 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:02:46.643962 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:02:46.644650 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:46.644930 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:46.681186 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Creating config drive at /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.config.rescue
May 27 23:02:46.687979 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpby1p8vj5 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:46.729869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpby1p8vj5" returned: 0 in 0.042s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:46.738184 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a27323e5e484fe5824b224fbd0954c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce997323a243a1a0df5249fca7fc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:02:47.068545 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<7cb7c255-4b3c-493e-9a31-e554576a0525> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:47.068545 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'keypairs' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:47.138383 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:47.149602 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:02:47.238766 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:47.274466 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:47.295410 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Successfully created port: cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:02:47.353059 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:47.436974 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:47.444130 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:47.474272 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d86ccb38-7138-4879-a355-4a9381125e23 req-c74aa924-6689-4c0b-b16b-71e6a49a4b1b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:47.474482 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d86ccb38-7138-4879-a355-4a9381125e23 req-c74aa924-6689-4c0b-b16b-71e6a49a4b1b service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:47.474709 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d86ccb38-7138-4879-a355-4a9381125e23 req-c74aa924-6689-4c0b-b16b-71e6a49a4b1b service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:47.474864 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d86ccb38-7138-4879-a355-4a9381125e23 req-c74aa924-6689-4c0b-b16b-71e6a49a4b1b service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:47.475284 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d86ccb38-7138-4879-a355-4a9381125e23 req-c74aa924-6689-4c0b-b16b-71e6a49a4b1b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:47.475738 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-d86ccb38-7138-4879-a355-4a9381125e23 req-c74aa924-6689-4c0b-b16b-71e6a49a4b1b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received unexpected event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with vm_state active and task_state rescuing.
May 27 23:02:47.572472 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<7cb7c255-4b3c-493e-9a31-e554576a0525> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:47.577587 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:47.651174 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:02:47.824114 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:02:47.824352 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:02:47.837406 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Creating config drive at /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.config.rescue
May 27 23:02:47.843627 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzllcne5r {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:47.890671 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzllcne5r" returned: 0 in 0.046s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:47.966208 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Successfully updated port: cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:02:48.034706 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ad6962e0-66d0-4ab2-856c-7a33f13918d6 req-173d3790-5475-4119-9f7c-e8312d85edb1 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Received event network-changed-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:48.035162 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ad6962e0-66d0-4ab2-856c-7a33f13918d6 req-173d3790-5475-4119-9f7c-e8312d85edb1 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Refreshing instance network info cache due to event network-changed-cef5d64f-5532-4e5d-9be2-1db68a9f1d73. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:02:48.035458 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ad6962e0-66d0-4ab2-856c-7a33f13918d6 req-173d3790-5475-4119-9f7c-e8312d85edb1 service nova] Acquiring lock "refresh_cache-0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:48.035585 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ad6962e0-66d0-4ab2-856c-7a33f13918d6 req-173d3790-5475-4119-9f7c-e8312d85edb1 service nova] Acquired lock "refresh_cache-0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:48.035731 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ad6962e0-66d0-4ab2-856c-7a33f13918d6 req-173d3790-5475-4119-9f7c-e8312d85edb1 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Refreshing network info cache for port cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:02:48.145158 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:48.216908 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d due to new event <LifecycleEvent: 1779922968.2165442, 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:02:48.217876 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922968.2165442, 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:48.217876 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] VM Resumed (Lifecycle Event)
May 27 23:02:48.222675 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-23bcf565-a23d-4add-b4c3-70a5bf29ad31 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:48.327878 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:48.384916 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:48.415713 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:48.471529 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Acquiring lock "refresh_cache-0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:48.510857 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:48.540382 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-ad6962e0-66d0-4ab2-856c-7a33f13918d6 req-173d3790-5475-4119-9f7c-e8312d85edb1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:48.551950 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:48.552778 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:48.643448 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ad6962e0-66d0-4ab2-856c-7a33f13918d6 req-173d3790-5475-4119-9f7c-e8312d85edb1 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:48.663528 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:02:48.664958 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:02:48.667481 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Creating image(s)
May 27 23:02:48.668940 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:48.669621 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "/opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:48.670075 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "/opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:48.670606 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:48.673643 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:48.674702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:48.725654 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:48.735101 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:48.772356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.097s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:48.772356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:48.772555 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:48.772885 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:48.775665 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:48.776014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:48.841609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.704s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:48.842371 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:02:48.848929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.704s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:48.849306 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.007s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:48.851760 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:02:48.859697 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ad6962e0-66d0-4ab2-856c-7a33f13918d6 req-173d3790-5475-4119-9f7c-e8312d85edb1 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:48.870244 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:48.872609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:48.944981 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk 1073741824" returned: 0 in 0.073s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:48.945497 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:48.945791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:49.029615 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:49.030065 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:02:49.030343 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:49.128483 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:49.129001 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Cannot resize image /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:02:49.129499 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:02:49.129741 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Ensure instance console log exists: /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:02:49.130105 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:49.130509 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:49.131384 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:49.238456 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922969.238011, 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:49.238619 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] VM Started (Lifecycle Event)
May 27 23:02:49.275896 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d72bc079-2fad-42ba-8950-450089d21bf0 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:49.357140 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:02:49.357822 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:02:49.361462 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:49.361462 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:49.364945 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ad6962e0-66d0-4ab2-856c-7a33f13918d6 req-173d3790-5475-4119-9f7c-e8312d85edb1 service nova] Releasing lock "refresh_cache-0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:49.365446 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Acquired lock "refresh_cache-0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:49.365646 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:02:49.475165 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c6d94c1e6da4237aa5dd517c31e03d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec877dc7b2240969ac89c13673f8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:02:49.576126 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:49.576950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:49.579797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:49.579797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:49.579797 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:49.579797 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received unexpected event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with vm_state rescued and task_state None.
May 27 23:02:49.579797 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:49.579797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:49.579797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:49.580072 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:49.580162 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] No waiting events found dispatching network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:49.580943 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received unexpected event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 for instance with vm_state rescued and task_state None.
May 27 23:02:49.580943 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:49.580943 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:49.580943 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:49.580943 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:49.581060 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] No waiting events found dispatching network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:49.581472 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9ba49279-e7c8-4d46-b53f-6a1408e590f8 req-d98d845c-00ef-4389-9540-b20d4a9608f6 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received unexpected event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 for instance with vm_state rescued and task_state None.
May 27 23:02:49.741964 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:49.744608 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:49.864946 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:02:49.928170 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:49.936998 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:49.976317 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:50.039156 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:50.039821 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:50.071613 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Successfully created port: 2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:02:50.125291 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:50.129721 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:02:50.131311 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:50.166097 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Unrescuing
May 27 23:02:50.166415 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:50.166542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquired lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:50.166913 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:02:50.196379 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:50.210707 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:50.212978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:50.237043 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:50.238076 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:50.256184 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 27 23:02:50.258130 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 7cb7c255-4b3c-493e-9a31-e554576a0525 due to new event <LifecycleEvent: 1779922970.2576833, 7cb7c255-4b3c-493e-9a31-e554576a0525 => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:02:50.258321 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922970.2576833, 7cb7c255-4b3c-493e-9a31-e554576a0525 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:50.258516 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] VM Resumed (Lifecycle Event)
May 27 23:02:50.349010 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:50.352562 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:02:50.352777 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.rescue --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:50.370192 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:02:50.406973 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Updating instance_info_cache with network_info: [{"id": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "address": "fa:16:3e:53:6e:9e", "network": {"id": "f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1776929254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "afce997323a243a1a0df5249fca7fc54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef5d64f-55", "ovs_interfaceid": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:50.450453 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.rescue --force-share --output=json" returned: 0 in 0.097s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:50.451935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.rescue --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:50.545087 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525/disk.rescue --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:50.549687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:50.623067 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Successfully updated port: 2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:02:50.635715 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:50.637375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:50.669173 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bc603b12-184d-4289-985c-921595350b48 req-3fa42644-f26d-4e40-829a-d180f7729f8a service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Received event network-changed-2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:50.669382 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bc603b12-184d-4289-985c-921595350b48 req-3fa42644-f26d-4e40-829a-d180f7729f8a service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Refreshing instance network info cache due to event network-changed-2d9b8029-820b-4780-a69e-2a8cca380d8f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:02:50.669713 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bc603b12-184d-4289-985c-921595350b48 req-3fa42644-f26d-4e40-829a-d180f7729f8a service nova] Acquiring lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:50.669812 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bc603b12-184d-4289-985c-921595350b48 req-3fa42644-f26d-4e40-829a-d180f7729f8a service nova] Acquired lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:50.669941 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-bc603b12-184d-4289-985c-921595350b48 req-3fa42644-f26d-4e40-829a-d180f7729f8a service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Refreshing network info cache for port 2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:02:50.674616 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:50.716669 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:02:50.734476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:50.735192 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:50.768862 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:50.773790 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:50.824760 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:50.825138 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:50.909991 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Releasing lock "refresh_cache-0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:50.911614 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Instance network_info: |[{"id": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "address": "fa:16:3e:53:6e:9e", "network": {"id": "f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1776929254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "afce997323a243a1a0df5249fca7fc54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef5d64f-55", "ovs_interfaceid": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:02:50.913628 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Start _get_guest_xml network_info=[{"id": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "address": "fa:16:3e:53:6e:9e", "network": {"id": "f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1776929254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "afce997323a243a1a0df5249fca7fc54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef5d64f-55", "ovs_interfaceid": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:02:50.915929 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:02:50.917598 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-148764375', uuid='0e5489ad-9907-4ba6-9ac6-2a93a7d4d512'), owner=OwnerMeta(userid='7a27323e5e484fe5824b224fbd0954c0', username='tempest-VolumesAdminNegativeTest-1854316783-project-member', projectid='afce997323a243a1a0df5249fca7fc54', projectname='tempest-VolumesAdminNegativeTest-1854316783'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "address": "fa:16:3e:53:6e:9e", "network": {"id": "f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1776929254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "afce997323a243a1a0df5249fca7fc54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef5d64f-55", "ovs_interfaceid": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922970.9171476) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:02:50.918944 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:02:50.919355 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:02:50.921268 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:02:50.921495 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:02:50.925141 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:02:50.925543 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:02:50.925711 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:02:50.925810 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:02:50.925943 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:02:50.926029 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:02:50.926133 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:02:50.926348 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:02:50.926508 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:02:50.926560 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:02:50.926659 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:02:50.926782 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:02:50.943656 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:50.949930 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:50.972972 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-148764375',display_name='tempest-VolumesAdminNegativeTest-server-148764375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesadminnegativetest-server-148764375',id=17,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afce997323a243a1a0df5249fca7fc54',ramdisk_id='',reservation_id='r-e1ts5erv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1854316783',owner_user_name='tempest-VolumesAdminNegativeTest-1854316783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:48Z,user_data=None,user_id='7a27323e5e484fe5824b224fbd0954c0',uuid=0e5489ad-9907-4ba6-9ac6-2a93a7d4d512,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "address": "fa:16:3e:53:6e:9e", "network": {"id": "f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1776929254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "afce997323a243a1a0df5249fca7fc54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef5d64f-55", "ovs_interfaceid": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:02:50.973194 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Converting VIF {"id": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "address": "fa:16:3e:53:6e:9e", "network": {"id": "f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1776929254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "afce997323a243a1a0df5249fca7fc54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef5d64f-55", "ovs_interfaceid": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:50.974836 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:6e:9e,bridge_name='br-int',has_traffic_filtering=True,id=cef5d64f-5532-4e5d-9be2-1db68a9f1d73,network=Network(f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef5d64f-55') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:50.976064 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:51.046503 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Unrescuing
May 27 23:02:51.046732 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:51.046873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquired lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:51.046984 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:02:51.050375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.051210 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:51.124895 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:51.141526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.143665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:51.146591 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:51.178666 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-bc603b12-184d-4289-985c-921595350b48 req-3fa42644-f26d-4e40-829a-d180f7729f8a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:51.233669 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.234041 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:51.269198 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-bc603b12-184d-4289-985c-921595350b48 req-3fa42644-f26d-4e40-829a-d180f7729f8a service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:51.285127 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 27 23:02:51.287396 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922971.285363, 7cb7c255-4b3c-493e-9a31-e554576a0525 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:51.287396 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] VM Started (Lifecycle Event)
May 27 23:02:51.309104 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:51.309353 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:51.312538 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:02:51.312672 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Claim successful on node np0000001565
May 27 23:02:51.320631 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.323717 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.rescue --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:51.368608 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updating instance_info_cache with network_info: [{"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:51.387218 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:02:51.390399 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:02:51.390399 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Creating image(s)
May 27 23:02:51.390399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:51.390399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:51.390399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:51.390399 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:51.393997 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:51.395108 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:51.417508 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.rescue --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.418187 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.rescue --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:51.482877 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] End _get_guest_xml xml=<domain type="qemu">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <uuid>0e5489ad-9907-4ba6-9ac6-2a93a7d4d512</uuid>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <name>instance-00000011</name>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumesAdminNegativeTest-server-148764375</nova:name>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:02:50</nova:creationTime>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:user uuid="7a27323e5e484fe5824b224fbd0954c0">tempest-VolumesAdminNegativeTest-1854316783-project-member</nova:user>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:project uuid="afce997323a243a1a0df5249fca7fc54">tempest-VolumesAdminNegativeTest-1854316783</nova:project>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         <nova:port uuid="cef5d64f-5532-4e5d-9be2-1db68a9f1d73">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <system>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <entry name="serial">0e5489ad-9907-4ba6-9ac6-2a93a7d4d512</entry>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <entry name="uuid">0e5489ad-9907-4ba6-9ac6-2a93a7d4d512</entry>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     </system>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <os>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   </os>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <features>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   </features>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   <devices>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk.config"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:53:6e:9e"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <target dev="tapcef5d64f-55"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     </interface>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/console.log" append="off"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     </serial>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <video>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     </video>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     </rng>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:   </devices>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]: </domain>
May 27 23:02:51.482877 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:02:51.484757 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Preparing to wait for external event network-vif-plugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:02:51.484757 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Acquiring lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:51.484757 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:51.484757 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:51.485420 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-148764375',display_name='tempest-VolumesAdminNegativeTest-server-148764375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesadminnegativetest-server-148764375',id=17,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afce997323a243a1a0df5249fca7fc54',ramdisk_id='',reservation_id='r-e1ts5erv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1854316783',owner_user_name='tempest-VolumesAdminNegativeTest-1854316783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:48Z,user_data=None,user_id='7a27323e5e484fe5824b224fbd0954c0',uuid=0e5489ad-9907-4ba6-9ac6-2a93a7d4d512,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "address": "fa:16:3e:53:6e:9e", "network": {"id": "f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1776929254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "afce997323a243a1a0df5249fca7fc54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef5d64f-55", "ovs_interfaceid": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:02:51.485962 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Converting VIF {"id": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "address": "fa:16:3e:53:6e:9e", "network": {"id": "f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1776929254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "afce997323a243a1a0df5249fca7fc54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef5d64f-55", "ovs_interfaceid": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:51.486547 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:6e:9e,bridge_name='br-int',has_traffic_filtering=True,id=cef5d64f-5532-4e5d-9be2-1db68a9f1d73,network=Network(f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef5d64f-55') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:51.486876 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:6e:9e,bridge_name='br-int',has_traffic_filtering=True,id=cef5d64f-5532-4e5d-9be2-1db68a9f1d73,network=Network(f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef5d64f-55') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:02:51.487687 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:51.488137 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:51.488565 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:02:51.490767 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:51.493896 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-bc603b12-184d-4289-985c-921595350b48 req-3fa42644-f26d-4e40-829a-d180f7729f8a service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:51.495139 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49d169f6-5342-5f57-9f85-8ab669f7c113', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:51.498326 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.103s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.498702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:51.499132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:51.500520 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:51.506090 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:51.507129 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk.rescue --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.507498 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d/disk (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:02:51.510915 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:02:51.511591 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:51.513660 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:51.514791 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcef5d64f-55, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:51.515814 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:02:51.517022 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcef5d64f-55, col_values=(('qos', UUID('c8dd9377-1c1f-4592-8c5a-481c611c3c0a')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:51.532187 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:51.546560 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcef5d64f-55, col_values=(('external_ids', {'iface-id': 'cef5d64f-5532-4e5d-9be2-1db68a9f1d73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:6e:9e', 'vm-uuid': '0e5489ad-9907-4ba6-9ac6-2a93a7d4d512'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:51.554609 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:51.559065 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:51.566677 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:51.569381 np0000001565 nova-compute[98289]: INFO os_vif [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:6e:9e,bridge_name='br-int',has_traffic_filtering=True,id=cef5d64f-5532-4e5d-9be2-1db68a9f1d73,network=Network(f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef5d64f-55')
May 27 23:02:51.585066 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.068s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.585635 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=12171MB free_disk=74.4294548034668GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:02:51.585816 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:51.605236 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.609770 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:51.656561 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk 1073741824" returned: 0 in 0.050s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.657084 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:51.657497 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:51.750636 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.751060 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:02:51.751281 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:51.791552 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:51.795645 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:51.843234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:51.843673 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Cannot resize image /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:02:51.844055 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:02:51.844248 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Ensure instance console log exists: /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:02:51.847780 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:51.848058 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:51.848241 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:51.872530 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Releasing lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:51.873169 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'flavor' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:51.911046 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:51.998867 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bc603b12-184d-4289-985c-921595350b48 req-3fa42644-f26d-4e40-829a-d180f7729f8a service nova] Releasing lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:51.999479 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:51.999735 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:02:52.054797 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Updating instance_info_cache with network_info: [{"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:52.302353 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 27 23:02:52.409722 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:52.440237 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:52.461058 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003362009999818838 future=<Future at 0x726e601eb410 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:52.461160 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:52.461885 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.772699782000018 future=<Future at 0x726e60179220 state=cancelled>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:52.461885 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.7726251779999984 future=<Future at 0x726e60179220 state=cancelled>) was cancelled while queued, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:52.461885 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:52.557945 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Releasing lock "refresh_cache-7cb7c255-4b3c-493e-9a31-e554576a0525" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:52.559136 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'flavor' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:52.587649 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:52.608971 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:52.623444 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:52.647741 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d30b19c1-85c0-49ba-849b-5ebc8fa746ba req-5a84f1e5-f0c4-40b6-85d3-2a6dd58a69b1 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:52.650052 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d30b19c1-85c0-49ba-849b-5ebc8fa746ba req-5a84f1e5-f0c4-40b6-85d3-2a6dd58a69b1 service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:52.650052 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d30b19c1-85c0-49ba-849b-5ebc8fa746ba req-5a84f1e5-f0c4-40b6-85d3-2a6dd58a69b1 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:52.650052 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d30b19c1-85c0-49ba-849b-5ebc8fa746ba req-5a84f1e5-f0c4-40b6-85d3-2a6dd58a69b1 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:52.650052 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d30b19c1-85c0-49ba-849b-5ebc8fa746ba req-5a84f1e5-f0c4-40b6-85d3-2a6dd58a69b1 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:52.650052 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-d30b19c1-85c0-49ba-849b-5ebc8fa746ba req-5a84f1e5-f0c4-40b6-85d3-2a6dd58a69b1 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received unexpected event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with vm_state rescued and task_state unrescuing.
May 27 23:02:52.751570 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999698525999975 future=<Future at 0x726e581880b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:52.752295 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99891012199987 future=<Future at 0x726e581880b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:52.752445 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998736538000003 future=<Future at 0x726e581880b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:52.754240 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Instance destroyed successfully.
May 27 23:02:52.754240 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'numa_topology' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:52.831775 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:52.999153 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Updating instance_info_cache with network_info: [{"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:53.055170 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:02:53.055389 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:02:53.096921 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:53.097050 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:53.097162 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] No VIF found with MAC fa:16:3e:53:6e:9e, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:02:53.097698 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Using config drive
May 27 23:02:53.101579 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:53.104622 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:53.127887 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:53.146991 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:53.255864 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:53.256288 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Object Instance<602b3e68-4ea1-48f7-a212-af3d9f8ddf7d> lazy-loaded attributes: flavor,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:53.270012 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:53.444101 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Acquiring lock "542edc82-9617-4269-b95c-523000992ff8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:53.444262 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "542edc82-9617-4269-b95c-523000992ff8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:53.503674 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:53.503977 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Instance network_info: |[{"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:02:53.506309 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Start _get_guest_xml network_info=[{"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:02:53.508321 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:02:53.509934 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='6a99f05a-6544-4994-9a1a-d98c320d088a'), owner=OwnerMeta(userid='2c6d94c1e6da4237aa5dd517c31e03d7', username='tempest-AttachVolumeMultiAttachTest-781715127-project-member', projectid='0ec877dc7b2240969ac89c13673f8799', projectname='tempest-AttachVolumeMultiAttachTest-781715127'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922973.5094998) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:02:53.511318 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:02:53.511657 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:02:53.512613 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:02:53.512821 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:02:53.514007 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:02:53.514317 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:02:53.514494 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:02:53.514618 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:02:53.514781 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:02:53.514846 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:02:53.514948 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:02:53.515094 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:02:53.515187 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:02:53.515392 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:02:53.515503 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:02:53.515615 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:02:53.525791 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-0',id=18,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-l45qiyb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=6a99f05a-6544-4994-9a1a-d98c320d088a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:02:53.526018 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:53.526414 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:0a:de,bridge_name='br-int',has_traffic_filtering=True,id=2d9b8029-820b-4780-a69e-2a8cca380d8f,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9b8029-82') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:53.526950 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a99f05a-6544-4994-9a1a-d98c320d088a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:53.558805 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:53.599200 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999758674000077 future=<Future at 0x726e60106fc0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:02:53.600074 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Instance destroyed successfully.
May 27 23:02:53.601524 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'numa_topology' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:02:53.607221 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:53.750407 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Creating config drive at /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk.config
May 27 23:02:53.754409 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpur75ivkn {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:53.802088 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpur75ivkn" returned: 0 in 0.047s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:53.827994 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:53.872142 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:53.946381 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:02:53.997547 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.008741 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.031896 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] End _get_guest_xml xml=<domain type="qemu">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <uuid>6a99f05a-6544-4994-9a1a-d98c320d088a</uuid>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <name>instance-00000012</name>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <nova:name>multiattach-server-0</nova:name>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:02:53</nova:creationTime>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:user uuid="2c6d94c1e6da4237aa5dd517c31e03d7">tempest-AttachVolumeMultiAttachTest-781715127-project-member</nova:user>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:project uuid="0ec877dc7b2240969ac89c13673f8799">tempest-AttachVolumeMultiAttachTest-781715127</nova:project>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         <nova:port uuid="2d9b8029-820b-4780-a69e-2a8cca380d8f">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <system>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <entry name="serial">6a99f05a-6544-4994-9a1a-d98c320d088a</entry>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <entry name="uuid">6a99f05a-6544-4994-9a1a-d98c320d088a</entry>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     </system>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <os>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   </os>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <features>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   </features>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   <devices>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk.config"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     </disk>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:47:0a:de"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <target dev="tap2d9b8029-82"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     </interface>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/console.log" append="off"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     </serial>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <video>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     </video>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     </rng>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:   </devices>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]: </domain>
May 27 23:02:54.031896 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:02:54.034509 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Preparing to wait for external event network-vif-plugged-2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:02:54.034509 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:54.034509 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:54.034509 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:54.034509 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-0',id=18,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-l45qiyb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=6a99f05a-6544-4994-9a1a-d98c320d088a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:02:54.034828 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:02:54.035204 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:0a:de,bridge_name='br-int',has_traffic_filtering=True,id=2d9b8029-820b-4780-a69e-2a8cca380d8f,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9b8029-82') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:02:54.035571 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:0a:de,bridge_name='br-int',has_traffic_filtering=True,id=2d9b8029-820b-4780-a69e-2a8cca380d8f,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9b8029-82') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:02:54.036035 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.038523 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:54.038523 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:02:54.040824 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.040824 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36c7e360-6852-5828-8a7d-93b7fdb51dbb', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:54.042252 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:54.052015 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.056540 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.056540 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d9b8029-82, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:54.056540 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d9b8029-82, col_values=(('qos', UUID('58bcb6a6-537d-4c09-a213-66acd1c8c7d4')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:54.056540 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d9b8029-82, col_values=(('external_ids', {'iface-id': '2d9b8029-820b-4780-a69e-2a8cca380d8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:0a:de', 'vm-uuid': '6a99f05a-6544-4994-9a1a-d98c320d088a'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:02:54.057502 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.058412 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:02:54.065393 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.756s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:54.065963 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:02:54.069468 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.483s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:54.077979 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.079276 np0000001565 nova-compute[98289]: INFO os_vif [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:0a:de,bridge_name='br-int',has_traffic_filtering=True,id=2d9b8029-820b-4780-a69e-2a8cca380d8f,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9b8029-82')
May 27 23:02:54.103575 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<7cb7c255-4b3c-493e-9a31-e554576a0525> lazy-loaded attributes: flavor,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:02:54.219427 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.494057 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:54.574666 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:02:54.574920 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:02:54.575243 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:54.575568 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received unexpected event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with vm_state rescued and task_state unrescuing.
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] No waiting events found dispatching network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received unexpected event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 for instance with vm_state rescued and task_state unrescuing.
May 27 23:02:54.721666 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:54.722238 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:54.722757 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:54.723034 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:54.723257 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] No waiting events found dispatching network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:54.723495 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received unexpected event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 for instance with vm_state rescued and task_state unrescuing.
May 27 23:02:54.723841 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:54.724089 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:54.724662 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:54.726226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:54.726226 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:54.726226 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received unexpected event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with vm_state rescued and task_state unrescuing.
May 27 23:02:54.726226 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:54.726226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:54.726567 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:54.731625 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:54.734864 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:54.736113 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.738184 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e0f5a660-20c1-4663-91b9-0926a92b9a8f req-6fae6427-2c36-4452-825c-e508b04da45b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received unexpected event network-vif-plugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with vm_state rescued and task_state unrescuing.
May 27 23:02:54.763669 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.825617 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.866427 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:54.928674 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e339645d1b454fa4b8bb89a20c0bf898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8214904c18049c086910b7b20b109b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:02:54.960706 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:55.085566 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:02:55.095765 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:55.112133 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:55.123222 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:55.152466 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:55.157458 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 119d02f0-0974-4fa4-9d6a-ecfefe01e029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:02:55.157915 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:55.158223 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 489adb12-811c-408c-af3f-24edcfc9d4bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:02:55.158687 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:02:55.158687 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance efc3328c-5e17-4eb2-b8fb-e645a6805b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:02:55.158687 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 7cb7c255-4b3c-493e-9a31-e554576a0525 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:02:55.159119 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance f47a00cc-da92-40c9-a668-9a160670addd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:02:55.159119 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 3eb890c1-c528-489f-8109-4b7870bfcf33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:02:55.159471 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 80c6eabe-0192-4030-a194-2d87bb638464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:02:55.159471 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:02:55.159471 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6a99f05a-6544-4994-9a1a-d98c320d088a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:02:55.159602 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:02:55.409878 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:55.416352 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:55.479418 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d due to new event <LifecycleEvent: 1779922975.47904, 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:02:55.479581 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922975.47904, 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:55.479701 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] VM Resumed (Lifecycle Event)
May 27 23:02:55.481683 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1e434c3d-1dfc-4ac6-a4bf-df216389a5c4 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:55.609698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:55.609822 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:02:55.609960 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:47:0a:de, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:02:55.610428 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Using config drive
May 27 23:02:55.662133 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 542edc82-9617-4269-b95c-523000992ff8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 27 23:02:55.662288 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:02:55.662468 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=2624MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:02:51 up 31 min,  2 users,  load average: 9.94, 5.44, 2.48\n', 'num_instances': '11', 'num_vm_active': '5', 'num_task_None': '7', 'num_os_type_None': '11', 'num_proj_7efe372c67374c55bd40d7757474f80a': '3', 'io_workload': '3', 'num_vm_rescued': '3', 'num_task_unrescuing': '2', 'num_proj_9818a7ed096346eb92128648c4280071': '2', 'num_proj_0ec877dc7b2240969ac89c13673f8799': '2', 'num_proj_d6f15f51479c4e37ab880af2031170be': '1', 'num_proj_9dbf5952ce9242a38d3c1881a1604223': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_afce997323a243a1a0df5249fca7fc54': '1', 'num_proj_e8214904c18049c086910b7b20b109b2': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:02:55.892202 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1ba2f48f-aad7-4d6b-8554-66f9d2f8ba8a tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:55.987800 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:56.000155 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:56.117387 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:56.194355 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully created port: d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:02:56.294164 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Creating config drive at /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk.config
May 27 23:02:56.299745 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvbktemny {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:56.342624 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvbktemny" returned: 0 in 0.043s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:02:56.420303 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:02:56.420576 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:02:56.503214 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922976.5029032, 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:56.503372 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] VM Started (Lifecycle Event)
May 27 23:02:56.604385 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:02:56.647865 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully created port: 8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:02:56.803466 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Received event network-vif-plugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:56.803771 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Acquiring lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:56.804000 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:56.804177 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:56.804359 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Processing event network-vif-plugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:02:56.804901 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Received event network-vif-plugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:56.805072 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Acquiring lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:56.805226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:56.805386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:56.805543 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] No waiting events found dispatching network-vif-plugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:56.805704 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Received unexpected event network-vif-plugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 for instance with vm_state building and task_state spawning.
May 27 23:02:56.805846 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:56.806003 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:56.806158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:56.806298 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:56.806474 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] No waiting events found dispatching network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:56.806621 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received unexpected event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 for instance with vm_state active and task_state None.
May 27 23:02:56.806848 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:56.807122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:56.807122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:56.807654 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:56.809080 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] No waiting events found dispatching network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:56.809905 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9656ec3a-7d64-4a4f-84f9-ab664070d2ff req-effffea2-1fb6-41bf-a94a-7e506cc8b2e5 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received unexpected event network-vif-plugged-fe17e03b-0353-4478-8ccb-48bb8622d814 for instance with vm_state active and task_state None.
May 27 23:02:56.811771 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:56.814016 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:02:56.827407 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:02:56.832324 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Instance spawned successfully.
May 27 23:02:56.832682 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:02:56.836315 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:56.843021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:56.923995 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:56.949159 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:56.973301 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:56.975979 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:57.005962 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:57.011826 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:57.062580 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0488faed-c8ca-4ba9-8c4b-fc90f1152394 req-f5a76188-64c5-47bf-aaee-ec6145944b75 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Received event network-vif-plugged-2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:57.063845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0488faed-c8ca-4ba9-8c4b-fc90f1152394 req-f5a76188-64c5-47bf-aaee-ec6145944b75 service nova] Acquiring lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:57.063845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0488faed-c8ca-4ba9-8c4b-fc90f1152394 req-f5a76188-64c5-47bf-aaee-ec6145944b75 service nova] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:57.063845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0488faed-c8ca-4ba9-8c4b-fc90f1152394 req-f5a76188-64c5-47bf-aaee-ec6145944b75 service nova] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:57.063845 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0488faed-c8ca-4ba9-8c4b-fc90f1152394 req-f5a76188-64c5-47bf-aaee-ec6145944b75 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Processing event network-vif-plugged-2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:02:57.110047 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Booting with volume fc4f800f-0613-4549-b71f-5ee16605c497 at /dev/vda
May 27 23:02:57.150023 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5c067b6a-0c77-46ae-bdc1-d5ae0d698740 req-bbc23b34-4c91-422a-8a5c-aaece477070f service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-changed-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:57.150023 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5c067b6a-0c77-46ae-bdc1-d5ae0d698740 req-bbc23b34-4c91-422a-8a5c-aaece477070f service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Refreshing instance network info cache due to event network-changed-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:02:57.150263 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5c067b6a-0c77-46ae-bdc1-d5ae0d698740 req-bbc23b34-4c91-422a-8a5c-aaece477070f service nova] Acquiring lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:57.150263 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5c067b6a-0c77-46ae-bdc1-d5ae0d698740 req-bbc23b34-4c91-422a-8a5c-aaece477070f service nova] Acquired lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:57.150436 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5c067b6a-0c77-46ae-bdc1-d5ae0d698740 req-bbc23b34-4c91-422a-8a5c-aaece477070f service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Refreshing network info cache for port d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:02:57.155509 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully created port: 22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:02:57.157354 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:02:57.175863 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:02:57.200416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:57.240230 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:02:57.240716 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:02:57.252785 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:02:57.256528 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fec3:7f1b', 'fe80::341f:bfff:fe55:81e6', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:f045', 'fe80::fc16:3eff:fe53:6e9e', 'fe80::fc16:3eff:fea8:ff85', 'fe80::c22:dff:fe5a:a8fd', 'fe80::fc16:3eff:fe47:ade'] 
May 27 23:02:57.256733 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:02:57.256846 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:02:57.259441 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:02:57.259441 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating existing volume attachment record: 1224d61a-1d74-4d4b-b7c1-fcfd8f98ff6f {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:02:57.347032 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:57.347427 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:57.348574 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:57.348836 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:57.349104 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:57.350785 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:57.433959 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:02:57.434137 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.365s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:57.434489 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:02:57.434866 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.941s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:57.440125 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:02:57.440370 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Claim successful on node np0000001565
May 27 23:02:57.513223 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922977.5129204, 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:57.513890 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] VM Started (Lifecycle Event)
May 27 23:02:57.660396 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5c067b6a-0c77-46ae-bdc1-d5ae0d698740 req-bbc23b34-4c91-422a-8a5c-aaece477070f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:57.681852 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully created port: b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:02:57.698525 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:02:57.702604 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:02:57.704409 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Instance spawned successfully.
May 27 23:02:57.704573 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:02:57.861128 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Took 9.20 seconds to spawn the instance on the hypervisor.
May 27 23:02:57.861365 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:58.018591 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:58.023380 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:58.104532 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5c067b6a-0c77-46ae-bdc1-d5ae0d698740 req-bbc23b34-4c91-422a-8a5c-aaece477070f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:58.148213 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:58.207994 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully created port: 22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:02:58.213777 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:58.213777 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:58.213777 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:58.213777 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:58.214136 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:58.214276 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:02:58.241980 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5c067b6a-0c77-46ae-bdc1-d5ae0d698740 req-bbc23b34-4c91-422a-8a5c-aaece477070f service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updated VIF entry in instance network info cache for port d1c554f6-4c5e-4c94-b8dd-469ba0a41da8. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:02:58.242493 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5c067b6a-0c77-46ae-bdc1-d5ae0d698740 req-bbc23b34-4c91-422a-8a5c-aaece477070f service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updating instance_info_cache with network_info: [{"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:02:58.373099 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Took 14.91 seconds to build instance.
May 27 23:02:58.409810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:58.410124 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:58.526391 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922978.524703, 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:58.526391 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] VM Paused (Lifecycle Event)
May 27 23:02:58.700790 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully updated port: d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:02:58.722445 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Took 7.33 seconds to spawn the instance on the hypervisor.
May 27 23:02:58.722445 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:58.745819 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5c067b6a-0c77-46ae-bdc1-d5ae0d698740 req-bbc23b34-4c91-422a-8a5c-aaece477070f service nova] Releasing lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:02:58.875749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-70c6ac5d-e680-4c58-ba2e-2b1867474d26 tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.429s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:58.884599 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Booting with volume 15648881-dc61-473b-8ee5-31bf6ade7f69 at /dev/vdb
May 27 23:02:58.912686 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:02:58.927025 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:02:58.929668 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:02:58.929926 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:02:58.930095 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:02:58.930269 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:02:58.930408 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:02:58.930695 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.19 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:02:58.940616 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:02:58.954774 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:02:58.974476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:02:59.016525 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:02:59.016525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:02:59.027221 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:02:59.028089 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fec3:7f1b', 'fe80::341f:bfff:fe55:81e6', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:f045', 'fe80::fc16:3eff:fe53:6e9e', 'fe80::fc16:3eff:fea8:ff85', 'fe80::c22:dff:fe5a:a8fd', 'fe80::fc16:3eff:fe47:ade'] 
May 27 23:02:59.028268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:02:59.028456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:02:59.028784 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:02:59.029357 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating existing volume attachment record: b910c1a8-402e-4d3e-8bcd-97d23d185429 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:02:59.032719 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:59.036372 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 7cb7c255-4b3c-493e-9a31-e554576a0525 due to new event <LifecycleEvent: 1779922979.0360541, 7cb7c255-4b3c-493e-9a31-e554576a0525 => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:02:59.036541 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922979.0360541, 7cb7c255-4b3c-493e-9a31-e554576a0525 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:02:59.036677 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] VM Resumed (Lifecycle Event)
May 27 23:02:59.058339 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:02:59.152977 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Received event network-vif-plugged-2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:59.152977 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] Acquiring lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:59.153164 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:02:59.153462 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:59.153524 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] No waiting events found dispatching network-vif-plugged-2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:02:59.153694 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Received unexpected event network-vif-plugged-2d9b8029-820b-4780-a69e-2a8cca380d8f for instance with vm_state active and task_state None.
May 27 23:02:59.153834 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-changed-d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:59.153974 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing instance network info cache due to event network-changed-d7259562-6553-4ef1-8d96-bc9e7b64bf75. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:02:59.157851 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] Acquiring lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:59.157978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] Acquired lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:59.158150 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing network info cache for port d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:02:59.175159 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:02:59.175378 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:02:59.221374 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-80f0cc84-5b72-4577-978f-6634d7ea5b6e req-7365cd1a-927a-4ed2-a3cc-d5ba9edbba5b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-changed-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:02:59.221500 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-80f0cc84-5b72-4577-978f-6634d7ea5b6e req-7365cd1a-927a-4ed2-a3cc-d5ba9edbba5b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Refreshing instance network info cache due to event network-changed-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:02:59.221790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-80f0cc84-5b72-4577-978f-6634d7ea5b6e req-7365cd1a-927a-4ed2-a3cc-d5ba9edbba5b service nova] Acquiring lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:02:59.221790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-80f0cc84-5b72-4577-978f-6634d7ea5b6e req-7365cd1a-927a-4ed2-a3cc-d5ba9edbba5b service nova] Acquired lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:02:59.221973 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-80f0cc84-5b72-4577-978f-6634d7ea5b6e req-7365cd1a-927a-4ed2-a3cc-d5ba9edbba5b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Refreshing network info cache for port d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:02:59.232513 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Took 15.18 seconds to build instance.
May 27 23:02:59.484310 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:02:59.541430 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:02:59.544055 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:02:59.660415 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:59.678037 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:02:59.724455 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-80f0cc84-5b72-4577-978f-6634d7ea5b6e req-7365cd1a-927a-4ed2-a3cc-d5ba9edbba5b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:02:59.734113 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.693s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:02:59.756253 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully updated port: 8b25fb47-0737-4f1d-a87b-c6a5eb87176b {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:02:59.766462 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:02:59.982263 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:00.047572 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922980.0472503, 7cb7c255-4b3c-493e-9a31-e554576a0525 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:00.048035 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] VM Started (Lifecycle Event)
May 27 23:03:00.059555 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-80f0cc84-5b72-4577-978f-6634d7ea5b6e req-7365cd1a-927a-4ed2-a3cc-d5ba9edbba5b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:00.111616 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-135e71be-dad8-4c7a-9961-1aeba2bfde29 req-803cd9a2-6beb-41c4-b3f3-d4d267aacbc2 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Received event network-changed-2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:00.111616 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-135e71be-dad8-4c7a-9961-1aeba2bfde29 req-803cd9a2-6beb-41c4-b3f3-d4d267aacbc2 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Refreshing instance network info cache due to event network-changed-2d9b8029-820b-4780-a69e-2a8cca380d8f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:00.111616 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-135e71be-dad8-4c7a-9961-1aeba2bfde29 req-803cd9a2-6beb-41c4-b3f3-d4d267aacbc2 service nova] Acquiring lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:00.111616 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-135e71be-dad8-4c7a-9961-1aeba2bfde29 req-803cd9a2-6beb-41c4-b3f3-d4d267aacbc2 service nova] Acquired lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:00.111616 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-135e71be-dad8-4c7a-9961-1aeba2bfde29 req-803cd9a2-6beb-41c4-b3f3-d4d267aacbc2 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Refreshing network info cache for port 2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:00.189772 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.755s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:00.190496 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.706s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:00.190696 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:03:00.195039 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:03:00.195213 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Claim successful on node np0000001565
May 27 23:03:00.233899 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-80f0cc84-5b72-4577-978f-6634d7ea5b6e req-7365cd1a-927a-4ed2-a3cc-d5ba9edbba5b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updated VIF entry in instance network info cache for port d1c554f6-4c5e-4c94-b8dd-469ba0a41da8. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:03:00.234149 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-80f0cc84-5b72-4577-978f-6634d7ea5b6e req-7365cd1a-927a-4ed2-a3cc-d5ba9edbba5b service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updating instance_info_cache with network_info: [{"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:00.483848 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1d6d5eb1-650a-4359-8831-a3a46e465be5 req-943e9333-e094-4816-ba81-31580228f2a7 service nova] Releasing lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:00.552810 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:00.554082 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:00.616376 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-135e71be-dad8-4c7a-9961-1aeba2bfde29 req-803cd9a2-6beb-41c4-b3f3-d4d267aacbc2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:00.665352 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Booting with volume a7613ef2-f3e5-460b-b93b-ac85d1586207 at /dev/vdc
May 27 23:03:00.700517 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:03:00.702800 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:03:00.703191 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:00.703544 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:00.736054 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:00.739838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-80f0cc84-5b72-4577-978f-6634d7ea5b6e req-7365cd1a-927a-4ed2-a3cc-d5ba9edbba5b service nova] Releasing lock "refresh_cache-602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:00.759972 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:03:00.785034 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:00.834457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:03:00.835020 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:03:00.851686 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully updated port: 433e6524-50fc-4b98-84b7-9921a6b8f731 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:03:00.860196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:03:00.868143 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fec3:7f1b', 'fe80::341f:bfff:fe55:81e6', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:f045', 'fe80::fc16:3eff:fe53:6e9e', 'fe80::fc16:3eff:fea8:ff85', 'fe80::c22:dff:fe5a:a8fd', 'fe80::fc16:3eff:fe47:ade'] 
May 27 23:03:00.869667 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:03:00.869667 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:03:00.869667 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:00.869667 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating existing volume attachment record: f08f8a27-b5b2-4981-b3f3-13617ddf57b1 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:03:01.014448 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4dc22bdfd81e4dc385d8743f9b0e0432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b736f014aad408ab49531699331775f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:03:01.058960 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922981.0585475, 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:01.059545 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] VM Resumed (Lifecycle Event)
May 27 23:03:01.141111 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-135e71be-dad8-4c7a-9961-1aeba2bfde29 req-803cd9a2-6beb-41c4-b3f3-d4d267aacbc2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:01.201375 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:03:01.322361 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4933f2ee-8418-44a7-b58a-c324fec15984 req-bd9ebac0-3af4-4963-be2f-a4ddcde67452 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-changed-8b25fb47-0737-4f1d-a87b-c6a5eb87176b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:01.322361 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4933f2ee-8418-44a7-b58a-c324fec15984 req-bd9ebac0-3af4-4963-be2f-a4ddcde67452 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing instance network info cache due to event network-changed-8b25fb47-0737-4f1d-a87b-c6a5eb87176b. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:01.322361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4933f2ee-8418-44a7-b58a-c324fec15984 req-bd9ebac0-3af4-4963-be2f-a4ddcde67452 service nova] Acquiring lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:01.322361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4933f2ee-8418-44a7-b58a-c324fec15984 req-bd9ebac0-3af4-4963-be2f-a4ddcde67452 service nova] Acquired lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:01.322361 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4933f2ee-8418-44a7-b58a-c324fec15984 req-bd9ebac0-3af4-4963-be2f-a4ddcde67452 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing network info cache for port 8b25fb47-0737-4f1d-a87b-c6a5eb87176b {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:01.392604 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-135e71be-dad8-4c7a-9961-1aeba2bfde29 req-803cd9a2-6beb-41c4-b3f3-d4d267aacbc2 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Updated VIF entry in instance network info cache for port 2d9b8029-820b-4780-a69e-2a8cca380d8f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:03:01.392919 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-135e71be-dad8-4c7a-9961-1aeba2bfde29 req-803cd9a2-6beb-41c4-b3f3-d4d267aacbc2 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Updating instance_info_cache with network_info: [{"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:01.564088 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:01.567515 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:01.599849 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:01.600369 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:01.706573 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Successfully created port: 247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:03:01.711187 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:03:01.827183 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4933f2ee-8418-44a7-b58a-c324fec15984 req-bd9ebac0-3af4-4963-be2f-a4ddcde67452 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:01.899943 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-135e71be-dad8-4c7a-9961-1aeba2bfde29 req-803cd9a2-6beb-41c4-b3f3-d4d267aacbc2 service nova] Releasing lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:01.937597 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4933f2ee-8418-44a7-b58a-c324fec15984 req-bd9ebac0-3af4-4963-be2f-a4ddcde67452 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:02.070345 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully updated port: 8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:03:02.077177 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922982.0768464, 6a99f05a-6544-4994-9a1a-d98c320d088a => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:02.077499 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] VM Started (Lifecycle Event)
May 27 23:03:02.110018 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:03:02.200481 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1faaba08-3bb6-4798-b415-5684aec3afa3 req-9ee427fd-e075-45e9-b19a-6b916f133d06 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-changed-433e6524-50fc-4b98-84b7-9921a6b8f731 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:02.200481 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1faaba08-3bb6-4798-b415-5684aec3afa3 req-9ee427fd-e075-45e9-b19a-6b916f133d06 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing instance network info cache due to event network-changed-433e6524-50fc-4b98-84b7-9921a6b8f731. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:02.200481 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1faaba08-3bb6-4798-b415-5684aec3afa3 req-9ee427fd-e075-45e9-b19a-6b916f133d06 service nova] Acquiring lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:02.244801 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4933f2ee-8418-44a7-b58a-c324fec15984 req-bd9ebac0-3af4-4963-be2f-a4ddcde67452 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:02.309228 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:03:02.309567 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:03:02.412753 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Successfully updated port: 247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:03:02.500975 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Acquiring lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:02.501684 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:02.501684 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Acquiring lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:02.501840 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:02.502012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:02.508343 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Terminating instance
May 27 23:03:02.581711 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:02.583609 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:02.693047 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:02.723551 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:03:02.724424 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:03:02.724646 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Creating image(s)
May 27 23:03:02.725078 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Acquiring lock "/opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:02.725185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "/opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:02.725628 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "/opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:02.726094 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:02.728501 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:02.730622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:02.748417 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4933f2ee-8418-44a7-b58a-c324fec15984 req-bd9ebac0-3af4-4963-be2f-a4ddcde67452 service nova] Releasing lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:02.749299 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1faaba08-3bb6-4798-b415-5684aec3afa3 req-9ee427fd-e075-45e9-b19a-6b916f133d06 service nova] Acquired lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:02.749664 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1faaba08-3bb6-4798-b415-5684aec3afa3 req-9ee427fd-e075-45e9-b19a-6b916f133d06 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing network info cache for port 433e6524-50fc-4b98-84b7-9921a6b8f731 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:02.812703 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:03:02.818060 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:02.818445 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:02.818973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:02.819409 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:02.821812 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:02.822110 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:02.911995 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:02.912190 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:02.927665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Acquiring lock "refresh_cache-542edc82-9617-4269-b95c-523000992ff8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:02.928169 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Acquired lock "refresh_cache-542edc82-9617-4269-b95c-523000992ff8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:02.928449 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:03:02.963210 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk 1073741824" returned: 0 in 0.051s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:02.963687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:02.964099 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:03.018896 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:03:03.038314 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.043285 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.060117 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:03:03.062079 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:03:03.062817 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Creating image(s)
May 27 23:03:03.063191 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:03:03.063588 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Ensure instance console log exists: /opt/stack/data/nova/instances/0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:03:03.063958 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:03.064238 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:03.064476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:03.067183 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.103s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:03.068369 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.071044 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:03:03.072145 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:03.088554 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922983.0872264, 6a99f05a-6544-4994-9a1a-d98c320d088a => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:03.088824 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] VM Paused (Lifecycle Event)
May 27 23:03:03.102122 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.150322 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.158686 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully updated port: 22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:03:03.160239 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:03.160733 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Cannot resize image /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:03:03.161132 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:03:03.161361 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Ensure instance console log exists: /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:03:03.161686 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:03.161931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:03.162103 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:03.254356 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-1faaba08-3bb6-4798-b415-5684aec3afa3 req-9ee427fd-e075-45e9-b19a-6b916f133d06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:03.322428 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.131s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:03.322428 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:03:03.325383 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.632s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:03.331169 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:03:03.331169 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Claim successful on node np0000001565
May 27 23:03:03.340359 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.350641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.378906 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Instance destroyed successfully.
May 27 23:03:03.379257 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lazy-loading 'resources' on Instance uuid 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:03.397839 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1faaba08-3bb6-4798-b415-5684aec3afa3 req-9ee427fd-e075-45e9-b19a-6b916f133d06 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:03.411407 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4da84f4b-f47c-400f-8433-0d80df05ad11 req-b1318bfd-210d-4019-8f55-4e66b6547dda service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-changed-8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:03.411606 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4da84f4b-f47c-400f-8433-0d80df05ad11 req-b1318bfd-210d-4019-8f55-4e66b6547dda service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing instance network info cache due to event network-changed-8f186912-a40c-40b0-9cc1-808a4f92aa20. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:03.411802 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4da84f4b-f47c-400f-8433-0d80df05ad11 req-b1318bfd-210d-4019-8f55-4e66b6547dda service nova] Acquiring lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:03.502296 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:03.547771 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1faaba08-3bb6-4798-b415-5684aec3afa3 req-9ee427fd-e075-45e9-b19a-6b916f133d06 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:03.593495 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:03.595405 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922983.595072, 6a99f05a-6544-4994-9a1a-d98c320d088a => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:03.595564 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] VM Resumed (Lifecycle Event)
May 27 23:03:03.672959 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:03.829437 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:03:03.831147 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:03:03.831147 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:03.831282 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:03.845861 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Updating instance_info_cache with network_info: [{"id": "247919d2-832d-428e-ba48-4f45a0c6c84b", "address": "fa:16:3e:86:fc:ba", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap247919d2-83", "ovs_interfaceid": "247919d2-832d-428e-ba48-4f45a0c6c84b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:03.882350 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-148764375',display_name='tempest-VolumesAdminNegativeTest-server-148764375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesadminnegativetest-server-148764375',id=17,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:02:57Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afce997323a243a1a0df5249fca7fc54',ramdisk_id='',reservation_id='r-e1ts5erv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1854316783',owner_user_name='tempest-VolumesAdminNegativeTest-1854316783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:02:58Z,user_data=None,user_id='7a27323e5e484fe5824b224fbd0954c0',uuid=0e5489ad-9907-4ba6-9ac6-2a93a7d4d512,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "address": "fa:16:3e:53:6e:9e", "network": {"id": "f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1776929254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "afce997323a243a1a0df5249fca7fc54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef5d64f-55", "ovs_interfaceid": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:03:03.883533 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Converting VIF {"id": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "address": "fa:16:3e:53:6e:9e", "network": {"id": "f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1776929254-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "afce997323a243a1a0df5249fca7fc54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef5d64f-55", "ovs_interfaceid": "cef5d64f-5532-4e5d-9be2-1db68a9f1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:03.883533 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:6e:9e,bridge_name='br-int',has_traffic_filtering=True,id=cef5d64f-5532-4e5d-9be2-1db68a9f1d73,network=Network(f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef5d64f-55') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:03.883533 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:6e:9e,bridge_name='br-int',has_traffic_filtering=True,id=cef5d64f-5532-4e5d-9be2-1db68a9f1d73,network=Network(f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef5d64f-55') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:03:03.885798 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.885997 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcef5d64f-55, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:03.887614 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.889434 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:03.890099 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.891593 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8dd9377-1c1f-4592-8c5a-481c611c3c0a) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:03.892081 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.892568 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:03.893070 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:03.897358 np0000001565 nova-compute[98289]: INFO os_vif [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:6e:9e,bridge_name='br-int',has_traffic_filtering=True,id=cef5d64f-5532-4e5d-9be2-1db68a9f1d73,network=Network(f30e8209-ed91-4bdc-8fbf-57ff68e5bd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef5d64f-55')
May 27 23:03:03.897358 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Deleting instance files /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512_del
May 27 23:03:03.899041 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Deletion of /opt/stack/data/nova/instances/0e5489ad-9907-4ba6-9ac6-2a93a7d4d512_del complete
May 27 23:03:03.927747 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6037b0819a94463e8e45d96f834c4341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818a7ed096346eb92128648c4280071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:03:04.050521 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1faaba08-3bb6-4798-b415-5684aec3afa3 req-9ee427fd-e075-45e9-b19a-6b916f133d06 service nova] Releasing lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:04.051021 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4da84f4b-f47c-400f-8433-0d80df05ad11 req-b1318bfd-210d-4019-8f55-4e66b6547dda service nova] Acquired lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:04.051326 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4da84f4b-f47c-400f-8433-0d80df05ad11 req-b1318bfd-210d-4019-8f55-4e66b6547dda service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing network info cache for port 8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:04.098084 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:04.099465 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:04.160574 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully updated port: b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:03:04.215988 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-324464e1-2b8b-4cb6-a0d4-d0c584d2ec9c req-48171a17-c7db-470d-abab-da13d8927d58 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-changed-b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:04.217242 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-324464e1-2b8b-4cb6-a0d4-d0c584d2ec9c req-48171a17-c7db-470d-abab-da13d8927d58 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing instance network info cache due to event network-changed-b35b0820-2c57-46ab-8bf6-81d591b179e2. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:04.217242 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-324464e1-2b8b-4cb6-a0d4-d0c584d2ec9c req-48171a17-c7db-470d-abab-da13d8927d58 service nova] Acquiring lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:04.282316 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Received event network-changed-247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:04.282461 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Refreshing instance network info cache due to event network-changed-247919d2-832d-428e-ba48-4f45a0c6c84b. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:04.282593 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Acquiring lock "refresh_cache-542edc82-9617-4269-b95c-523000992ff8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:04.326408 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Successfully created port: 0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:03:04.332793 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:03:04.347996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Releasing lock "refresh_cache-542edc82-9617-4269-b95c-523000992ff8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:04.348266 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Instance network_info: |[{"id": "247919d2-832d-428e-ba48-4f45a0c6c84b", "address": "fa:16:3e:86:fc:ba", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap247919d2-83", "ovs_interfaceid": "247919d2-832d-428e-ba48-4f45a0c6c84b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:03:04.349281 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Acquired lock "refresh_cache-542edc82-9617-4269-b95c-523000992ff8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:04.349281 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Refreshing network info cache for port 247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:04.351642 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Start _get_guest_xml network_info=[{"id": "247919d2-832d-428e-ba48-4f45a0c6c84b", "address": "fa:16:3e:86:fc:ba", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap247919d2-83", "ovs_interfaceid": "247919d2-832d-428e-ba48-4f45a0c6c84b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:03:04.353422 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:03:04.354638 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-929057079', uuid='542edc82-9617-4269-b95c-523000992ff8'), owner=OwnerMeta(userid='4dc22bdfd81e4dc385d8743f9b0e0432', username='tempest-VolumesNegativeTest-578680527-project-member', projectid='0b736f014aad408ab49531699331775f', projectname='tempest-VolumesNegativeTest-578680527'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "247919d2-832d-428e-ba48-4f45a0c6c84b", "address": "fa:16:3e:86:fc:ba", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap247919d2-83", "ovs_interfaceid": "247919d2-832d-428e-ba48-4f45a0c6c84b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922984.3541048) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:03:04.357369 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:03:04.357369 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:03:04.357973 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:03:04.358303 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:03:04.359221 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:03:04.359781 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:03:04.359932 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:03:04.360043 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:03:04.360154 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:03:04.360237 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:03:04.360342 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:03:04.360496 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:03:04.360593 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:03:04.360698 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:03:04.360796 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:03:04.360903 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:03:04.381738 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-929057079',display_name='tempest-VolumesNegativeTest-instance-929057079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesnegativetest-instance-929057079',id=20,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b736f014aad408ab49531699331775f',ramdisk_id='',reservation_id='r-it24xvqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-578680527',owner_user_name='tempest-VolumesNegativeTest-578680527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:02Z,user_data=None,user_id='4dc22bdfd81e4dc385d8743f9b0e0432',uuid=542edc82-9617-4269-b95c-523000992ff8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "247919d2-832d-428e-ba48-4f45a0c6c84b", "address": "fa:16:3e:86:fc:ba", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap247919d2-83", "ovs_interfaceid": "247919d2-832d-428e-ba48-4f45a0c6c84b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:04.381981 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Converting VIF {"id": "247919d2-832d-428e-ba48-4f45a0c6c84b", "address": "fa:16:3e:86:fc:ba", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap247919d2-83", "ovs_interfaceid": "247919d2-832d-428e-ba48-4f45a0c6c84b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:04.382753 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:fc:ba,bridge_name='br-int',has_traffic_filtering=True,id=247919d2-832d-428e-ba48-4f45a0c6c84b,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247919d2-83') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:04.384951 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lazy-loading 'pci_devices' on Instance uuid 542edc82-9617-4269-b95c-523000992ff8 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:04.395561 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Refreshing inventories for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 27 23:03:04.406575 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 23:03:04.407251 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:03:04.407592 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:03:04.407715 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:03:04.407922 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:04.481911 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Updating ProviderTree inventory for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 27 23:03:04.482120 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Updating inventory in ProviderTree for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 23:03:04.494892 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:04.554944 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4da84f4b-f47c-400f-8433-0d80df05ad11 req-b1318bfd-210d-4019-8f55-4e66b6547dda service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:04.561400 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Refreshing aggregate associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, aggregates: None {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 27 23:03:04.601878 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999743887000022 future=<Future at 0x726e60228260 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:04.644781 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Refreshing trait associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_PPC64LE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_AARCH64,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_STATELESS_FIRMWARE {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 27 23:03:04.751579 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4da84f4b-f47c-400f-8433-0d80df05ad11 req-b1318bfd-210d-4019-8f55-4e66b6547dda service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:04.838860 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:03:04.852515 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:04.892915 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] End _get_guest_xml xml=<domain type="qemu">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <uuid>542edc82-9617-4269-b95c-523000992ff8</uuid>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <name>instance-00000014</name>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumesNegativeTest-instance-929057079</nova:name>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:03:04</nova:creationTime>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:user uuid="4dc22bdfd81e4dc385d8743f9b0e0432">tempest-VolumesNegativeTest-578680527-project-member</nova:user>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:project uuid="0b736f014aad408ab49531699331775f">tempest-VolumesNegativeTest-578680527</nova:project>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         <nova:port uuid="247919d2-832d-428e-ba48-4f45a0c6c84b">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="192.168.233.218" ipVersion="4"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <system>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <entry name="serial">542edc82-9617-4269-b95c-523000992ff8</entry>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <entry name="uuid">542edc82-9617-4269-b95c-523000992ff8</entry>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     </system>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <os>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   </os>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <features>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   </features>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   <devices>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk.config"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:86:fc:ba"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <target dev="tap247919d2-83"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/console.log" append="off"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     </serial>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <video>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     </video>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     </rng>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:   </devices>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]: </domain>
May 27 23:03:04.892915 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:03:04.895316 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Preparing to wait for external event network-vif-plugged-247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:04.895316 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Acquiring lock "542edc82-9617-4269-b95c-523000992ff8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:04.895316 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "542edc82-9617-4269-b95c-523000992ff8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:04.895316 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "542edc82-9617-4269-b95c-523000992ff8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:04.895316 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-929057079',display_name='tempest-VolumesNegativeTest-instance-929057079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesnegativetest-instance-929057079',id=20,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b736f014aad408ab49531699331775f',ramdisk_id='',reservation_id='r-it24xvqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-578680527',owner_user_name='tempest-VolumesNegativeTest-578680527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:02Z,user_data=None,user_id='4dc22bdfd81e4dc385d8743f9b0e0432',uuid=542edc82-9617-4269-b95c-523000992ff8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "247919d2-832d-428e-ba48-4f45a0c6c84b", "address": "fa:16:3e:86:fc:ba", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap247919d2-83", "ovs_interfaceid": "247919d2-832d-428e-ba48-4f45a0c6c84b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:04.895521 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Converting VIF {"id": "247919d2-832d-428e-ba48-4f45a0c6c84b", "address": "fa:16:3e:86:fc:ba", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap247919d2-83", "ovs_interfaceid": "247919d2-832d-428e-ba48-4f45a0c6c84b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:04.898556 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:fc:ba,bridge_name='br-int',has_traffic_filtering=True,id=247919d2-832d-428e-ba48-4f45a0c6c84b,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247919d2-83') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:04.899154 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:fc:ba,bridge_name='br-int',has_traffic_filtering=True,id=247919d2-832d-428e-ba48-4f45a0c6c84b,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247919d2-83') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:04.899652 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:04.900469 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:04.900735 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:04.902166 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:04.902385 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb8accf9-8125-5bdb-a07f-b2674b71d569', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:04.905484 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:04.905484 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:04.912208 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:04.912495 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap247919d2-83, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:04.913656 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap247919d2-83, col_values=(('qos', UUID('c1788889-2bb6-4f39-99cf-8689b9a226c6')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:04.913656 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap247919d2-83, col_values=(('external_ids', {'iface-id': '247919d2-832d-428e-ba48-4f45a0c6c84b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:fc:ba', 'vm-uuid': '542edc82-9617-4269-b95c-523000992ff8'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:04.914007 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:04.915537 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:04.923729 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:04.929721 np0000001565 nova-compute[98289]: INFO os_vif [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:fc:ba,bridge_name='br-int',has_traffic_filtering=True,id=247919d2-832d-428e-ba48-4f45a0c6c84b,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247919d2-83')
May 27 23:03:04.962518 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Successfully updated port: 0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:03:05.023388 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4da84f4b-f47c-400f-8433-0d80df05ad11 req-b1318bfd-210d-4019-8f55-4e66b6547dda service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:05.247291 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:05.281743 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Successfully updated port: 22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:03:05.310976 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:05.464580 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "refresh_cache-59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:05.464685 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquired lock "refresh_cache-59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:05.464807 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:03:05.472878 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3971bad4-6293-4741-84ad-282bbd7879fc req-413105bb-4206-439b-b3ba-bc87634f6417 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-changed-22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:05.473046 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3971bad4-6293-4741-84ad-282bbd7879fc req-413105bb-4206-439b-b3ba-bc87634f6417 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing instance network info cache due to event network-changed-22db9eb7-e550-46da-9fd0-082bc64ad74f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:05.473997 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3971bad4-6293-4741-84ad-282bbd7879fc req-413105bb-4206-439b-b3ba-bc87634f6417 service nova] Acquiring lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:05.485835 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Updated VIF entry in instance network info cache for port 247919d2-832d-428e-ba48-4f45a0c6c84b. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:03:05.486227 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Updating instance_info_cache with network_info: [{"id": "247919d2-832d-428e-ba48-4f45a0c6c84b", "address": "fa:16:3e:86:fc:ba", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap247919d2-83", "ovs_interfaceid": "247919d2-832d-428e-ba48-4f45a0c6c84b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:05.525384 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4da84f4b-f47c-400f-8433-0d80df05ad11 req-b1318bfd-210d-4019-8f55-4e66b6547dda service nova] Releasing lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:05.525704 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-324464e1-2b8b-4cb6-a0d4-d0c584d2ec9c req-48171a17-c7db-470d-abab-da13d8927d58 service nova] Acquired lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:05.525801 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-324464e1-2b8b-4cb6-a0d4-d0c584d2ec9c req-48171a17-c7db-470d-abab-da13d8927d58 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing network info cache for port b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:05.533006 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:03:05.533006 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:03:05.749046 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Took 1.34 seconds to deallocate network for instance.
May 27 23:03:05.783678 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:05.843968 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:03:05.845109 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:03:05.845430 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Creating image(s)
May 27 23:03:05.845887 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "/opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:05.846065 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:05.846838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:05.847388 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:05.851023 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:05.852094 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:05.939136 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:05.939714 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:05.940168 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:05.940657 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:05.947550 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:05.947901 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:05.989652 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Releasing lock "refresh_cache-542edc82-9617-4269-b95c-523000992ff8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:05.990037 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-changed-22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:05.990263 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing instance network info cache due to event network-changed-22a9c0da-759e-45d4-8c4a-0f0afe6d472e. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:05.990556 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Acquiring lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:06.030912 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-324464e1-2b8b-4cb6-a0d4-d0c584d2ec9c req-48171a17-c7db-470d-abab-da13d8927d58 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:06.035203 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:03:06.041609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:06.042069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:06.065984 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:06.091122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk 1073741824" returned: 0 in 0.049s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:06.091550 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:06.091820 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:06.173415 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-324464e1-2b8b-4cb6-a0d4-d0c584d2ec9c req-48171a17-c7db-470d-abab-da13d8927d58 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:06.178868 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:06.179318 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:03:06.179548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:06.259089 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:06.259640 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:06.259933 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Cannot resize image /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:03:06.260245 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:03:06.260443 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Ensure instance console log exists: /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:03:06.260664 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:06.260852 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:06.260993 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:06.281763 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-83169847-3209-452b-8ffd-cfb8d017d42c req-e0b1b341-973e-4270-89ca-cabd52406fed service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Received event network-vif-deleted-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:06.325448 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:06.345469 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e5ce0920-a3ec-4475-93cd-2cf8bb8b38ca req-376062ab-40a7-4c40-b8c6-cafb95a0b0d5 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Received event network-changed-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:06.345571 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e5ce0920-a3ec-4475-93cd-2cf8bb8b38ca req-376062ab-40a7-4c40-b8c6-cafb95a0b0d5 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Refreshing instance network info cache due to event network-changed-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:06.345754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e5ce0920-a3ec-4475-93cd-2cf8bb8b38ca req-376062ab-40a7-4c40-b8c6-cafb95a0b0d5 service nova] Acquiring lock "refresh_cache-59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:06.363579 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-324464e1-2b8b-4cb6-a0d4-d0c584d2ec9c req-48171a17-c7db-470d-abab-da13d8927d58 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:06.453751 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:06.453909 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:06.453954 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] No VIF found with MAC fa:16:3e:86:fc:ba, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:06.454893 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Using config drive
May 27 23:03:06.478449 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Updating instance_info_cache with network_info: [{"id": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "address": "fa:16:3e:09:38:3a", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd725ff-8e", "ovs_interfaceid": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:06.542529 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.218s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:06.543252 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.284s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:06.543450 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:03:06.865825 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-324464e1-2b8b-4cb6-a0d4-d0c584d2ec9c req-48171a17-c7db-470d-abab-da13d8927d58 service nova] Releasing lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:06.866068 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3971bad4-6293-4741-84ad-282bbd7879fc req-413105bb-4206-439b-b3ba-bc87634f6417 service nova] Acquired lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:06.866279 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3971bad4-6293-4741-84ad-282bbd7879fc req-413105bb-4206-439b-b3ba-bc87634f6417 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing network info cache for port 22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:06.960114 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:06.980526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Releasing lock "refresh_cache-59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:06.980763 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Instance network_info: |[{"id": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "address": "fa:16:3e:09:38:3a", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd725ff-8e", "ovs_interfaceid": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:03:06.981023 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e5ce0920-a3ec-4475-93cd-2cf8bb8b38ca req-376062ab-40a7-4c40-b8c6-cafb95a0b0d5 service nova] Acquired lock "refresh_cache-59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:06.981154 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e5ce0920-a3ec-4475-93cd-2cf8bb8b38ca req-376062ab-40a7-4c40-b8c6-cafb95a0b0d5 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Refreshing network info cache for port 0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:06.985668 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Start _get_guest_xml network_info=[{"id": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "address": "fa:16:3e:09:38:3a", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd725ff-8e", "ovs_interfaceid": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:03:06.995728 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:03:06.995728 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1449943138', uuid='59ef4a49-bfd7-490d-8d17-a371b7ed4c4d'), owner=OwnerMeta(userid='6037b0819a94463e8e45d96f834c4341', username='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member', projectid='9818a7ed096346eb92128648c4280071', projectname='tempest-ServerBootFromVolumeStableRescueTest-800872693'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "address": "fa:16:3e:09:38:3a", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd725ff-8e", "ovs_interfaceid": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922986.9950178) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:03:06.997710 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:03:06.998497 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:03:07.002353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:03:07.003049 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:03:07.003567 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:03:07.023037 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1449943138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-1449943138',id=21,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-9lo0ul3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:05Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=59ef4a49-bfd7-490d-8d17-a371b7ed4c4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "address": "fa:16:3e:09:38:3a", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd725ff-8e", "ovs_interfaceid": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:07.023612 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "address": "fa:16:3e:09:38:3a", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd725ff-8e", "ovs_interfaceid": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:07.024241 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:38:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd725ff-8e') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:07.026323 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'pci_devices' on Instance uuid 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:07.058540 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:03:07.063208 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:03:07.063208 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:07.063208 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:07.164563 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Creating config drive at /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk.config
May 27 23:03:07.168712 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz0maw5s4 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:07.203128 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c6d94c1e6da4237aa5dd517c31e03d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec877dc7b2240969ac89c13673f8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:03:07.222655 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz0maw5s4" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:07.285245 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:03:07.285685 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:03:07.369956 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3971bad4-6293-4741-84ad-282bbd7879fc req-413105bb-4206-439b-b3ba-bc87634f6417 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:07.488489 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-e5ce0920-a3ec-4475-93cd-2cf8bb8b38ca req-376062ab-40a7-4c40-b8c6-cafb95a0b0d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:07.497767 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3971bad4-6293-4741-84ad-282bbd7879fc req-413105bb-4206-439b-b3ba-bc87634f6417 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:07.531301 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] End _get_guest_xml xml=<domain type="qemu">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <uuid>59ef4a49-bfd7-490d-8d17-a371b7ed4c4d</uuid>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <name>instance-00000015</name>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1449943138</nova:name>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:03:06</nova:creationTime>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:user uuid="6037b0819a94463e8e45d96f834c4341">tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member</nova:user>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:project uuid="9818a7ed096346eb92128648c4280071">tempest-ServerBootFromVolumeStableRescueTest-800872693</nova:project>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         <nova:port uuid="0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <system>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <entry name="serial">59ef4a49-bfd7-490d-8d17-a371b7ed4c4d</entry>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <entry name="uuid">59ef4a49-bfd7-490d-8d17-a371b7ed4c4d</entry>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     </system>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <os>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   </os>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <features>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   </features>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   <devices>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk.config"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:09:38:3a"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <target dev="tap0dd725ff-8e"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/console.log" append="off"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     </serial>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <video>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     </video>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     </rng>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:   </devices>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]: </domain>
May 27 23:03:07.531301 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:03:07.534211 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Preparing to wait for external event network-vif-plugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:07.534211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:07.534211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:07.534211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:07.534211 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1449943138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-1449943138',id=21,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-9lo0ul3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:05Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=59ef4a49-bfd7-490d-8d17-a371b7ed4c4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "address": "fa:16:3e:09:38:3a", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd725ff-8e", "ovs_interfaceid": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:07.534472 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "address": "fa:16:3e:09:38:3a", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd725ff-8e", "ovs_interfaceid": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:07.534472 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:38:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd725ff-8e') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:07.534549 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:38:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd725ff-8e') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:07.535080 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:07.535645 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:07.535984 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:07.537300 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:07.537550 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ae97b12-2573-5413-bad2-08ad69cc0ac5', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:07.538485 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:07.539434 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:07.546603 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:07.550367 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:07.550367 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dd725ff-8e, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:07.550514 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dd725ff-8e, col_values=(('qos', UUID('355dfe2a-2136-4e6e-b643-98e1145a92f0')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:07.550713 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dd725ff-8e, col_values=(('external_ids', {'iface-id': '0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:38:3a', 'vm-uuid': '59ef4a49-bfd7-490d-8d17-a371b7ed4c4d'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:07.552310 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:07.555441 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:07.561745 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:03:07.568450 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:07.570155 np0000001565 nova-compute[98289]: INFO os_vif [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:38:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd725ff-8e')
May 27 23:03:07.729163 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:07.755348 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0015403810000407248 future=<Future at 0x726e581880b0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:07.755348 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:07.755348 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.8438166979999551 future=<Future at 0x726e60106fc0 state=cancelled>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:07.755348 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.8436101439999675 future=<Future at 0x726e60106fc0 state=cancelled>) was cancelled while queued, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:07.755555 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:07.755555 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=11.846054049000031 future=<Future at 0x726e60228260 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:07.755637 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=11.845951946000014 future=<Future at 0x726e60228260 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:07.789812 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3971bad4-6293-4741-84ad-282bbd7879fc req-413105bb-4206-439b-b3ba-bc87634f6417 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:07.793602 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:03:07.810325 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:07.812799 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:07.866961 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:07.999213 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-e5ce0920-a3ec-4475-93cd-2cf8bb8b38ca req-376062ab-40a7-4c40-b8c6-cafb95a0b0d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:08.065826 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:03:08.089995 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ab23e47c-9133-4500-b626-dab9ed56e944 req-8a43baff-01d7-4eeb-b184-682530d820a6 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Received event network-vif-plugged-247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:08.091013 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ab23e47c-9133-4500-b626-dab9ed56e944 req-8a43baff-01d7-4eeb-b184-682530d820a6 service nova] Acquiring lock "542edc82-9617-4269-b95c-523000992ff8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:08.093281 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ab23e47c-9133-4500-b626-dab9ed56e944 req-8a43baff-01d7-4eeb-b184-682530d820a6 service nova] Lock "542edc82-9617-4269-b95c-523000992ff8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:08.093281 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ab23e47c-9133-4500-b626-dab9ed56e944 req-8a43baff-01d7-4eeb-b184-682530d820a6 service nova] Lock "542edc82-9617-4269-b95c-523000992ff8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:08.093281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ab23e47c-9133-4500-b626-dab9ed56e944 req-8a43baff-01d7-4eeb-b184-682530d820a6 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Processing event network-vif-plugged-247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:08.138722 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:08.148155 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:08.151443 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:08.176791 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:08.182505 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e5ce0920-a3ec-4475-93cd-2cf8bb8b38ca req-376062ab-40a7-4c40-b8c6-cafb95a0b0d5 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Updated VIF entry in instance network info cache for port 0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:03:08.183131 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e5ce0920-a3ec-4475-93cd-2cf8bb8b38ca req-376062ab-40a7-4c40-b8c6-cafb95a0b0d5 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Updating instance_info_cache with network_info: [{"id": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "address": "fa:16:3e:09:38:3a", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd725ff-8e", "ovs_interfaceid": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:08.186366 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:08.294385 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3971bad4-6293-4741-84ad-282bbd7879fc req-413105bb-4206-439b-b3ba-bc87634f6417 service nova] Releasing lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:08.294385 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquired lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:08.294385 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:03:08.302839 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.760s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:08.357514 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Deleted allocations for instance 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512
May 27 23:03:08.430478 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Successfully created port: fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:03:08.608572 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922988.6081347, 542edc82-9617-4269-b95c-523000992ff8 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:08.609188 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:03:08.609373 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 542edc82-9617-4269-b95c-523000992ff8] VM Started (Lifecycle Event)
May 27 23:03:08.619003 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:03:08.621126 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 542edc82-9617-4269-b95c-523000992ff8] Instance spawned successfully.
May 27 23:03:08.621448 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:03:08.685738 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e5ce0920-a3ec-4475-93cd-2cf8bb8b38ca req-376062ab-40a7-4c40-b8c6-cafb95a0b0d5 service nova] Releasing lock "refresh_cache-59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:08.907555 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:08.941902 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Successfully updated port: fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:03:09.075147 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:03:09.077434 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:03:09.077434 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Creating image(s)
May 27 23:03:09.077434 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:09.077434 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:09.077434 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:09.077780 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:09.081046 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:09.082200 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:09.101817 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:09.112320 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:09.112520 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:09.112673 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No VIF found with MAC fa:16:3e:09:38:3a, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:09.114816 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Using config drive
May 27 23:03:09.117722 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 542edc82-9617-4269-b95c-523000992ff8] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:09.121983 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 542edc82-9617-4269-b95c-523000992ff8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:09.128465 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:09.129665 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:09.130230 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:09.130777 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:09.131101 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:09.131415 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:09.185204 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:09.185794 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:09.186857 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:09.187468 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:09.190639 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:09.192239 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:09.316420 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.125s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:09.316994 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:09.369620 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da8777ef-3ba9-4301-b589-5769c58c38fd tempest-VolumesAdminNegativeTest-1854316783 tempest-VolumesAdminNegativeTest-1854316783-project-member] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.868s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:09.379530 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk 1073741824" returned: 0 in 0.063s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:09.379914 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:09.380227 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:09.445320 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:09.445320 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:09.445320 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:03:09.473475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:09.473475 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:03:09.473475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:09.522832 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:09.562820 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:09.563393 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Cannot resize image /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:03:09.563527 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:03:09.563635 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Ensure instance console log exists: /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:03:09.563872 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:09.564097 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:09.564226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:09.624612 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:09.630548 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 542edc82-9617-4269-b95c-523000992ff8] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:03:09.631000 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922989.630781, 542edc82-9617-4269-b95c-523000992ff8 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:09.631122 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 542edc82-9617-4269-b95c-523000992ff8] VM Paused (Lifecycle Event)
May 27 23:03:09.638446 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Took 6.91 seconds to spawn the instance on the hypervisor.
May 27 23:03:09.640068 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:09.810471 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Creating config drive at /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk.config
May 27 23:03:09.813601 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp021uuuzs {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:09.861433 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp021uuuzs" returned: 0 in 0.048s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:09.876925 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:10.027626 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:10.139709 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 542edc82-9617-4269-b95c-523000992ff8] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:10.146312 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922990.1458242, 542edc82-9617-4269-b95c-523000992ff8 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:10.148133 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 542edc82-9617-4269-b95c-523000992ff8] VM Resumed (Lifecycle Event)
May 27 23:03:10.153537 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Took 15.70 seconds to build instance.
May 27 23:03:10.161478 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Received event network-vif-plugged-247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:10.164437 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] Acquiring lock "542edc82-9617-4269-b95c-523000992ff8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:10.164437 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] Lock "542edc82-9617-4269-b95c-523000992ff8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:10.164437 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] Lock "542edc82-9617-4269-b95c-523000992ff8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:10.165133 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] No waiting events found dispatching network-vif-plugged-247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:10.165133 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Received unexpected event network-vif-plugged-247919d2-832d-428e-ba48-4f45a0c6c84b for instance with vm_state active and task_state None.
May 27 23:03:10.165133 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Received event network-changed-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:10.165133 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Refreshing instance network info cache due to event network-changed-fa19979e-8452-466d-983f-af63f239ced4. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:10.165133 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] Acquiring lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:10.218903 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:10.274722 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:10.341312 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:10.372010 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:10.439391 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Updating instance_info_cache with network_info: [{"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:10.464429 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:10.540677 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:10.541493 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:10.627523 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:10.627717 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:10.653812 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 542edc82-9617-4269-b95c-523000992ff8] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:10.655814 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 542edc82-9617-4269-b95c-523000992ff8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:10.657759 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "542edc82-9617-4269-b95c-523000992ff8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.213s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:10.698169 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c84ee6b3-5c37-4476-96ea-d9185b8722e6 req-34b82e19-a84f-4c12-9aac-a60b29c52021 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Received event network-vif-plugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:10.698169 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c84ee6b3-5c37-4476-96ea-d9185b8722e6 req-34b82e19-a84f-4c12-9aac-a60b29c52021 service nova] Acquiring lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:10.698413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c84ee6b3-5c37-4476-96ea-d9185b8722e6 req-34b82e19-a84f-4c12-9aac-a60b29c52021 service nova] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:10.698413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c84ee6b3-5c37-4476-96ea-d9185b8722e6 req-34b82e19-a84f-4c12-9aac-a60b29c52021 service nova] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:10.698538 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c84ee6b3-5c37-4476-96ea-d9185b8722e6 req-34b82e19-a84f-4c12-9aac-a60b29c52021 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Processing event network-vif-plugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:10.701261 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:10.942430 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:10.943271 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Instance network_info: |[{"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:03:10.947862 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Start _get_guest_xml network_info=[{"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:03:10.948947 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] Acquired lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:10.949649 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Refreshing network info cache for port fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:10.954052 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:03:10.957073 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='6ab04c1a-7858-471e-95fd-5b04d1da3061'), owner=OwnerMeta(userid='2c6d94c1e6da4237aa5dd517c31e03d7', username='tempest-AttachVolumeMultiAttachTest-781715127-project-member', projectid='0ec877dc7b2240969ac89c13673f8799', projectname='tempest-AttachVolumeMultiAttachTest-781715127'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922990.9566371) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:03:10.962361 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:03:10.962361 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:03:10.964265 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:03:10.964615 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:03:10.965636 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:03:10.966071 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:03:10.966275 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:03:10.966419 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:03:10.966749 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:03:10.967023 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:03:10.967187 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:03:10.967393 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:03:10.967690 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:03:10.967802 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:03:10.968942 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:03:10.969113 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:03:10.990271 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-1',id=22,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-kihy0sqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=6ab04c1a-7858-471e-95fd-5b04d1da3061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:10.990489 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:10.991185 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f3:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa19979e-8452-466d-983f-af63f239ced4,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa19979e-84') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:10.992157 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ab04c1a-7858-471e-95fd-5b04d1da3061 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:11.039709 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:11.132475 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:03:11.334809 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:11.349564 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922991.3485203, 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:11.349564 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] VM Started (Lifecycle Event)
May 27 23:03:11.350376 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:03:11.355382 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:03:11.358289 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Instance spawned successfully.
May 27 23:03:11.358714 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:03:11.383406 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:11.453228 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:11.494967 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] End _get_guest_xml xml=<domain type="qemu">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <uuid>6ab04c1a-7858-471e-95fd-5b04d1da3061</uuid>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <name>instance-00000016</name>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <nova:name>multiattach-server-1</nova:name>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:03:10</nova:creationTime>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:user uuid="2c6d94c1e6da4237aa5dd517c31e03d7">tempest-AttachVolumeMultiAttachTest-781715127-project-member</nova:user>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:project uuid="0ec877dc7b2240969ac89c13673f8799">tempest-AttachVolumeMultiAttachTest-781715127</nova:project>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         <nova:port uuid="fa19979e-8452-466d-983f-af63f239ced4">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <system>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <entry name="serial">6ab04c1a-7858-471e-95fd-5b04d1da3061</entry>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <entry name="uuid">6ab04c1a-7858-471e-95fd-5b04d1da3061</entry>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     </system>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <os>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   </os>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <features>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   </features>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   <devices>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk.config"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:62:f3:f7"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <target dev="tapfa19979e-84"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/console.log" append="off"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     </serial>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <video>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     </video>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     </rng>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:   </devices>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]: </domain>
May 27 23:03:11.494967 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:03:11.498379 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Preparing to wait for external event network-vif-plugged-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:11.498379 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:11.498379 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:11.498379 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:11.498379 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-1',id=22,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-kihy0sqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=6ab04c1a-7858-471e-95fd-5b04d1da3061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:11.498713 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:11.498713 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f3:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa19979e-8452-466d-983f-af63f239ced4,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa19979e-84') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:11.498713 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f3:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa19979e-8452-466d-983f-af63f239ced4,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa19979e-84') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:11.498985 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:11.499345 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:11.499598 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:11.502351 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:11.503152 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c73a8f0-ec90-542b-a95f-15d7e55ec086', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:11.503516 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:11.504150 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:11.504956 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:11.509075 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:11.509296 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa19979e-84, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:11.509638 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa19979e-84, col_values=(('qos', UUID('0c73bf12-76ba-405d-82b0-3e19e698c3ed')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:11.509817 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa19979e-84, col_values=(('external_ids', {'iface-id': 'fa19979e-8452-466d-983f-af63f239ced4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:f3:f7', 'vm-uuid': '6ab04c1a-7858-471e-95fd-5b04d1da3061'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:11.510706 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:11.515354 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:11.516322 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:11.517757 np0000001565 nova-compute[98289]: INFO os_vif [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f3:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa19979e-8452-466d-983f-af63f239ced4,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa19979e-84')
May 27 23:03:11.526913 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating instance_info_cache with network_info: [{"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:11.669391 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Acquiring lock "542edc82-9617-4269-b95c-523000992ff8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:11.669592 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "542edc82-9617-4269-b95c-523000992ff8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:11.669686 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Acquiring lock "542edc82-9617-4269-b95c-523000992ff8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:11.669866 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "542edc82-9617-4269-b95c-523000992ff8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:11.670081 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "542edc82-9617-4269-b95c-523000992ff8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:11.672835 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Terminating instance
May 27 23:03:11.713078 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:11.713427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:11.716170 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:03:11.716287 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Claim successful on node np0000001565
May 27 23:03:11.828031 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:11.851624 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:11.853971 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:11.867352 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:11.867352 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:11.867352 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:11.867352 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:11.867352 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:11.867352 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:12.018489 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Updated VIF entry in instance network info cache for port fa19979e-8452-466d-983f-af63f239ced4. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:03:12.019797 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Updating instance_info_cache with network_info: [{"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:12.030103 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Releasing lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:12.030220 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Instance network_info: |[{"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:03:12.030828 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Acquired lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:12.030828 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing network info cache for port 22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:12.034733 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Start _get_guest_xml network_info=[{"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1224d61a-1d74-4d4b-b7c1-fcfd8f98ff6f', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc4f800f-0613-4549-b71f-5ee16605c497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc4f800f-0613-4549-b71f-5ee16605c497', 'serial': 'fc4f800f-0613-4549-b71f-5ee16605c497'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'attachment_id': 'b910c1a8-402e-4d3e-8bcd-97d23d185429', 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15648881-dc61-473b-8ee5-31bf6ade7f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539', 'attached_at': '', 'detached_at': '', 'volume_id': '15648881-dc61-473b-8ee5-31bf6ade7f69', 'serial': '15648881-dc61-473b-8ee5-31bf6ade7f69'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'attachment_id': 'f08f8a27-b5b2-4981-b3f3-13617ddf57b1', 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7613ef2-f3e5-460b-b93b-ac85d1586207', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7613ef2-f3e5-460b-b93b-ac85d1586207', 'serial': 'a7613ef2-f3e5-460b-b93b-ac85d1586207'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:03:12.048176 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:03:12.051778 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1620832723', uuid='0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539'), owner=OwnerMeta(userid='e339645d1b454fa4b8bb89a20c0bf898', username='tempest-TaggedBootDevicesTest-439981373-project-member', projectid='e8214904c18049c086910b7b20b109b2', projectname='tempest-TaggedBootDevicesTest-439981373'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922992.0502865) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:03:12.053421 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:03:12.054039 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:03:12.055402 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:03:12.055608 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:03:12.056786 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:03:12.057182 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:03:12.057357 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:03:12.057507 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:03:12.057712 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:03:12.057884 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:03:12.059951 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:03:12.060156 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:03:12.060294 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:03:12.060466 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:03:12.060606 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:03:12.061009 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:03:12.074562 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:03:12.076006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc4f800f-0613-4549-b71f-5ee16605c497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:12.076006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:12.076006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:12.076006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc4f800f-0613-4549-b71f-5ee16605c497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:03:12.091136 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:12.092492 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:12.093469 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:12.093731 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:12.094487 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:12.096972 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:12.106070 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:12.106070 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:12.113732 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:12.113732 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:12.121245 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497] added
May 27 23:03:12.121245 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:12.121245 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:12.121245 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:12.121245 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:12.121245 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:12.121245 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:12.121573 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:12.121777 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:12.121991 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:12.124324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497] added
May 27 23:03:12.124324 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:12.124324 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:12.124324 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:12.124324 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:12.124324 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:12.124324 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:12.124544 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:12.124689 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:12.124839 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:12.176458 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:03:12.205065 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:12.236630 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:12.266966 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:12.355741 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:03:12.356274 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922992.355819, 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:12.356274 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] VM Paused (Lifecycle Event)
May 27 23:03:12.372413 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Took 6.53 seconds to spawn the instance on the hypervisor.
May 27 23:03:12.372413 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:12.463060 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-93832138-08b2-4a9c-b110-3d358cf20488 req-cce08c77-2105-4899-a8eb-8945fe2b4402 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Received event network-vif-unplugged-247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:12.464357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-93832138-08b2-4a9c-b110-3d358cf20488 req-cce08c77-2105-4899-a8eb-8945fe2b4402 service nova] Acquiring lock "542edc82-9617-4269-b95c-523000992ff8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:12.464588 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-93832138-08b2-4a9c-b110-3d358cf20488 req-cce08c77-2105-4899-a8eb-8945fe2b4402 service nova] Lock "542edc82-9617-4269-b95c-523000992ff8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:12.464745 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-93832138-08b2-4a9c-b110-3d358cf20488 req-cce08c77-2105-4899-a8eb-8945fe2b4402 service nova] Lock "542edc82-9617-4269-b95c-523000992ff8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:12.464901 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-93832138-08b2-4a9c-b110-3d358cf20488 req-cce08c77-2105-4899-a8eb-8945fe2b4402 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] No waiting events found dispatching network-vif-unplugged-247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:12.466518 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-93832138-08b2-4a9c-b110-3d358cf20488 req-cce08c77-2105-4899-a8eb-8945fe2b4402 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Received event network-vif-unplugged-247919d2-832d-428e-ba48-4f45a0c6c84b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:03:12.494169 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:12.508369 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:12.520031 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 542edc82-9617-4269-b95c-523000992ff8] Instance destroyed successfully.
May 27 23:03:12.520995 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lazy-loading 'resources' on Instance uuid 542edc82-9617-4269-b95c-523000992ff8 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:12.522547 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c76fa0b6-8ea3-415a-ae64-9f00051f65f4 req-4ed2507c-7c04-456f-af76-12f3c26b4448 service nova] Releasing lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:12.543163 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:12.767599 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c89dde02-dd30-4f01-8d37-82a28e818d25 req-806eed74-0bcf-440b-b702-d10809909c12 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Received event network-vif-plugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:12.768456 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c89dde02-dd30-4f01-8d37-82a28e818d25 req-806eed74-0bcf-440b-b702-d10809909c12 service nova] Acquiring lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:12.769635 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c89dde02-dd30-4f01-8d37-82a28e818d25 req-806eed74-0bcf-440b-b702-d10809909c12 service nova] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:12.769635 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c89dde02-dd30-4f01-8d37-82a28e818d25 req-806eed74-0bcf-440b-b702-d10809909c12 service nova] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:12.769635 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c89dde02-dd30-4f01-8d37-82a28e818d25 req-806eed74-0bcf-440b-b702-d10809909c12 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] No waiting events found dispatching network-vif-plugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:12.769635 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c89dde02-dd30-4f01-8d37-82a28e818d25 req-806eed74-0bcf-440b-b702-d10809909c12 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Received unexpected event network-vif-plugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 for instance with vm_state active and task_state None.
May 27 23:03:12.861349 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:12.863217 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922992.8630383, 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:12.863324 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] VM Resumed (Lifecycle Event)
May 27 23:03:12.879420 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Took 13.46 seconds to build instance.
May 27 23:03:12.920165 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:13.024412 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-929057079',display_name='tempest-VolumesNegativeTest-instance-929057079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesnegativetest-instance-929057079',id=20,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:09Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b736f014aad408ab49531699331775f',ramdisk_id='',reservation_id='r-it24xvqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-578680527',owner_user_name='tempest-VolumesNegativeTest-578680527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:10Z,user_data=None,user_id='4dc22bdfd81e4dc385d8743f9b0e0432',uuid=542edc82-9617-4269-b95c-523000992ff8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "247919d2-832d-428e-ba48-4f45a0c6c84b", "address": "fa:16:3e:86:fc:ba", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap247919d2-83", "ovs_interfaceid": "247919d2-832d-428e-ba48-4f45a0c6c84b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:03:13.024666 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Converting VIF {"id": "247919d2-832d-428e-ba48-4f45a0c6c84b", "address": "fa:16:3e:86:fc:ba", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap247919d2-83", "ovs_interfaceid": "247919d2-832d-428e-ba48-4f45a0c6c84b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:13.025127 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:fc:ba,bridge_name='br-int',has_traffic_filtering=True,id=247919d2-832d-428e-ba48-4f45a0c6c84b,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247919d2-83') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:13.025613 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:fc:ba,bridge_name='br-int',has_traffic_filtering=True,id=247919d2-832d-428e-ba48-4f45a0c6c84b,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247919d2-83') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:03:13.026755 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:13.027854 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap247919d2-83, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:13.031751 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:13.035217 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:13.036146 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:13.036299 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1788889-2bb6-4f39-99cf-8689b9a226c6) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:13.037990 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:13.044918 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:13.049566 np0000001565 nova-compute[98289]: INFO os_vif [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:fc:ba,bridge_name='br-int',has_traffic_filtering=True,id=247919d2-832d-428e-ba48-4f45a0c6c84b,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap247919d2-83')
May 27 23:03:13.049926 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Deleting instance files /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8_del
May 27 23:03:13.051004 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Deletion of /opt/stack/data/nova/instances/542edc82-9617-4269-b95c-523000992ff8_del complete
May 27 23:03:13.055814 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:13.055965 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:13.056077 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:62:f3:f7, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:13.056504 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Using config drive
May 27 23:03:13.084204 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updated VIF entry in instance network info cache for port 22a9c0da-759e-45d4-8c4a-0f0afe6d472e. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:03:13.085064 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating instance_info_cache with network_info: [{"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:13.122822 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:13.125284 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:13.136999 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:13.136999 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:13.142676 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:13.142676 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:13.148656 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.165098 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:13.165098 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.192472 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:13.192472 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:13.206340 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497, portal: 192.168.50.100,3260]
May 27 23:03:13.206340 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497, portal: 192.168.50.100,3260] successful.
May 27 23:03:13.206340 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:13.221360 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:13.227495 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497, portal: 192.168.40.100,3260]
May 27 23:03:13.227495 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497, portal: 192.168.40.100,3260] successful.
May 27 23:03:13.227495 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:13.238820 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:13.239433 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.239433 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.239433 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.239433 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.239433 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.239433 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.239433 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:13.239433 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:13.239433 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:13.239641 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.239641 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.239641 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.239641 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.239641 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.239641 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.239641 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:13.239641 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:13.239641 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:13.239929 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:13.240016 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:13.240980 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] HCTL ('13', '-', '-', 0) found on session 24 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:13.241099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:13.257777 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.257777 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.257777 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.257777 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.257777 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.257777 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.257777 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:13.257777 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:13.257777 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:13.258144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.258144 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:13.258144 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.258144 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:13.258144 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.258144 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:13.258144 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:13.258144 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:13.258144 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:13.259144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:13.259144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:13.260515 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] HCTL ('14', '-', '-', 0) found on session 25 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:13.260697 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:13.272438 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Searching for a device in session 24 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:13.272586 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fc4f800f-0613-4549-b71f-5ee16605c497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:13.278859 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Searching for a device in session 25 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:13.281634 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc4f800f-0613-4549-b71f-5ee16605c497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:13.365809 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:13.374368 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:13.390105 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.979s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:13.491590 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:13.562542 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:13.564597 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 23:03:13.565468 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:03:13.565963 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:03:13.567671 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:03:13.568151 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 542edc82-9617-4269-b95c-523000992ff8] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:03:13.568839 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 542edc82-9617-4269-b95c-523000992ff8] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:03:13.569024 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:13.588159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Releasing lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:13.588357 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Received event network-vif-unplugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:13.588699 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Acquiring lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:13.588857 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:13.588960 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:13.589064 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] No waiting events found dispatching network-vif-unplugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:13.589172 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Received event network-vif-unplugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:03:13.589268 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Received event network-vif-unplugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:13.589419 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Acquiring lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:13.589524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:13.589617 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] Lock "0e5489ad-9907-4ba6-9ac6-2a93a7d4d512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:13.589708 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] No waiting events found dispatching network-vif-unplugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:13.589835 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9f8b710-72b8-4756-802f-c259e322d0e5 req-04e9f922-404c-4ae7-b87a-7043333fe116 service nova] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Received event network-vif-unplugged-cef5d64f-5532-4e5d-9be2-1db68a9f1d73 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:03:13.639262 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:13.737416 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Creating config drive at /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk.config
May 27 23:03:13.741461 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjn2bv8ht {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:13.794825 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjn2bv8ht" returned: 0 in 0.052s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:13.878857 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999519301999953 future=<Future at 0x726e601b3c50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:13.997422 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3965fb1b-d522-438b-b849-d5f1414f0919 req-9b43677f-2342-4181-8f77-87f89c2eec1f service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Received event network-vif-deleted-247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:13.999425 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-3965fb1b-d522-438b-b849-d5f1414f0919 req-9b43677f-2342-4181-8f77-87f89c2eec1f service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Neutron deleted interface 247919d2-832d-428e-ba48-4f45a0c6c84b; detaching it from the instance and deleting it from the info cache
May 27 23:03:13.999760 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3965fb1b-d522-438b-b849-d5f1414f0919 req-9b43677f-2342-4181-8f77-87f89c2eec1f service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Detach interface failed, port_id=247919d2-832d-428e-ba48-4f45a0c6c84b, reason: Instance 542edc82-9617-4269-b95c-523000992ff8 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:03:14.072134 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:03:14.094954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:03:14.256832 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:14.292298 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:14.295003 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:14.364047 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:14.450136 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 542edc82-9617-4269-b95c-523000992ff8] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:14.460373 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:14.538020 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-214c7d72-29e5-4383-a41e-3464e0a428a7 req-e39e67cb-77ce-4ab4-a507-50a957efea00 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Received event network-vif-unplugged-247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:14.538020 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-214c7d72-29e5-4383-a41e-3464e0a428a7 req-e39e67cb-77ce-4ab4-a507-50a957efea00 service nova] Acquiring lock "542edc82-9617-4269-b95c-523000992ff8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:14.538514 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-214c7d72-29e5-4383-a41e-3464e0a428a7 req-e39e67cb-77ce-4ab4-a507-50a957efea00 service nova] Lock "542edc82-9617-4269-b95c-523000992ff8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:14.538638 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-214c7d72-29e5-4383-a41e-3464e0a428a7 req-e39e67cb-77ce-4ab4-a507-50a957efea00 service nova] Lock "542edc82-9617-4269-b95c-523000992ff8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:14.540422 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-214c7d72-29e5-4383-a41e-3464e0a428a7 req-e39e67cb-77ce-4ab4-a507-50a957efea00 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] No waiting events found dispatching network-vif-unplugged-247919d2-832d-428e-ba48-4f45a0c6c84b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:14.540422 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-214c7d72-29e5-4383-a41e-3464e0a428a7 req-e39e67cb-77ce-4ab4-a507-50a957efea00 service nova] [instance: 542edc82-9617-4269-b95c-523000992ff8] Received event network-vif-unplugged-247919d2-832d-428e-ba48-4f45a0c6c84b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:03:14.580606 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.867s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:14.581067 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:03:14.849236 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fec3d4fd-a53d-4305-95dc-a0d9c5f05d18 req-d77d09a1-2422-4d9a-96b5-9e7d644ca76a service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Received event network-vif-plugged-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:14.850446 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fec3d4fd-a53d-4305-95dc-a0d9c5f05d18 req-d77d09a1-2422-4d9a-96b5-9e7d644ca76a service nova] Acquiring lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:14.850556 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fec3d4fd-a53d-4305-95dc-a0d9c5f05d18 req-d77d09a1-2422-4d9a-96b5-9e7d644ca76a service nova] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:14.850674 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fec3d4fd-a53d-4305-95dc-a0d9c5f05d18 req-d77d09a1-2422-4d9a-96b5-9e7d644ca76a service nova] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:14.850861 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fec3d4fd-a53d-4305-95dc-a0d9c5f05d18 req-d77d09a1-2422-4d9a-96b5-9e7d644ca76a service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Processing event network-vif-plugged-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:14.955078 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 542edc82-9617-4269-b95c-523000992ff8] Took 1.39 seconds to deallocate network for instance.
May 27 23:03:15.088653 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:03:15.088822 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:03:15.089035 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:15.089272 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:15.109961 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Found WWN 3300000006d1f1c02 for multipath device dm-5 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:03:15.110298 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:15.110526 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000006d1f1c02', 'path': '/dev/dm-5', 'multipath_id': '3300000006d1f1c02'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:15.114243 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d1f1c02', 'path': '/dev/dm-5', 'multipath_id': '3300000006d1f1c02'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:03:15.160992 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:03:15.162069 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922995.1601276, 6ab04c1a-7858-471e-95fd-5b04d1da3061 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:15.163730 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] VM Started (Lifecycle Event)
May 27 23:03:15.164729 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:03:15.169325 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Instance spawned successfully.
May 27 23:03:15.169884 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:03:15.193291 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f0d298d70064eac8ffd4fe25b1e203b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f15f51479c4e37ab880af2031170be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:03:15.471970 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:15.474387 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:15.474387 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:15.591967 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:03:15.614660 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:15.622430 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:03:15.622800 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15648881-dc61-473b-8ee5-31bf6ade7f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:15.622887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:15.624022 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:15.624214 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15648881-dc61-473b-8ee5-31bf6ade7f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:03:15.638469 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:15.639181 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:15.640096 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:15.640096 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:15.640444 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:15.640973 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:15.652690 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:15.652690 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:15.665147 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:15.665147 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:15.666731 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:15.668762 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:15.674413 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69] added
May 27 23:03:15.674413 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:15.674413 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:15.674413 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:15.674413 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:15.674413 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:15.674413 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:15.677078 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:15.677320 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0373(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:15.677468 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:15.680120 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:15.680676 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:15.680676 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:15.681046 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:15.682500 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:15.682912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69] added
May 27 23:03:15.682912 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:15.682912 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:15.682912 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:15.682912 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:15.682912 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:15.682912 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:15.683168 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:15.686426 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:15.686426 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0448(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:15.686426 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:15.768195 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Successfully created port: 5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:03:15.981294 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] instance snapshotting
May 27 23:03:16.095952 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:03:16.110912 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Beginning live snapshot process
May 27 23:03:16.172056 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:03:16.172056 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922996.1709077, 6ab04c1a-7858-471e-95fd-5b04d1da3061 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:16.172056 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] VM Paused (Lifecycle Event)
May 27 23:03:16.187602 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Took 7.11 seconds to spawn the instance on the hypervisor.
May 27 23:03:16.187982 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:16.254069 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:03:16.254295 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:03:16.362132 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Successfully updated port: 5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:03:16.438424 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1255298a-9bcc-46eb-928b-54bc8629b331 req-d9402a0e-e70a-442d-b260-d16a86bcd1e6 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-changed-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:16.438424 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1255298a-9bcc-46eb-928b-54bc8629b331 req-d9402a0e-e70a-442d-b260-d16a86bcd1e6 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Refreshing instance network info cache due to event network-changed-5497c3f3-3f6d-4932-b646-487b60e99781. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:16.438424 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1255298a-9bcc-46eb-928b-54bc8629b331 req-d9402a0e-e70a-442d-b260-d16a86bcd1e6 service nova] Acquiring lock "refresh_cache-09a47014-23a8-4dad-ab17-6df274ed8cf7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:16.438424 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1255298a-9bcc-46eb-928b-54bc8629b331 req-d9402a0e-e70a-442d-b260-d16a86bcd1e6 service nova] Acquired lock "refresh_cache-09a47014-23a8-4dad-ab17-6df274ed8cf7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:16.438424 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1255298a-9bcc-46eb-928b-54bc8629b331 req-d9402a0e-e70a-442d-b260-d16a86bcd1e6 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Refreshing network info cache for port 5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:16.656912 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:16.657208 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:16.673212 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:16.674675 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779922996.6744654, 6ab04c1a-7858-471e-95fd-5b04d1da3061 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:16.674813 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] VM Resumed (Lifecycle Event)
May 27 23:03:16.677866 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:16.686008 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:16.691851 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:16.691851 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:16.704053 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Took 14.08 seconds to build instance.
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:16.707312 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:16.707312 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:16.710009 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:16.722720 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:16.731547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.731547 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.731547 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.731547 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.731547 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.731547 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.731547 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.731547 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.731547 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:16.731726 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.731726 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.731726 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.731726 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.731726 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.731726 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.731726 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.731726 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.731726 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:16.738634 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.738634 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.738634 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.738634 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.738634 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.738634 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.738634 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.738634 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.738634 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:16.738845 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.738845 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.738845 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.738845 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.738845 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.738845 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.738845 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.738845 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.738845 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:16.757005 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:03:16.781579 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69, portal: 192.168.50.100,3260]
May 27 23:03:16.781579 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69, portal: 192.168.50.100,3260] successful.
May 27 23:03:16.781579 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:16.783241 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69, portal: 192.168.40.100,3260]
May 27 23:03:16.783241 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69, portal: 192.168.40.100,3260] successful.
May 27 23:03:16.783241 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:16.795059 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:16.800352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:16.809940 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.809940 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.809940 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.809940 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.809940 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.809940 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.809940 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.809940 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.809940 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:16.809940 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:16.809940 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:16.810195 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.810195 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.810195 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.810195 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.810195 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.810195 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.810195 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.810195 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.810195 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:16.810195 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:16.810195 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:16.810383 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:16.810452 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:16.811438 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] HCTL ('15', '-', '-', 0) found on session 26 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:16.811573 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:16.819593 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.819593 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.819593 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.819593 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.819593 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.819593 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.819593 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.819593 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.819593 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:16.819593 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:16.819593 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:16.819810 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.819810 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:16.819810 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.819810 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:16.819810 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.819810 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:16.819810 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.819810 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:16.819810 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:16.819810 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:16.819810 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:16.819988 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:16.820042 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:16.820882 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] HCTL ('16', '-', '-', 0) found on session 27 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:16.820980 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:16.826579 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Searching for a device in session 26 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:16.826579 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '15648881-dc61-473b-8ee5-31bf6ade7f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:16.835826 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Searching for a device in session 27 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:16.835826 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15648881-dc61-473b-8ee5-31bf6ade7f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:16.864128 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "refresh_cache-09a47014-23a8-4dad-ab17-6df274ed8cf7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:16.939933 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-1255298a-9bcc-46eb-928b-54bc8629b331 req-d9402a0e-e70a-442d-b260-d16a86bcd1e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:16.946967 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-71b545e1-6cf3-485e-aaa4-9228441ae3c5 req-36020a73-5cf5-4ed8-b000-211965ea8509 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Received event network-vif-plugged-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:16.947156 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-71b545e1-6cf3-485e-aaa4-9228441ae3c5 req-36020a73-5cf5-4ed8-b000-211965ea8509 service nova] Acquiring lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:16.947326 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-71b545e1-6cf3-485e-aaa4-9228441ae3c5 req-36020a73-5cf5-4ed8-b000-211965ea8509 service nova] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:16.949110 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-71b545e1-6cf3-485e-aaa4-9228441ae3c5 req-36020a73-5cf5-4ed8-b000-211965ea8509 service nova] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:16.949110 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-71b545e1-6cf3-485e-aaa4-9228441ae3c5 req-36020a73-5cf5-4ed8-b000-211965ea8509 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] No waiting events found dispatching network-vif-plugged-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:16.949313 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-71b545e1-6cf3-485e-aaa4-9228441ae3c5 req-36020a73-5cf5-4ed8-b000-211965ea8509 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Received unexpected event network-vif-plugged-fa19979e-8452-466d-983f-af63f239ced4 for instance with vm_state active and task_state None.
May 27 23:03:17.007738 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1255298a-9bcc-46eb-928b-54bc8629b331 req-d9402a0e-e70a-442d-b260-d16a86bcd1e6 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:17.111421 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:03:17.112348 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:03:17.112659 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Creating image(s)
May 27 23:03:17.113052 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:17.113239 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:17.113816 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:17.114274 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:17.117347 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:17.121849 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:17.139983 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1255298a-9bcc-46eb-928b-54bc8629b331 req-d9402a0e-e70a-442d-b260-d16a86bcd1e6 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:17.160694 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lazy-loading 'flavor' on Instance uuid 80c6eabe-0192-4030-a194-2d87bb638464 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:17.177127 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:17.179299 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:17.207116 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:17.207623 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:17.208057 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:17.209346 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:17.211992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.612s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:17.214307 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:17.214667 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:17.271038 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.796s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:17.303280 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:17.303677 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:17.349216 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Deleted allocations for instance 542edc82-9617-4269-b95c-523000992ff8
May 27 23:03:17.354447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk 1073741824" returned: 0 in 0.051s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:17.355070 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:17.356427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:17.465050 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.108s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:17.466995 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:03:17.466995 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:17.543008 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:17.543552 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Cannot resize image /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:03:17.544129 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:03:17.544405 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Ensure instance console log exists: /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:03:17.544802 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:17.545121 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:17.545319 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:17.636724 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk --force-share --output=json -f qcow2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:17.647222 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1255298a-9bcc-46eb-928b-54bc8629b331 req-d9402a0e-e70a-442d-b260-d16a86bcd1e6 service nova] Releasing lock "refresh_cache-09a47014-23a8-4dad-ab17-6df274ed8cf7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:17.648941 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquired lock "refresh_cache-09a47014-23a8-4dad-ab17-6df274ed8cf7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:17.649398 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:03:17.654395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:03:17.737737 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk --force-share --output=json -f qcow2" returned: 0 in 0.101s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:17.738254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk --force-share --output=json -f qcow2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:17.828536 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk --force-share --output=json -f qcow2" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:17.828536 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:17.833564 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:17.833564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:17.934962 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:17.935465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8r0f_mnh/b5b55c257b3947549556476a5b3e4a16.delta 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:17.988655 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8r0f_mnh/b5b55c257b3947549556476a5b3e4a16.delta 1073741824" returned: 0 in 0.052s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:17.989464 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Quiescing instance not available: QEMU guest agent is not enabled.
May 27 23:03:18.038252 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:18.171456 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:18.197400 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:18.234283 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:18.290427 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98289) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 23:03:18.295412 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Skipping quiescing instance: QEMU guest agent is not enabled.
May 27 23:03:18.339102 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:03:18.340059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8r0f_mnh/b5b55c257b3947549556476a5b3e4a16.delta /opt/stack/data/nova/instances/snapshots/tmp8r0f_mnh/b5b55c257b3947549556476a5b3e4a16 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:18.373349 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e0bc22dc-99a2-42b8-adfa-3095e2d70297 tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Lock "542edc82-9617-4269-b95c-523000992ff8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.703s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:18.426442 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:18.440905 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8r0f_mnh/b5b55c257b3947549556476a5b3e4a16.delta /opt/stack/data/nova/instances/snapshots/tmp8r0f_mnh/b5b55c257b3947549556476a5b3e4a16" returned: 0 in 0.101s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:18.444942 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Snapshot extracted, beginning image upload
May 27 23:03:18.602999 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Received event network-changed-2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:18.603504 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Refreshing instance network info cache due to event network-changed-2d9b8029-820b-4780-a69e-2a8cca380d8f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:18.603504 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] Acquiring lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:18.603572 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] Acquired lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:18.603710 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Refreshing network info cache for port 2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:18.614711 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Updating instance_info_cache with network_info: [{"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:18.670602 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Found WWN 330000000b9a12dde for multipath device dm-8 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:03:18.671173 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:18.671345 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '330000000b9a12dde', 'path': '/dev/dm-8', 'multipath_id': '330000000b9a12dde'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:18.671545 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b9a12dde', 'path': '/dev/dm-8', 'multipath_id': '330000000b9a12dde'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:03:19.106010 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:19.116863 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Releasing lock "refresh_cache-09a47014-23a8-4dad-ab17-6df274ed8cf7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:19.117104 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Instance network_info: |[{"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:03:19.119466 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Start _get_guest_xml network_info=[{"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:03:19.121962 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:03:19.124902 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-739387005', uuid='09a47014-23a8-4dad-ab17-6df274ed8cf7'), owner=OwnerMeta(userid='8f0d298d70064eac8ffd4fe25b1e203b', username='tempest-ServerActionsTestOtherA-1786604563-project-member', projectid='d6f15f51479c4e37ab880af2031170be', projectname='tempest-ServerActionsTestOtherA-1786604563'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779922999.1231017) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:03:19.125734 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:03:19.126185 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:03:19.127861 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:03:19.127861 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:03:19.128746 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:03:19.129156 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:03:19.129368 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:03:19.129513 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:03:19.129688 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:03:19.129815 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:03:19.129982 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:03:19.130162 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:03:19.130736 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:03:19.130736 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:03:19.130736 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:03:19.130821 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:03:19.151385 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-739387005',display_name='tempest-tempest.common.compute-instance-739387005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-tempest-common-compute-instance-739387005',id=23,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnodhAb2AYguwUd5MV+nvPGMbjwA3r/emEznS8hSo46pEnn++o3pinPXblU18rNwX+gwoeQytYg7sLDlLIvv2OF+DTWF+VTfmRotWRCucjo1E6Z1kEn1QxneivXH8UZIg==',key_name='tempest-keypair-480643972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-l3upe9iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=09a47014-23a8-4dad-ab17-6df274ed8cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:19.154515 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:19.154515 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:19.154515 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'pci_devices' on Instance uuid 09a47014-23a8-4dad-ab17-6df274ed8cf7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:19.178892 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:03:19.179589 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7613ef2-f3e5-460b-b93b-ac85d1586207', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:19.179589 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:19.183416 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:19.183416 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7613ef2-f3e5-460b-b93b-ac85d1586207', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:03:19.206405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:19.206935 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:19.213628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:19.213923 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:19.214446 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:19.214685 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:19.227641 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:19.227641 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:19.232528 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:19.232528 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:19.240299 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207] added
May 27 23:03:19.240299 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:19.240299 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:19.240299 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:19.240299 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:19.240299 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:19.240299 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:19.240299 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:19.240299 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:19.240299 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:19.245264 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207] added
May 27 23:03:19.245264 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:19.245264 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:19.245264 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:19.245264 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:19.245264 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:19.245264 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:19.245511 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:19.245587 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:19.245695 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:19.257355 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:19.257355 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:19.257355 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Attaching volume 065ce712-bac2-49ae-b684-5600689bfd55 to /dev/vdb
May 27 23:03:19.301197 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:19.318310 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:03:19.343875 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6a99f05a-6544-4994-9a1a-d98c320d088a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:19.344821 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:19.349727 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:19.390633 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:03:19.392131 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:03:19.398987 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:03:19.400283 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fec3:7f1b', 'fe80::341f:bfff:fe55:81e6', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:f045', 'fe80::fc16:3eff:fea8:ff85', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe09:383a', 'fe80::fc16:3eff:fe62:f3f7'] 
May 27 23:03:19.400501 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:03:19.400501 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:03:19.402403 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:19.402403 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating existing volume attachment record: 5a3db189-4a0f-4a45-a274-37ff54a6d04c {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:03:19.544706 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:19.602823 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0005285629999889352 future=<Future at 0x726e60228260 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:19.602823 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:19.602823 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.275604812999973 future=<Future at 0x726e601b3c50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:19.602823 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.275498661000029 future=<Future at 0x726e601b3c50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:19.605309 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Emitting event <LifecycleEvent: 1779922984.6015263, 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:19.605532 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] VM Stopped (Lifecycle Event)
May 27 23:03:19.661404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] End _get_guest_xml xml=<domain type="qemu">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <uuid>09a47014-23a8-4dad-ab17-6df274ed8cf7</uuid>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <name>instance-00000017</name>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <nova:name>tempest-tempest.common.compute-instance-739387005</nova:name>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:03:19</nova:creationTime>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:user uuid="8f0d298d70064eac8ffd4fe25b1e203b">tempest-ServerActionsTestOtherA-1786604563-project-member</nova:user>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:project uuid="d6f15f51479c4e37ab880af2031170be">tempest-ServerActionsTestOtherA-1786604563</nova:project>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         <nova:port uuid="5497c3f3-3f6d-4932-b646-487b60e99781">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <system>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <entry name="serial">09a47014-23a8-4dad-ab17-6df274ed8cf7</entry>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <entry name="uuid">09a47014-23a8-4dad-ab17-6df274ed8cf7</entry>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     </system>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <os>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   </os>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <features>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   </features>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   <devices>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.config"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:33:92:45"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <target dev="tap5497c3f3-3f"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/console.log" append="off"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     </serial>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <video>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     </video>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     </rng>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:   </devices>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]: </domain>
May 27 23:03:19.661404 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:03:19.663344 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Preparing to wait for external event network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:19.663344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:19.663344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:19.663344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:19.663682 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-739387005',display_name='tempest-tempest.common.compute-instance-739387005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-tempest-common-compute-instance-739387005',id=23,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnodhAb2AYguwUd5MV+nvPGMbjwA3r/emEznS8hSo46pEnn++o3pinPXblU18rNwX+gwoeQytYg7sLDlLIvv2OF+DTWF+VTfmRotWRCucjo1E6Z1kEn1QxneivXH8UZIg==',key_name='tempest-keypair-480643972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-l3upe9iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=09a47014-23a8-4dad-ab17-6df274ed8cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:19.663908 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:19.664766 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:19.665176 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:19.665668 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:19.666031 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:19.666450 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:19.667765 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:19.667957 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58b994a7-8b17-5e31-98b2-a4cf100ffb4f', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:19.681815 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:19.682683 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:19.689258 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:19.689258 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5497c3f3-3f, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:19.689722 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5497c3f3-3f, col_values=(('qos', UUID('44b3b7fe-f361-4292-8556-ae900b9f73d6')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:19.689967 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5497c3f3-3f, col_values=(('external_ids', {'iface-id': '5497c3f3-3f6d-4932-b646-487b60e99781', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:92:45', 'vm-uuid': '09a47014-23a8-4dad-ab17-6df274ed8cf7'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:19.693574 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:19.696398 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:19.704703 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:19.705929 np0000001565 nova-compute[98289]: INFO os_vif [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f')
May 27 23:03:19.753033 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Updated VIF entry in instance network info cache for port 2d9b8029-820b-4780-a69e-2a8cca380d8f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:03:19.753277 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Updating instance_info_cache with network_info: [{"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:19.849012 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid 6a99f05a-6544-4994-9a1a-d98c320d088a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:19.976428 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:03:19.976826 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:19.977019 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:20.111787 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36a09381-e2f2-4649-97af-da8cfe860c35 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 0e5489ad-9907-4ba6-9ac6-2a93a7d4d512] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:20.240722 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:20.246062 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:20.256288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] Releasing lock "refresh_cache-6a99f05a-6544-4994-9a1a-d98c320d088a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:20.256471 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Received event network-changed-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:20.256592 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Refreshing instance network info cache due to event network-changed-fa19979e-8452-466d-983f-af63f239ced4. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:20.256732 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] Acquiring lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:20.256831 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] Acquired lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:20.257155 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Refreshing network info cache for port fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:20.258881 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:20.258881 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:20.263930 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:20.263930 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:20.276628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:20.284819 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.300073 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:20.303714 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.303714 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.303714 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.303714 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.303714 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.303714 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.303714 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.303714 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.303714 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.303714 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.303714 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:20.303911 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.303911 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.303911 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.303911 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.303911 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.303911 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.303911 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.303911 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.303911 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.303911 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.303911 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:20.364410 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207, portal: 192.168.40.100,3260]
May 27 23:03:20.364410 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207, portal: 192.168.40.100,3260] successful.
May 27 23:03:20.364410 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:20.365786 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207, portal: 192.168.50.100,3260]
May 27 23:03:20.365786 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207, portal: 192.168.50.100,3260] successful.
May 27 23:03:20.365786 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:20.380194 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:20.385869 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:20.400145 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:20.400478 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:20.400831 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:20.401009 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:20.402740 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] HCTL ('18', '-', '-', 0) found on session 29 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:20.403073 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:20.408363 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:20.408363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:20.409391 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] HCTL ('17', '-', '-', 0) found on session 28 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:20.409391 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:20.421915 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Searching for a device in session 29 and hctl ['18', '*', '*', 0] yield: sdl {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:20.421915 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7613ef2-f3e5-460b-b93b-ac85d1586207', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:20.430960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Searching for a device in session 28 and hctl ['17', '*', '*', 0] yield: sdm {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:20.430960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a7613ef2-f3e5-460b-b93b-ac85d1586207', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:20.759877 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:20.860507 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:21.099953 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Snapshot image upload complete
May 27 23:03:21.100273 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bbcf941b-cf4a-440d-aa3a-b6d6d070debd tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Took 5.11 seconds to snapshot the instance on the hypervisor.
May 27 23:03:21.206311 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:21.211854 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:03:21.237979 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:21.237979 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:21.237979 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No VIF found with MAC fa:16:3e:33:92:45, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:21.237979 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Using config drive
May 27 23:03:21.373264 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Updated VIF entry in instance network info cache for port fa19979e-8452-466d-983f-af63f239ced4. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:03:21.373452 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Updating instance_info_cache with network_info: [{"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:21.743734 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:21.876343 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ebd6e3d2-7172-4d6f-9b91-9cdaa67fb4c1 req-b7e90f26-3a0a-48a6-b893-72c8ac132abc service nova] Releasing lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:21.893943 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Creating config drive at /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.config
May 27 23:03:21.898088 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmfsn7kad {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:21.947235 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6a99f05a-6544-4994-9a1a-d98c320d088a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:21.947593 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:21.947889 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Attaching volume efb4a267-4a4f-4d87-a669-59ae752f46d7 to /dev/vdb
May 27 23:03:21.953805 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmfsn7kad" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:22.012452 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:22.025986 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:03:22.051351 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:22.088705 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:03:22.089100 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:03:22.104163 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:03:22.106794 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fec3:7f1b', 'fe80::341f:bfff:fe55:81e6', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:f045', 'fe80::fc16:3eff:fea8:ff85', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe09:383a', 'fe80::fc16:3eff:fe62:f3f7'] 
May 27 23:03:22.107312 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:03:22.107511 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:03:22.108176 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:22.109059 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Updating existing volume attachment record: c0b18836-f9a4-4cab-9316-28291f0a2a93 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:03:22.228993 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Found WWN 3300000002cf2e44b for multipath device dm-9 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:03:22.229566 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:22.233351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.253s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:22.233351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '3300000002cf2e44b', 'path': '/dev/dm-9', 'multipath_id': '3300000002cf2e44b'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:22.233351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:03:22.233351 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002cf2e44b', 'path': '/dev/dm-9', 'multipath_id': '3300000002cf2e44b'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:03:22.248100 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:22.250418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:22.250955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:22.251187 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:22.252445 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:22.252445 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:22.263841 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:22.263841 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:22.275149 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:22.275149 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:22.284151 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55] added
May 27 23:03:22.284151 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:22.284151 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:22.284151 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:22.284151 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:22.284151 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:22.284151 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:22.284151 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:22.284151 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0329(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:22.284440 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:22.286092 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55] added
May 27 23:03:22.286092 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:22.286092 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:22.286092 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:22.286092 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:22.286092 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:22.286092 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:22.286302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:22.286474 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:22.286597 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:22.446585 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:22.479467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:22.579100 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:22.629271 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:22.630824 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:22.663933 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-596443f5-f3ea-478a-b944-c5852729e4bc req-8a7e6995-a3fc-464d-b4f3-6f9041391c7a service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:22.663933 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-596443f5-f3ea-478a-b944-c5852729e4bc req-8a7e6995-a3fc-464d-b4f3-6f9041391c7a service nova] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:22.663933 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-596443f5-f3ea-478a-b944-c5852729e4bc req-8a7e6995-a3fc-464d-b4f3-6f9041391c7a service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:22.663933 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-596443f5-f3ea-478a-b944-c5852729e4bc req-8a7e6995-a3fc-464d-b4f3-6f9041391c7a service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:22.663933 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-596443f5-f3ea-478a-b944-c5852729e4bc req-8a7e6995-a3fc-464d-b4f3-6f9041391c7a service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Processing event network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:22.691021 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:03:22.692057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efb4a267-4a4f-4d87-a669-59ae752f46d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:22.692057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:22.742881 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:22.743105 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:22.744090 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:d4:98,bridge_name='br-int',has_traffic_filtering=True,id=d7259562-6553-4ef1-8d96-bc9e7b64bf75,network=Network(9b8fa309-a1c3-4439-b6a8-c2689abd3092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7259562-65') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:22.746505 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:22.746654 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:22.747028 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b25fb47-0737-4f1d-a87b-c6a5eb87176b,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b25fb47-07') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:22.747635 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:22.747760 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:22.748093 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:06:a6,bridge_name='br-int',has_traffic_filtering=True,id=433e6524-50fc-4b98-84b7-9921a6b8f731,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap433e6524-50') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:22.748628 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:22.748753 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:22.749055 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:af,bridge_name='br-int',has_traffic_filtering=True,id=8f186912-a40c-40b0-9cc1-808a4f92aa20,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f186912-a4') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:22.750710 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:22.750953 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:22.751223 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=22a9c0da-759e-45d4-8c4a-0f0afe6d472e,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a9c0da-75') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:22.751762 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:22.751876 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:22.752193 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:18,bridge_name='br-int',has_traffic_filtering=True,id=b35b0820-2c57-46ab-8bf6-81d591b179e2,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35b0820-2c') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:22.752695 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:22.752795 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:22.753109 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:5e:14,bridge_name='br-int',has_traffic_filtering=True,id=22db9eb7-e550-46da-9fd0-082bc64ad74f,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22db9eb7-e5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:22.753681 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lazy-loading 'pci_devices' on Instance uuid 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:23.207541 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.258813 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] End _get_guest_xml xml=<domain type="qemu">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <uuid>0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539</uuid>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <name>instance-00000013</name>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <nova:name>tempest-device-tagging-server-1620832723</nova:name>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:03:12</nova:creationTime>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:user uuid="e339645d1b454fa4b8bb89a20c0bf898">tempest-TaggedBootDevicesTest-439981373-project-member</nova:user>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:project uuid="e8214904c18049c086910b7b20b109b2">tempest-TaggedBootDevicesTest-439981373</nova:project>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:port uuid="d7259562-6553-4ef1-8d96-bc9e7b64bf75">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:port uuid="8b25fb47-0737-4f1d-a87b-c6a5eb87176b">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:port uuid="433e6524-50fc-4b98-84b7-9921a6b8f731">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.1.8" ipVersion="4"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:port uuid="8f186912-a40c-40b0-9cc1-808a4f92aa20">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.1.30" ipVersion="4"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:port uuid="22a9c0da-759e-45d4-8c4a-0f0afe6d472e">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:port uuid="b35b0820-2c57-46ab-8bf6-81d591b179e2">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         <nova:port uuid="22db9eb7-e550-46da-9fd0-082bc64ad74f">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <system>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <entry name="serial">0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539</entry>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <entry name="uuid">0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539</entry>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </system>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <os>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   </os>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <features>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   </features>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   <devices>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539/disk.config"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <alias name="ua-fc4f800f-0613-4549-b71f-5ee16605c497"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-5"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <serial>fc4f800f-0613-4549-b71f-5ee16605c497</serial>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <alias name="ua-15648881-dc61-473b-8ee5-31bf6ade7f69"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-8"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <serial>15648881-dc61-473b-8ee5-31bf6ade7f69</serial>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <alias name="ua-a7613ef2-f3e5-460b-b93b-ac85d1586207"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-9"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <target dev="vdc" bus="virtio"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <serial>a7613ef2-f3e5-460b-b93b-ac85d1586207</serial>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:03:d4:98"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <target dev="tapd7259562-65"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:8b:84:b8"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <target dev="tap8b25fb47-07"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:26:06:a6"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <target dev="tap433e6524-50"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:f8:60:af"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <target dev="tap8f186912-a4"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:e6:c4:ae"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <target dev="tap22a9c0da-75"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:57:45:18"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <target dev="tapb35b0820-2c"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:81:5e:14"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <target dev="tap22db9eb7-e5"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539/console.log" append="off"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </serial>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <video>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </video>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </rng>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:   </devices>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]: </domain>
May 27 23:03:23.258813 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Preparing to wait for external event network-vif-plugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Preparing to wait for external event network-vif-plugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Preparing to wait for external event network-vif-plugged-433e6524-50fc-4b98-84b7-9921a6b8f731 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Preparing to wait for external event network-vif-plugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:23.262288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:23.263168 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:23.263168 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Preparing to wait for external event network-vif-plugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:23.263168 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:23.263168 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:23.263168 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:23.263290 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Preparing to wait for external event network-vif-plugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:23.263456 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:23.263626 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:23.263743 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:23.263932 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Preparing to wait for external event network-vif-plugged-22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:23.264061 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:23.264209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:23.264539 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:23.265464 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:23.265586 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:23.266267 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:d4:98,bridge_name='br-int',has_traffic_filtering=True,id=d7259562-6553-4ef1-8d96-bc9e7b64bf75,network=Network(9b8fa309-a1c3-4439-b6a8-c2689abd3092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7259562-65') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:23.266461 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d4:98,bridge_name='br-int',has_traffic_filtering=True,id=d7259562-6553-4ef1-8d96-bc9e7b64bf75,network=Network(9b8fa309-a1c3-4439-b6a8-c2689abd3092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7259562-65') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:23.266883 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.267232 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.267573 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:23.268557 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.268783 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f041000b-8130-5fcc-919d-5b4926bdb3ba', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.272566 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.273867 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.275967 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.276185 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7259562-65, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.276612 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7259562-65, col_values=(('qos', UUID('481d913c-0d34-4cb0-9d01-41c40bae052d')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.276819 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7259562-65, col_values=(('external_ids', {'iface-id': 'd7259562-6553-4ef1-8d96-bc9e7b64bf75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:d4:98', 'vm-uuid': '0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.278741 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.280258 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.285071 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:23.286951 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:23.292353 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.292353 np0000001565 nova-compute[98289]: INFO os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d4:98,bridge_name='br-int',has_traffic_filtering=True,id=d7259562-6553-4ef1-8d96-bc9e7b64bf75,network=Network(9b8fa309-a1c3-4439-b6a8-c2689abd3092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7259562-65')
May 27 23:03:23.292600 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:23.292700 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:23.293211 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b25fb47-0737-4f1d-a87b-c6a5eb87176b,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b25fb47-07') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:23.293475 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b25fb47-0737-4f1d-a87b-c6a5eb87176b,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b25fb47-07') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:23.293759 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.293999 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.294194 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:23.295583 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.295772 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa24895a-b108-5a85-a4dd-3cb916c196bc', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.298047 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:23.299651 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:23.299651 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:23.304051 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:23.307231 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:23.307231 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:23.309271 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.309271 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b25fb47-07, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.309598 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b25fb47-07, col_values=(('qos', UUID('9ea7492e-de0c-40cd-8645-31589145c925')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.309781 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b25fb47-07, col_values=(('external_ids', {'iface-id': '8b25fb47-0737-4f1d-a87b-c6a5eb87176b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:84:b8', 'vm-uuid': '0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.312612 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.313749 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.314817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:23.322469 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:23.328241 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.332188 np0000001565 nova-compute[98289]: INFO os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b25fb47-0737-4f1d-a87b-c6a5eb87176b,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b25fb47-07')
May 27 23:03:23.332188 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:23.332492 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:23.333365 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:06:a6,bridge_name='br-int',has_traffic_filtering=True,id=433e6524-50fc-4b98-84b7-9921a6b8f731,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap433e6524-50') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:23.333511 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:06:a6,bridge_name='br-int',has_traffic_filtering=True,id=433e6524-50fc-4b98-84b7-9921a6b8f731,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap433e6524-50') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:23.333852 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.335818 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.335818 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:23.335818 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.335818 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6462abf2-46bb-5738-a5a0-252359169ada', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.337963 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.338888 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.339502 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.339736 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.353054 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:23.363659 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.369150 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.369284 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap433e6524-50, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.369596 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap433e6524-50, col_values=(('qos', UUID('39bf7270-b16e-444a-8748-e8bb96607de3')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.369732 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap433e6524-50, col_values=(('external_ids', {'iface-id': '433e6524-50fc-4b98-84b7-9921a6b8f731', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:06:a6', 'vm-uuid': '0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.374071 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.375897 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.395867 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.398615 np0000001565 nova-compute[98289]: INFO os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:06:a6,bridge_name='br-int',has_traffic_filtering=True,id=433e6524-50fc-4b98-84b7-9921a6b8f731,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap433e6524-50')
May 27 23:03:23.398615 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:23.398615 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:23.400073 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:af,bridge_name='br-int',has_traffic_filtering=True,id=8f186912-a40c-40b0-9cc1-808a4f92aa20,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f186912-a4') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:23.400073 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:af,bridge_name='br-int',has_traffic_filtering=True,id=8f186912-a40c-40b0-9cc1-808a4f92aa20,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f186912-a4') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:23.400073 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.400073 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.400073 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:23.404620 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.404620 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08ebe95e-4c32-541d-b21c-4c06b4c93e97', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.407194 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.407280 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.408354 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:03:23.409804 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923003.4092984, 09a47014-23a8-4dad-ab17-6df274ed8cf7 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:23.409969 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] VM Started (Lifecycle Event)
May 27 23:03:23.417263 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260]
May 27 23:03:23.417263 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260] successful.
May 27 23:03:23.417263 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:23.420525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260]
May 27 23:03:23.420525 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260] successful.
May 27 23:03:23.420525 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:23.421630 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:03:23.421630 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.425771 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Instance spawned successfully.
May 27 23:03:23.426110 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:03:23.430413 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.432373 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f186912-a4, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.432373 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f186912-a4, col_values=(('qos', UUID('fc269afc-ef1d-4b30-be2b-e64edb23a4be')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.432373 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f186912-a4, col_values=(('external_ids', {'iface-id': '8f186912-a40c-40b0-9cc1-808a4f92aa20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:60:af', 'vm-uuid': '0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.432582 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.433770 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.434875 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:23.443423 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:23.457620 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:23.458871 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:23.459236 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:23.459538 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:23.459538 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:23.460628 np0000001565 nova-compute[98289]: INFO os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:af,bridge_name='br-int',has_traffic_filtering=True,id=8f186912-a40c-40b0-9cc1-808a4f92aa20,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f186912-a4')
May 27 23:03:23.464068 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:23.464068 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:23.464068 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=22a9c0da-759e-45d4-8c4a-0f0afe6d472e,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a9c0da-75') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:23.464068 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=22a9c0da-759e-45d4-8c4a-0f0afe6d472e,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a9c0da-75') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:23.464068 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.464068 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.464068 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:23.464847 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.465188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec3c1acd-c91e-5376-a2b3-f812a982813b', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.465872 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.466641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.468001 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] HCTL ('20', '-', '-', 0) found on session 31 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:23.468205 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:23.476572 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:23.476936 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:23.477317 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:23.477982 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:23.480031 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] HCTL ('19', '-', '-', 0) found on session 30 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:23.484290 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:23.491010 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.499881 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:23.500126 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:23.508364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.510916 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching for a device in session 31 and hctl ['20', '*', '*', 0] yield: sdn {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:23.514609 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22a9c0da-75, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.515380 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:23.515683 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching for a device in session 30 and hctl ['19', '*', '*', 0] yield: sdo {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:23.515928 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22a9c0da-75, col_values=(('qos', UUID('664da3df-fd08-4c2b-802f-dfbf3fb42111')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.516657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:23.517870 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22a9c0da-75, col_values=(('external_ids', {'iface-id': '22a9c0da-759e-45d4-8c4a-0f0afe6d472e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:c4:ae', 'vm-uuid': '0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.519357 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.520733 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.550408 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.554898 np0000001565 nova-compute[98289]: INFO os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=22a9c0da-759e-45d4-8c4a-0f0afe6d472e,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a9c0da-75')
May 27 23:03:23.555389 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:23.555639 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:23.559750 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:18,bridge_name='br-int',has_traffic_filtering=True,id=b35b0820-2c57-46ab-8bf6-81d591b179e2,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35b0820-2c') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:23.559750 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:18,bridge_name='br-int',has_traffic_filtering=True,id=b35b0820-2c57-46ab-8bf6-81d591b179e2,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35b0820-2c') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:23.559750 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.559995 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.559995 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:23.562525 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.562698 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '831df9cd-83cb-5e16-bb09-ea75e67c2dd6', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.563579 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.564213 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.596072 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.603886 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.604300 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb35b0820-2c, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.604579 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb35b0820-2c, col_values=(('qos', UUID('bfff5c5d-1172-4c29-a0cb-8ad50077cdd5')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.604716 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb35b0820-2c, col_values=(('external_ids', {'iface-id': 'b35b0820-2c57-46ab-8bf6-81d591b179e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:45:18', 'vm-uuid': '0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.607914 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.608531 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.640175 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.641754 np0000001565 nova-compute[98289]: INFO os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:18,bridge_name='br-int',has_traffic_filtering=True,id=b35b0820-2c57-46ab-8bf6-81d591b179e2,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35b0820-2c')
May 27 23:03:23.642213 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:23.642395 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:23.643038 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:5e:14,bridge_name='br-int',has_traffic_filtering=True,id=22db9eb7-e550-46da-9fd0-082bc64ad74f,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22db9eb7-e5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:23.643139 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5e:14,bridge_name='br-int',has_traffic_filtering=True,id=22db9eb7-e550-46da-9fd0-082bc64ad74f,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22db9eb7-e5') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:23.644158 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.644158 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.644158 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:23.645421 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.645483 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23935d8f-01a1-5518-ab4d-80382b14db9f', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.646141 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.646813 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.676780 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.682704 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.682960 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22db9eb7-e5, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.683400 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22db9eb7-e5, col_values=(('qos', UUID('09cd5d16-4a26-448c-a17c-e9075e39e5ff')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.683682 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22db9eb7-e5, col_values=(('external_ids', {'iface-id': '22db9eb7-e550-46da-9fd0-082bc64ad74f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:5e:14', 'vm-uuid': '0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:23.685015 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.686544 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:23.718059 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:23.719141 np0000001565 nova-compute[98289]: INFO os_vif [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5e:14,bridge_name='br-int',has_traffic_filtering=True,id=22db9eb7-e550-46da-9fd0-082bc64ad74f,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22db9eb7-e5')
May 27 23:03:23.920890 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:23.924461 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:23.937873 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:23.938074 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:23.938452 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:23.938689 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:23.938925 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:23.939137 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:24.010956 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:03:24.252302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:03:24.426757 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:03:24.427256 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923004.4268253, 09a47014-23a8-4dad-ab17-6df274ed8cf7 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:24.427256 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] VM Paused (Lifecycle Event)
May 27 23:03:24.445451 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Took 7.33 seconds to spawn the instance on the hypervisor.
May 27 23:03:24.445581 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:24.574923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:24.575177 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:24.578161 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:03:24.578434 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Claim successful on node np0000001565
May 27 23:03:24.725402 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9f6cec4b-3e3f-4513-bbdb-faf705ba4df6 req-12d6acf2-8184-4517-858d-8ede3a5798ae service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:24.725693 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f6cec4b-3e3f-4513-bbdb-faf705ba4df6 req-12d6acf2-8184-4517-858d-8ede3a5798ae service nova] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:24.725894 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f6cec4b-3e3f-4513-bbdb-faf705ba4df6 req-12d6acf2-8184-4517-858d-8ede3a5798ae service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:24.726055 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f6cec4b-3e3f-4513-bbdb-faf705ba4df6 req-12d6acf2-8184-4517-858d-8ede3a5798ae service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:24.728808 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9f6cec4b-3e3f-4513-bbdb-faf705ba4df6 req-12d6acf2-8184-4517-858d-8ede3a5798ae service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] No waiting events found dispatching network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:24.728938 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9f6cec4b-3e3f-4513-bbdb-faf705ba4df6 req-12d6acf2-8184-4517-858d-8ede3a5798ae service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received unexpected event network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 for instance with vm_state active and task_state None.
May 27 23:03:24.929611 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:24.934290 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923004.9339802, 09a47014-23a8-4dad-ab17-6df274ed8cf7 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:24.934567 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] VM Resumed (Lifecycle Event)
May 27 23:03:24.952862 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Took 13.32 seconds to build instance.
May 27 23:03:25.239504 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:25.239504 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:25.239504 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] No VIF found with MAC fa:16:3e:03:d4:98, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:25.239785 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] No VIF found with MAC fa:16:3e:e6:c4:ae, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:25.240818 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Using config drive
May 27 23:03:25.270485 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Found WWN 330000000493f2b88 for multipath device dm-10 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:03:25.270881 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:25.271656 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] <== connect_volume: return (5294ms) {'type': 'block', 'scsi_wwn': '330000000493f2b88', 'path': '/dev/dm-10', 'multipath_id': '330000000493f2b88'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:25.271656 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000493f2b88', 'path': '/dev/dm-10', 'multipath_id': '330000000493f2b88'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:03:25.271855 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.580s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:25.271996 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efb4a267-4a4f-4d87-a669-59ae752f46d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:03:25.275402 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lazy-loading 'flavor' on Instance uuid 80c6eabe-0192-4030-a194-2d87bb638464 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:25.289834 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:25.292746 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:25.293164 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:25.294509 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:25.294736 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:25.295009 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:25.311212 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:25.311212 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:25.319059 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:25.319059 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:25.328385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7] added
May 27 23:03:25.328385 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:25.328385 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:25.328385 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:25.328385 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:25.328385 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:25.328385 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:25.328710 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:25.328747 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:25.328926 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:25.329909 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7] added
May 27 23:03:25.329909 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:25.329909 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:25.329909 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:25.329909 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:25.329909 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:25.329909 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:25.330092 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:25.330201 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:25.330349 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:25.439739 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:25.443810 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:25.457670 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.830s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:25.754626 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:25.780259 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Attempting to attach volume 065ce712-bac2-49ae-b684-5600689bfd55 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:03:25.784031 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:03:25.784031 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:25.784031 np0000001565 nova-compute[98289]:   <alias name="ua-065ce712-bac2-49ae-b684-5600689bfd55"/>
May 27 23:03:25.784031 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-10"/>
May 27 23:03:25.784031 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:03:25.784031 np0000001565 nova-compute[98289]:   <serial>065ce712-bac2-49ae-b684-5600689bfd55</serial>
May 27 23:03:25.784031 np0000001565 nova-compute[98289]: </disk>
May 27 23:03:25.784031 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:03:25.841921 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7f6a25b3-b404-47a4-ba06-a03c860a98cd req-7e2e524f-4152-4109-be23-fea9393e40b0 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-changed-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:25.842297 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7f6a25b3-b404-47a4-ba06-a03c860a98cd req-7e2e524f-4152-4109-be23-fea9393e40b0 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Refreshing instance network info cache due to event network-changed-5497c3f3-3f6d-4932-b646-487b60e99781. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:25.842488 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7f6a25b3-b404-47a4-ba06-a03c860a98cd req-7e2e524f-4152-4109-be23-fea9393e40b0 service nova] Acquiring lock "refresh_cache-09a47014-23a8-4dad-ab17-6df274ed8cf7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:25.842581 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7f6a25b3-b404-47a4-ba06-a03c860a98cd req-7e2e524f-4152-4109-be23-fea9393e40b0 service nova] Acquired lock "refresh_cache-09a47014-23a8-4dad-ab17-6df274ed8cf7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:25.842690 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7f6a25b3-b404-47a4-ba06-a03c860a98cd req-7e2e524f-4152-4109-be23-fea9393e40b0 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Refreshing network info cache for port 5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:25.997939 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Creating config drive at /opt/stack/data/nova/instances/0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539/disk.config
May 27 23:03:26.005350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_lxh4ytx {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:26.057359 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_lxh4ytx" returned: 0 in 0.050s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:26.330657 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:26.330980 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:26.347520 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7f6a25b3-b404-47a4-ba06-a03c860a98cd req-7e2e524f-4152-4109-be23-fea9393e40b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:26.349801 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:26.349801 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:26.355156 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:26.355156 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:26.377142 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:26.383374 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.411057 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.422483 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.422811 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:26.496881 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7, portal: 192.168.50.100,3260]
May 27 23:03:26.496881 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7, portal: 192.168.50.100,3260] successful.
May 27 23:03:26.496881 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:26.517382 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7, portal: 192.168.40.100,3260]
May 27 23:03:26.517382 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7, portal: 192.168.40.100,3260] successful.
May 27 23:03:26.517382 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:26.532215 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:26.537235 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:26.546224 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:03:26.546472 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:26.558770 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:26.559975 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.265s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:26.559975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:26.561831 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('21', '-', '-', 0) found on session 32 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:26.561953 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:26.575257 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:26.575948 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.282s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:26.576006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:26.577323 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 32 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:26.577649 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'efb4a267-4a4f-4d87-a669-59ae752f46d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:26.579392 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('22', '-', '-', 0) found on session 33 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:26.579568 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:26.593959 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 33 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:26.594441 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efb4a267-4a4f-4d87-a669-59ae752f46d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:26.633190 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:26.698477 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:26.703317 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:26.767021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:26.849081 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7f6a25b3-b404-47a4-ba06-a03c860a98cd req-7e2e524f-4152-4109-be23-fea9393e40b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:26.911842 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:26.916534 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:26.948396 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.000091 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.004368 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.049628 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:03:27.081356 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-23fb27f9-fb5a-414b-a664-9ccdad73b990 req-fae2a1f8-c198-4982-8a8b-826665b0e517 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:27.082697 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-23fb27f9-fb5a-414b-a664-9ccdad73b990 req-fae2a1f8-c198-4982-8a8b-826665b0e517 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:27.082697 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-23fb27f9-fb5a-414b-a664-9ccdad73b990 req-fae2a1f8-c198-4982-8a8b-826665b0e517 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:27.082921 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-23fb27f9-fb5a-414b-a664-9ccdad73b990 req-fae2a1f8-c198-4982-8a8b-826665b0e517 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:27.085263 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-23fb27f9-fb5a-414b-a664-9ccdad73b990 req-fae2a1f8-c198-4982-8a8b-826665b0e517 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Processing event network-vif-plugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:27.110906 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.140649 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.191915 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.209500 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.232412 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.238610 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.254202 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7f6a25b3-b404-47a4-ba06-a03c860a98cd req-7e2e524f-4152-4109-be23-fea9393e40b0 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Updated VIF entry in instance network info cache for port 5497c3f3-3f6d-4932-b646-487b60e99781. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:03:27.258759 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7f6a25b3-b404-47a4-ba06-a03c860a98cd req-7e2e524f-4152-4109-be23-fea9393e40b0 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Updating instance_info_cache with network_info: [{"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:27.275491 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.293646 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:03:27.317657 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.324098 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.338837 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-32386a7c-04e2-401d-badf-9cbf1797237f req-9e0d94ff-fc95-44f9-93cb-eb49ef894476 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-433e6524-50fc-4b98-84b7-9921a6b8f731 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:27.338929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-32386a7c-04e2-401d-badf-9cbf1797237f req-9e0d94ff-fc95-44f9-93cb-eb49ef894476 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:27.339158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-32386a7c-04e2-401d-badf-9cbf1797237f req-9e0d94ff-fc95-44f9-93cb-eb49ef894476 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:27.339883 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-32386a7c-04e2-401d-badf-9cbf1797237f req-9e0d94ff-fc95-44f9-93cb-eb49ef894476 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:27.339883 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-32386a7c-04e2-401d-badf-9cbf1797237f req-9e0d94ff-fc95-44f9-93cb-eb49ef894476 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Processing event network-vif-plugged-433e6524-50fc-4b98-84b7-9921a6b8f731 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:27.400464 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.494518 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.500823 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.516792 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:27.517257 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:27.517257 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:27.517257 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] No VIF found with MAC fa:16:3e:c3:7f:1b, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:27.576357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.998s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:27.576357 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:03:27.587916 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.622323 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.628120 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.765509 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7f6a25b3-b404-47a4-ba06-a03c860a98cd req-7e2e524f-4152-4109-be23-fea9393e40b0 service nova] Releasing lock "refresh_cache-09a47014-23a8-4dad-ab17-6df274ed8cf7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:27.766693 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.952600 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:27.952600 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:27.952600 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:27.952600 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:27.952600 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Processing event network-vif-plugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:27.952600 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:27.952600 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:27.952600 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:27.952600 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:27.952600 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No event matching network-vif-plugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b in dict_keys([('network-vif-plugged', '8f186912-a40c-40b0-9cc1-808a4f92aa20'), ('network-vif-plugged', '22a9c0da-759e-45d4-8c4a-0f0afe6d472e'), ('network-vif-plugged', 'b35b0820-2c57-46ab-8bf6-81d591b179e2'), ('network-vif-plugged', '22db9eb7-e550-46da-9fd0-082bc64ad74f')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:03:27.953711 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received unexpected event network-vif-plugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b for instance with vm_state building and task_state spawning.
May 27 23:03:27.953984 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:27.954230 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:27.954486 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:27.955774 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:27.955774 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5532eb86-7762-4e4b-b9c1-d50d3dc62168 req-d8962f92-f713-4323-af21-bb0894a0dec1 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Processing event network-vif-plugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:27.985318 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.989525 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:27.993723 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:28.020560 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:28.088360 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:03:28.089520 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:03:28.091432 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:28.093491 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:28.209677 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:28.218804 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6037b0819a94463e8e45d96f834c4341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818a7ed096346eb92128648c4280071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:03:28.281725 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:28.282065 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:28.317058 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found WWN 330000000888da0d7 for multipath device dm-11 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:03:28.317058 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:28.317205 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== connect_volume: return (5625ms) {'type': 'block', 'scsi_wwn': '330000000888da0d7', 'path': '/dev/dm-11', 'multipath_id': '330000000888da0d7'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:28.317205 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000888da0d7', 'path': '/dev/dm-11', 'multipath_id': '330000000888da0d7'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:03:28.320298 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid 6a99f05a-6544-4994-9a1a-d98c320d088a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:28.453856 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:28.455537 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:28.592472 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:03:28.649618 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:28.655445 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:28.684945 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:28.716973 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923008.7164402, 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:28.716973 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] VM Started (Lifecycle Event)
May 27 23:03:28.735122 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Successfully created port: 7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:03:28.824967 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Attempting to attach volume efb4a267-4a4f-4d87-a669-59ae752f46d7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:03:28.826771 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:03:28.826771 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:28.826771 np0000001565 nova-compute[98289]:   <alias name="ua-efb4a267-4a4f-4d87-a669-59ae752f46d7"/>
May 27 23:03:28.826771 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-11"/>
May 27 23:03:28.826771 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:03:28.826771 np0000001565 nova-compute[98289]:   <serial>efb4a267-4a4f-4d87-a669-59ae752f46d7</serial>
May 27 23:03:28.826771 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:03:28.826771 np0000001565 nova-compute[98289]: </disk>
May 27 23:03:28.826771 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:03:28.880721 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0006985190000250441 future=<Future at 0x726e601b3c50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:28.880721 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:28.880721 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Emitting event <LifecycleEvent: 1779922993.878219, 542edc82-9617-4269-b95c-523000992ff8 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:28.880721 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] VM Stopped (Lifecycle Event)
May 27 23:03:29.071738 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:29.075461 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:29.080836 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:29.084322 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35a68077-d2ef-4476-a3ce-fc75d7b9bf79 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.829s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:29.097826 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:03:29.107857 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:29.179838 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:29.179991 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:29.180132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:29.180319 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:29.180389 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No event matching network-vif-plugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 in dict_keys([('network-vif-plugged', '8f186912-a40c-40b0-9cc1-808a4f92aa20'), ('network-vif-plugged', 'b35b0820-2c57-46ab-8bf6-81d591b179e2'), ('network-vif-plugged', '22db9eb7-e550-46da-9fd0-082bc64ad74f')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:03:29.180966 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received unexpected event network-vif-plugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 for instance with vm_state building and task_state spawning.
May 27 23:03:29.181150 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:29.181250 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:29.181416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:29.181416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:29.181611 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Processing event network-vif-plugged-22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:29.181736 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:29.182360 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:29.182524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:29.182683 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:29.182683 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No event matching network-vif-plugged-22db9eb7-e550-46da-9fd0-082bc64ad74f in dict_keys([('network-vif-plugged', '8f186912-a40c-40b0-9cc1-808a4f92aa20'), ('network-vif-plugged', 'b35b0820-2c57-46ab-8bf6-81d591b179e2')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:03:29.182797 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-a9948976-70fb-416c-9186-39e6572801df req-de28f6b7-c902-425a-998e-299e7e6bf95e service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received unexpected event network-vif-plugged-22db9eb7-e550-46da-9fd0-082bc64ad74f for instance with vm_state building and task_state spawning.
May 27 23:03:29.224374 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:29.232439 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923009.2310634, 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:29.232439 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] VM Paused (Lifecycle Event)
May 27 23:03:29.383610 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 542edc82-9617-4269-b95c-523000992ff8] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:29.405011 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:29.417188 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-433e6524-50fc-4b98-84b7-9921a6b8f731 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:29.419473 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:29.420385 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:29.420563 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:29.420742 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No event matching network-vif-plugged-433e6524-50fc-4b98-84b7-9921a6b8f731 in dict_keys([('network-vif-plugged', '8f186912-a40c-40b0-9cc1-808a4f92aa20'), ('network-vif-plugged', 'b35b0820-2c57-46ab-8bf6-81d591b179e2')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:03:29.420956 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received unexpected event network-vif-plugged-433e6524-50fc-4b98-84b7-9921a6b8f731 for instance with vm_state building and task_state spawning.
May 27 23:03:29.421034 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:29.421193 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:29.421357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:29.421483 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:29.421616 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Processing event network-vif-plugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:29.421819 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:29.422137 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:29.422428 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:29.422618 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:29.422872 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No event matching network-vif-plugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 in dict_keys([('network-vif-plugged', 'b35b0820-2c57-46ab-8bf6-81d591b179e2')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:03:29.423060 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-babf4253-9864-4567-bc3c-5635d2a214fe req-44920259-13b3-4c5e-8ac1-55ffeadbd057 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received unexpected event network-vif-plugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 for instance with vm_state building and task_state spawning.
May 27 23:03:29.474235 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Successfully updated port: 7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:03:29.606163 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Booting with volume-backed-image 6300a9f9-2b54-4283-b976-5a0c9409f522 at /dev/vda
May 27 23:03:29.733912 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:29.735817 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:29.975438 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:29.975596 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquired lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:29.975747 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:03:30.056087 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:30.056087 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:30.062505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:30.062505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:30.062505 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No event matching network-vif-plugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e in dict_keys([('network-vif-plugged', 'b35b0820-2c57-46ab-8bf6-81d591b179e2')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:03:30.062923 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received unexpected event network-vif-plugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e for instance with vm_state building and task_state spawning.
May 27 23:03:30.063889 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:30.064693 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:30.064879 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:30.065029 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:30.065183 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Processing event network-vif-plugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:30.065261 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-plugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:30.065398 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:30.065585 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:30.065643 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:30.065746 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-plugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:30.065867 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-ec49d38b-977b-4aa5-9f4e-a0a6dc357c9f req-15c45927-99c3-4811-994b-38fb29b21a40 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received unexpected event network-vif-plugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 for instance with vm_state building and task_state spawning.
May 27 23:03:30.067000 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:03:30.069940 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:03:30.076711 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Instance spawned successfully.
May 27 23:03:30.078826 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:03:30.238016 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:03:30.238441 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923010.2381504, 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:30.238633 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] VM Resumed (Lifecycle Event)
May 27 23:03:30.543824 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:30.543991 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:30.544033 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:30.544145 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:47:0a:de, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:30.551663 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:03:30.585975 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:30.586177 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:30.586620 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:30.586976 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:30.587344 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:30.587711 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:30.743413 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:30.744872 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:30.777770 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:30.978141 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Updating instance_info_cache with network_info: [{"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:31.097578 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Took 28.04 seconds to spawn the instance on the hypervisor.
May 27 23:03:31.097578 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:31.247231 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:03:31.250180 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a133bc0f-1dae-4ba2-982c-52698319922c req-d6c0c8f0-6a35-4911-bff6-ffe9a04b63c5 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-changed-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:31.250363 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a133bc0f-1dae-4ba2-982c-52698319922c req-d6c0c8f0-6a35-4911-bff6-ffe9a04b63c5 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Refreshing instance network info cache due to event network-changed-7343ba63-a626-4bbe-b9bd-b4668c6593a7. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:31.251078 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a133bc0f-1dae-4ba2-982c-52698319922c req-d6c0c8f0-6a35-4911-bff6-ffe9a04b63c5 service nova] Acquiring lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:31.476182 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Stashing vm_state: active {{(pid=98289) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 27 23:03:31.481450 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Releasing lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:31.481732 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Instance network_info: |[{"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:03:31.482481 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a133bc0f-1dae-4ba2-982c-52698319922c req-d6c0c8f0-6a35-4911-bff6-ffe9a04b63c5 service nova] Acquired lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:31.482652 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a133bc0f-1dae-4ba2-982c-52698319922c req-d6c0c8f0-6a35-4911-bff6-ffe9a04b63c5 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Refreshing network info cache for port 7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:31.607689 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Took 40.39 seconds to build instance.
May 27 23:03:31.985065 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a133bc0f-1dae-4ba2-982c-52698319922c req-d6c0c8f0-6a35-4911-bff6-ffe9a04b63c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:32.038779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:32.039034 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:32.094202 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d2caf45-f32b-4567-b0b8-f869deb319b8 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.146s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:32.109424 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.896s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:32.314450 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a133bc0f-1dae-4ba2-982c-52698319922c req-d6c0c8f0-6a35-4911-bff6-ffe9a04b63c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:32.519953 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:32.520581 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:32.525657 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a133bc0f-1dae-4ba2-982c-52698319922c req-d6c0c8f0-6a35-4911-bff6-ffe9a04b63c5 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Updated VIF entry in instance network info cache for port 7343ba63-a626-4bbe-b9bd-b4668c6593a7. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:03:32.526362 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a133bc0f-1dae-4ba2-982c-52698319922c req-d6c0c8f0-6a35-4911-bff6-ffe9a04b63c5 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Updating instance_info_cache with network_info: [{"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:32.545281 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:03:32.546193 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Claim successful on node np0000001565
May 27 23:03:33.028790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a133bc0f-1dae-4ba2-982c-52698319922c req-d6c0c8f0-6a35-4911-bff6-ffe9a04b63c5 service nova] Releasing lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:33.031415 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid 6ab04c1a-7858-471e-95fd-5b04d1da3061 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:33.050962 np0000001565 nova-compute[98289]: INFO nova.compute.resource_tracker [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating resource usage from migration 4a7aa81e-26f8-4cea-920c-a9f1b709c270
May 27 23:03:33.232460 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:33.248520 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:33.267707 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:03:33.296514 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:33.337279 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:03:33.337722 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:03:33.348284 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:03:33.350078 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fec3:7f1b', 'fe80::341f:bfff:fe55:81e6', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:f045', 'fe80::fc16:3eff:fea8:ff85', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe09:383a', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe33:9245', 'fe80::fc16:3eff:fe03:d498', 'fe80::fc16:3eff:fe8b:84b8', 'fe80::dcd4:d2ff:fef1:b456', 'fe80::fc16:3eff:fe26:6a6', 'fe80::fc16:3eff:fef8:60af', 'fe80::fc16:3eff:fee6:c4ae', 'fe80::fc16:3eff:fe57:4518', 'fe80::fc16:3eff:fe81:5e14', 'fe80::e0fd:1fff:feda:75a7', 'fe80::4893:9bff:fe5d:9403'] 
May 27 23:03:33.350216 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:03:33.350387 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:03:33.350713 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:33.350977 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Updating existing volume attachment record: e6ba6514-1edb-4da4-a841-125c86c88f26 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:03:33.677601 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b2caa010-3a7a-456c-a98b-f4424076b765 req-5782e2c4-5dbd-4c33-b522-a17fa60657b6 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-changed-d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:33.678125 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b2caa010-3a7a-456c-a98b-f4424076b765 req-5782e2c4-5dbd-4c33-b522-a17fa60657b6 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing instance network info cache due to event network-changed-d7259562-6553-4ef1-8d96-bc9e7b64bf75. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:03:33.678467 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b2caa010-3a7a-456c-a98b-f4424076b765 req-5782e2c4-5dbd-4c33-b522-a17fa60657b6 service nova] Acquiring lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:33.678674 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b2caa010-3a7a-456c-a98b-f4424076b765 req-5782e2c4-5dbd-4c33-b522-a17fa60657b6 service nova] Acquired lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:33.678904 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b2caa010-3a7a-456c-a98b-f4424076b765 req-5782e2c4-5dbd-4c33-b522-a17fa60657b6 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Refreshing network info cache for port d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:03:33.689586 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:33.863428 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:33.864486 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:33.960055 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:03:33.960789 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:03:34.039550 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:34.182517 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-b2caa010-3a7a-456c-a98b-f4424076b765 req-5782e2c4-5dbd-4c33-b522-a17fa60657b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:34.366985 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Detaching volume 34cb2b43-4dd5-4c09-90bb-1915fc834e97
May 27 23:03:34.418976 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Attempting to driver detach volume 34cb2b43-4dd5-4c09-90bb-1915fc834e97 from mountpoint /dev/vdb
May 27 23:03:34.426781 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Found disk vdb by alias ua-34cb2b43-4dd5-4c09-90bb-1915fc834e97 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:03:34.429385 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Found disk vdb by alias ua-34cb2b43-4dd5-4c09-90bb-1915fc834e97 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:03:34.429899 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Attempting to detach device vdb from instance 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:03:34.430288 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:03:34.430288 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:34.430288 np0000001565 nova-compute[98289]:   <alias name="ua-34cb2b43-4dd5-4c09-90bb-1915fc834e97"/>
May 27 23:03:34.430288 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-4"/>
May 27 23:03:34.430288 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:03:34.430288 np0000001565 nova-compute[98289]:   <serial>34cb2b43-4dd5-4c09-90bb-1915fc834e97</serial>
May 27 23:03:34.430288 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:03:34.430288 np0000001565 nova-compute[98289]: </disk>
May 27 23:03:34.430288 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:03:34.444425 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Successfully detached device vdb from instance 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d from the persistent domain config.
May 27 23:03:34.444569 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] (1/8): Attempting to detach device vdb with device alias ua-34cb2b43-4dd5-4c09-90bb-1915fc834e97 from instance 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:03:34.444903 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:03:34.444903 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:34.444903 np0000001565 nova-compute[98289]:   <alias name="ua-34cb2b43-4dd5-4c09-90bb-1915fc834e97"/>
May 27 23:03:34.444903 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-4"/>
May 27 23:03:34.444903 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:03:34.444903 np0000001565 nova-compute[98289]:   <serial>34cb2b43-4dd5-4c09-90bb-1915fc834e97</serial>
May 27 23:03:34.444903 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:03:34.444903 np0000001565 nova-compute[98289]: </disk>
May 27 23:03:34.444903 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:03:34.466871 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:03:34.608850 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-b2caa010-3a7a-456c-a98b-f4424076b765 req-5782e2c4-5dbd-4c33-b522-a17fa60657b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:34.788310 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b2caa010-3a7a-456c-a98b-f4424076b765 req-5782e2c4-5dbd-4c33-b522-a17fa60657b6 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updated VIF entry in instance network info cache for port d7259562-6553-4ef1-8d96-bc9e7b64bf75. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:03:34.789041 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b2caa010-3a7a-456c-a98b-f4424076b765 req-5782e2c4-5dbd-4c33-b522-a17fa60657b6 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating instance_info_cache with network_info: [{"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:34.979325 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.940s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:34.979617 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Migrating
May 27 23:03:34.979878 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:34.980037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:35.064133 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923015.063808, 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d => ua-34cb2b43-4dd5-4c09-90bb-1915fc834e97> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:03:35.068276 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-34cb2b43-4dd5-4c09-90bb-1915fc834e97 for instance 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:03:35.069097 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Successfully detached device vdb from instance 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d from the live domain config.
May 27 23:03:35.069309 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:03:35.071922 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:35.072132 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:35.072652 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:35.073071 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '34cb2b43-4dd5-4c09-90bb-1915fc834e97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:03:35.073254 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:35.108106 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:35.108538 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:35.110322 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', '33')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:03:35.110322 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', '20')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:03:35.112600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97', '21')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:03:35.113624 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e386571a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:03:35.115351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:03:35.115886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Flush multipath device 3300000006d839091 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:03:35.134307 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:35.134505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:35.134728 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Attaching volume efb4a267-4a4f-4d87-a669-59ae752f46d7 to /dev/vdb
May 27 23:03:35.145931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:03:35.189977 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:35.191229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:03:35.208726 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:03:35.238274 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:35.251981 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:03:35.252139 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:03:35.254517 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:03:35.267481 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:03:35.267897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:03:35.278395 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:03:35.278680 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:03:35.291098 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:03:35.294450 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fec3:7f1b', 'fe80::341f:bfff:fe55:81e6', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:f045', 'fe80::fc16:3eff:fea8:ff85', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe09:383a', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe33:9245', 'fe80::fc16:3eff:fe03:d498', 'fe80::fc16:3eff:fe8b:84b8', 'fe80::dcd4:d2ff:fef1:b456', 'fe80::fc16:3eff:fe26:6a6', 'fe80::fc16:3eff:fef8:60af', 'fe80::fc16:3eff:fee6:c4ae', 'fe80::fc16:3eff:fe57:4518', 'fe80::fc16:3eff:fe81:5e14', 'fe80::e0fd:1fff:feda:75a7', 'fe80::4893:9bff:fe5d:9403'] 
May 27 23:03:35.294614 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:03:35.294765 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:03:35.296193 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:35.297932 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b2caa010-3a7a-456c-a98b-f4424076b765 req-5782e2c4-5dbd-4c33-b522-a17fa60657b6 service nova] Releasing lock "refresh_cache-0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:35.298551 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:35.298759 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Updating existing volume attachment record: 736a7f87-b31c-4d41-8a39-ba8aa0c3074f {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:03:35.333980 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97, portal: 192.168.40.100,3260]
May 27 23:03:35.333980 np0000001565 nova-compute[98289]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97, portal: 192.168.40.100,3260] successful.
May 27 23:03:35.333980 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:35.359997 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:35.371737 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:35.414418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97, portal: 192.168.50.100,3260]
May 27 23:03:35.414418 np0000001565 nova-compute[98289]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-34cb2b43-4dd5-4c09-90bb-1915fc834e97, portal: 192.168.50.100,3260] successful.
May 27 23:03:35.414418 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:35.441084 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:35.441476 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:35.441624 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] <== disconnect_volume: return (369ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:35.441777 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:03:35.482108 np0000001565 nova-compute[98289]: INFO nova.compute.rpcapi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 27 23:03:35.483227 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:35.483450 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:03:35.492809 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:03:35.499951 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:03:35.502939 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Creating image(s)
May 27 23:03:35.504394 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:03:35.504556 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Ensure instance console log exists: /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:03:35.507931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:35.507931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:35.507931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:35.507931 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Start _get_guest_xml network_info=[{"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e6ba6514-1edb-4da4-a841-125c86c88f26', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8eb4bd8d-577c-4065-a466-d943fd51ef8e', 'attached_at': '', 'detached_at': '', 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'serial': '0f68fa49-46d6-4139-a993-b907a1188ed0'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:03:35.517410 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:03:35.519156 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-65006145', uuid='8eb4bd8d-577c-4065-a466-d943fd51ef8e'), owner=OwnerMeta(userid='6037b0819a94463e8e45d96f834c4341', username='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member', projectid='9818a7ed096346eb92128648c4280071', projectname='tempest-ServerBootFromVolumeStableRescueTest-800872693'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923015.5186357) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:03:35.520745 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:03:35.521262 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:03:35.522146 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:03:35.522388 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:03:35.524386 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:03:35.525655 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:03:35.527375 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:03:35.527589 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:03:35.527777 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:03:35.528122 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:03:35.528273 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:03:35.528537 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:03:35.528864 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:03:35.529043 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:03:35.529198 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:03:35.529523 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:03:35.546722 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:03:35.547206 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:35.547457 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:35.547909 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:35.548165 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:03:35.560723 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:35.561484 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:35.561982 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:35.562313 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:35.562760 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:35.562947 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:35.574842 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:35.574842 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:35.579727 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:35.579727 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:35.586422 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0] added
May 27 23:03:35.586422 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:35.586422 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:35.586422 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:35.586422 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:35.586422 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:35.586422 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:35.586422 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:35.586422 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0241(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:35.586745 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:35.590565 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0] added
May 27 23:03:35.590565 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:35.590565 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:35.590565 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:35.590565 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:35.590565 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:35.590565 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:35.590824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:35.590824 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0279(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:35.590948 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:35.856975 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:03:35.857233 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efb4a267-4a4f-4d87-a669-59ae752f46d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:35.857365 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:35.995677 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'flavor' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:36.014252 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:36.014325 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquired lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:36.014603 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:03:36.519166 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:36.586928 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:36.591624 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:36.607170 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:36.607170 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:36.611404 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:36.611404 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:36.621726 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:36.626586 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.649314 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.649850 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.650956 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.651268 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:36.716669 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0, portal: 192.168.50.100,3260]
May 27 23:03:36.716669 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0, portal: 192.168.50.100,3260] successful.
May 27 23:03:36.716669 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:36.727671 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:36.733785 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0, portal: 192.168.40.100,3260]
May 27 23:03:36.733785 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0, portal: 192.168.40.100,3260] successful.
May 27 23:03:36.733785 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:36.748839 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:36.756767 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:36.757207 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:36.757207 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:36.758514 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] HCTL ('11', '-', '-', 0) found on session 34 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:36.758605 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:36.772939 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:36.773494 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:36.773784 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:36.773784 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:36.775864 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching for a device in session 34 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:36.776270 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:36.777728 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] HCTL ('12', '-', '-', 0) found on session 35 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:36.777848 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:36.794063 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching for a device in session 35 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:36.794063 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:36.930347 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:37.002225 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-adcb1484-c193-4630-a477-a17bccbf97c9 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.137s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:37.108148 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating instance_info_cache with network_info: [{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:37.192179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:37.192292 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:37.192546 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:37.192694 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:37.192796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:37.194906 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Terminating instance
May 27 23:03:37.563766 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:03:37.610087 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Releasing lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:37.697852 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:03:37.728313 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:37.731733 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:37.760936 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:37.914253 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:37.923359 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:37.951620 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-80b86b24-4612-4866-a1bc-c8ba6cc842b3 req-751e738a-1ce7-4633-a9c8-c43a86ab94c4 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:37.952131 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-80b86b24-4612-4866-a1bc-c8ba6cc842b3 req-751e738a-1ce7-4633-a9c8-c43a86ab94c4 service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:37.952316 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-80b86b24-4612-4866-a1bc-c8ba6cc842b3 req-751e738a-1ce7-4633-a9c8-c43a86ab94c4 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:37.952508 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-80b86b24-4612-4866-a1bc-c8ba6cc842b3 req-751e738a-1ce7-4633-a9c8-c43a86ab94c4 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:37.952670 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-80b86b24-4612-4866-a1bc-c8ba6cc842b3 req-751e738a-1ce7-4633-a9c8-c43a86ab94c4 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:37.952848 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-80b86b24-4612-4866-a1bc-c8ba6cc842b3 req-751e738a-1ce7-4633-a9c8-c43a86ab94c4 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:03:38.010538 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:38.019264 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:38.032423 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999704837000081 future=<Future at 0x726e38640f20 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:38.033643 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998410452000144 future=<Future at 0x726e38640f20 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:38.033786 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998252296000146 future=<Future at 0x726e38640f20 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:38.034708 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Instance destroyed successfully.
May 27 23:03:38.035427 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'resources' on Instance uuid 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:38.248716 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:38.538971 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387169604',display_name='tempest-ServerRescueNegativeTestJSON-server-1387169604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-1387169604',id=11,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMm+yhSwEok+0ExtQUX/N7Mp2wWehXO06JZkCmX7PNpDkKIgB3aEsU6fo/i2atzPjbTEkDy8zEdL4FI+9I32CVR1gqa6cI1Wn0i/uB7WDgHSVop9ymnZE7TmYqrtE4yC3w==',key_name='tempest-keypair-1375101173',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:02:48Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-nkhrldeb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d33b630152d4b96949f3afbb65d7115',uuid=602b3e68-4ea1-48f7-a212-af3d9f8ddf7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:03:38.539174 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "address": "fa:16:3e:47:f0:45", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c554f6-4c", "ovs_interfaceid": "d1c554f6-4c5e-4c94-b8dd-469ba0a41da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:38.539684 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=d1c554f6-4c5e-4c94-b8dd-469ba0a41da8,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c554f6-4c') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:38.539910 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=d1c554f6-4c5e-4c94-b8dd-469ba0a41da8,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c554f6-4c') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:03:38.541255 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:38.541641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1c554f6-4c, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:38.545790 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:38.545790 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:38.545790 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:38.545790 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:38.545972 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05dda841-ab0d-45f8-b876-388b039257a4) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:38.546433 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:38.549012 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:38.549012 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:38.549415 np0000001565 nova-compute[98289]: INFO os_vif [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:f0:45,bridge_name='br-int',has_traffic_filtering=True,id=d1c554f6-4c5e-4c94-b8dd-469ba0a41da8,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c554f6-4c')
May 27 23:03:38.549701 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Deleting instance files /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d_del
May 27 23:03:38.550469 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Deletion of /opt/stack/data/nova/instances/602b3e68-4ea1-48f7-a212-af3d9f8ddf7d_del complete
May 27 23:03:38.585669 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Found WWN 3300000008e8dca8f for multipath device dm-4 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:03:38.585669 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:38.585669 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000008e8dca8f', 'path': '/dev/dm-4', 'multipath_id': '3300000008e8dca8f'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:38.585669 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008e8dca8f', 'path': '/dev/dm-4', 'multipath_id': '3300000008e8dca8f'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:03:38.585669 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.727s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:38.585669 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efb4a267-4a4f-4d87-a669-59ae752f46d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:03:38.597859 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:38.598513 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:38.600886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:38.603809 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:38.604086 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:38.604526 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:38.620897 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:38.620897 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:38.625634 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:38.625634 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:38.637457 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:38.642705 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:38.657806 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:38.658386 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:38.658386 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:38.659743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('21', '0', '0', 0) found on session 32 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:38.659743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 21 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:38.664564 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:38.665280 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:38.665280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:38.666960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('22', '0', '0', 0) found on session 33 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:38.667059 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 22 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:38.671803 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 32 and hctl ('21', '0', '0', 0) yield: sdp {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:38.671925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'efb4a267-4a4f-4d87-a669-59ae752f46d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:38.674937 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 33 and hctl ('22', '0', '0', 0) yield: sdq {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:38.675087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efb4a267-4a4f-4d87-a669-59ae752f46d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:39.056622 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 23:03:39.057493 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:03:39.057603 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:03:39.057696 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:03:39.057907 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:39.093664 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-65006145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-65006145',id=24,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-bj8x2age',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:29Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=8eb4bd8d-577c-4065-a466-d943fd51ef8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:39.093942 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:39.095941 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:70:56,bridge_name='br-int',has_traffic_filtering=True,id=7343ba63-a626-4bbe-b9bd-b4668c6593a7,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7343ba63-a6') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:39.100666 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'pci_devices' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:39.128242 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Starting migrate_disk_and_power_off {{(pid=98289) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 27 23:03:39.158109 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.164537 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.190849 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:39.193657 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.202499 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.236759 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.392045 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b4b1464a-29ea-4294-b180-0a01ed02683e req-470c8a5c-fcc3-479b-9508-37e1c11a282a service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:39.392992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b4b1464a-29ea-4294-b180-0a01ed02683e req-470c8a5c-fcc3-479b-9508-37e1c11a282a service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:39.393152 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b4b1464a-29ea-4294-b180-0a01ed02683e req-470c8a5c-fcc3-479b-9508-37e1c11a282a service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:39.393319 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b4b1464a-29ea-4294-b180-0a01ed02683e req-470c8a5c-fcc3-479b-9508-37e1c11a282a service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:39.394086 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b4b1464a-29ea-4294-b180-0a01ed02683e req-470c8a5c-fcc3-479b-9508-37e1c11a282a service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] No waiting events found dispatching network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:39.394086 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-b4b1464a-29ea-4294-b180-0a01ed02683e req-470c8a5c-fcc3-479b-9508-37e1c11a282a service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received unexpected event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f for instance with vm_state active and task_state resize_migrating.
May 27 23:03:39.474445 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.486210 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.521038 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99960021899983 future=<Future at 0x726e581e6e70 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:39.525173 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance destroyed successfully.
May 27 23:03:39.529411 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-373770128',display_name='tempest-ServerActionsTestOtherB-server-373770128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestotherb-server-373770128',id=16,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkuCpnXkvttUUkvybNqerRfpglzcntgI2LbNRFPS1WvoMpreQBqFxBf2ldcA5vcM/zSM/QMd+MwRw2lJY1injdu+2h30nJE+SFIeu7eI9MVi5k22eYdTlR/lcnOcp4shQ==',key_name='tempest-keypair-47837674',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:02:36Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dbf5952ce9242a38d3c1881a1604223',ramdisk_id='',reservation_id='r-qn417ctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1638868194',owner_user_name='tempest-ServerActionsTestOtherB-1638868194-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb24b22559e4715a196b40ce9948d74',uuid=80c6eabe-0192-4030-a194-2d87bb638464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099632896-network", "vif_mac": "fa:16:3e:c3:7f:1b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:03:39.529411 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converting VIF {"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099632896-network", "vif_mac": "fa:16:3e:c3:7f:1b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:39.529411 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:39.529411 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:03:39.530312 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.530525 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61892495-66, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:39.532514 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.532858 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:39.533519 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.534504 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.534591 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=900e8bc6-4abf-4db9-bd20-cd8631e9a7cc) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:39.535021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.535417 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:39.536418 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.540112 np0000001565 nova-compute[98289]: INFO os_vif [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66')
May 27 23:03:39.542928 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:03:39.542928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:39.542928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:39.600319 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:03:39.603906 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] End _get_guest_xml xml=<domain type="qemu">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <uuid>8eb4bd8d-577c-4065-a466-d943fd51ef8e</uuid>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <name>instance-00000018</name>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-65006145</nova:name>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:03:35</nova:creationTime>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:user uuid="6037b0819a94463e8e45d96f834c4341">tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member</nova:user>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:project uuid="9818a7ed096346eb92128648c4280071">tempest-ServerBootFromVolumeStableRescueTest-800872693</nova:project>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         <nova:port uuid="7343ba63-a626-4bbe-b9bd-b4668c6593a7">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <system>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <entry name="serial">8eb4bd8d-577c-4065-a466-d943fd51ef8e</entry>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <entry name="uuid">8eb4bd8d-577c-4065-a466-d943fd51ef8e</entry>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     </system>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <os>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   </os>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <features>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   </features>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   <devices>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.config"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <alias name="ua-0f68fa49-46d6-4139-a993-b907a1188ed0"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-4"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <serial>0f68fa49-46d6-4139-a993-b907a1188ed0</serial>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:aa:70:56"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <target dev="tap7343ba63-a6"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/console.log" append="off"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     </serial>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <video>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     </video>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     </rng>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:   </devices>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]: </domain>
May 27 23:03:39.603906 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:03:39.605978 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Preparing to wait for external event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:03:39.605978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:39.605978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:39.605978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:39.605978 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-65006145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-65006145',id=24,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-bj8x2age',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:29Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=8eb4bd8d-577c-4065-a466-d943fd51ef8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:39.605978 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:39.606314 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:70:56,bridge_name='br-int',has_traffic_filtering=True,id=7343ba63-a626-4bbe-b9bd-b4668c6593a7,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7343ba63-a6') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:39.606878 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:70:56,bridge_name='br-int',has_traffic_filtering=True,id=7343ba63-a626-4bbe-b9bd-b4668c6593a7,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7343ba63-a6') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:39.606878 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.606878 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:39.607039 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:39.608028 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.608167 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40e04055-5c18-5e07-af62-41609e7a8e90', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:39.608897 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.609938 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:39.610485 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.612410 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.612539 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7343ba63-a6, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:39.612860 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7343ba63-a6, col_values=(('qos', UUID('37ab3cb2-5ccc-4204-ac4f-776ee3d1c8a2')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:39.613045 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7343ba63-a6, col_values=(('external_ids', {'iface-id': '7343ba63-a626-4bbe-b9bd-b4668c6593a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:70:56', 'vm-uuid': '8eb4bd8d-577c-4065-a466-d943fd51ef8e'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:39.613679 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.614867 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:39.619793 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:39.620635 np0000001565 nova-compute[98289]: INFO os_vif [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:70:56,bridge_name='br-int',has_traffic_filtering=True,id=7343ba63-a626-4bbe-b9bd-b4668c6593a7,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7343ba63-a6')
May 27 23:03:40.015606 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-15b981cb-b204-4c63-a4cc-df38179668aa req-941d7387-6126-45aa-9da7-d8c04b3092f1 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:40.015766 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-15b981cb-b204-4c63-a4cc-df38179668aa req-941d7387-6126-45aa-9da7-d8c04b3092f1 service nova] Acquiring lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:40.016645 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-15b981cb-b204-4c63-a4cc-df38179668aa req-941d7387-6126-45aa-9da7-d8c04b3092f1 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:40.016758 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-15b981cb-b204-4c63-a4cc-df38179668aa req-941d7387-6126-45aa-9da7-d8c04b3092f1 service nova] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:40.016861 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-15b981cb-b204-4c63-a4cc-df38179668aa req-941d7387-6126-45aa-9da7-d8c04b3092f1 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] No waiting events found dispatching network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:40.016977 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-15b981cb-b204-4c63-a4cc-df38179668aa req-941d7387-6126-45aa-9da7-d8c04b3092f1 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-unplugged-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:03:40.017066 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-15b981cb-b204-4c63-a4cc-df38179668aa req-941d7387-6126-45aa-9da7-d8c04b3092f1 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Received event network-vif-deleted-d1c554f6-4c5e-4c94-b8dd-469ba0a41da8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:40.017174 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-15b981cb-b204-4c63-a4cc-df38179668aa req-941d7387-6126-45aa-9da7-d8c04b3092f1 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Neutron deleted interface d1c554f6-4c5e-4c94-b8dd-469ba0a41da8; detaching it from the instance and deleting it from the info cache
May 27 23:03:40.019000 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-15b981cb-b204-4c63-a4cc-df38179668aa req-941d7387-6126-45aa-9da7-d8c04b3092f1 service nova] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Detach interface failed, port_id=d1c554f6-4c5e-4c94-b8dd-469ba0a41da8, reason: Instance 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:03:40.213493 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:40.617963 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found WWN 330000000888da0d7 for multipath device dm-11 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:03:40.618528 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.033s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:40.618528 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== connect_volume: return (4760ms) {'type': 'block', 'scsi_wwn': '330000000888da0d7', 'path': '/dev/dm-11', 'multipath_id': '330000000888da0d7'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:40.618528 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000888da0d7', 'path': '/dev/dm-11', 'multipath_id': '330000000888da0d7'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:03:40.618935 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.076s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:40.619440 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:03:40.619622 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:03:40.623354 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid 6ab04c1a-7858-471e-95fd-5b04d1da3061 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:40.654868 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:40.655665 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', '35')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:03:40.655665 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '31')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:03:40.656895 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '30')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:03:40.658584 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e38615800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'): ({'sdo'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:03:40.658799 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Removing multipathed devices sdo, sdn {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:03:40.659048 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Flush multipath device 330000000493f2b88 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:03:40.696893 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:03:40.716431 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Took 1.66 seconds to deallocate network for instance.
May 27 23:03:40.742063 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:03:40.797801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:03:40.797956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:03:40.799533 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:03:40.810207 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:03:40.810504 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:03:40.822520 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:40.858488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260]
May 27 23:03:40.858488 np0000001565 nova-compute[98289]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260] successful.
May 27 23:03:40.858488 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:40.884280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:40.895872 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:40.939655 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260]
May 27 23:03:40.939655 np0000001565 nova-compute[98289]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260] successful.
May 27 23:03:40.939655 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:40.970559 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:40.970694 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:40.970819 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] <== disconnect_volume: return (1428ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:40.970936 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:03:40.973141 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:41.070725 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:41.071424 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:41.127803 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Attempting to attach volume efb4a267-4a4f-4d87-a669-59ae752f46d7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:03:41.129937 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:03:41.129937 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:41.129937 np0000001565 nova-compute[98289]:   <alias name="ua-efb4a267-4a4f-4d87-a669-59ae752f46d7"/>
May 27 23:03:41.129937 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-11"/>
May 27 23:03:41.129937 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:03:41.129937 np0000001565 nova-compute[98289]:   <serial>efb4a267-4a4f-4d87-a669-59ae752f46d7</serial>
May 27 23:03:41.129937 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:03:41.129937 np0000001565 nova-compute[98289]: </disk>
May 27 23:03:41.129937 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:03:41.143898 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:41.144072 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:41.144221 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No VIF found with MAC fa:16:3e:aa:70:56, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:41.144820 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Using config drive
May 27 23:03:41.180438 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:41.181014 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:03:41.181768 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464_resize/disk /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:41.226235 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:41.226604 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:41.273567 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "cp -r /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464_resize/disk /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:41.273936 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464_resize/disk.config /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:41.331163 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "cp -r /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464_resize/disk.config /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config" returned: 0 in 0.057s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:41.333363 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464_resize/disk.info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.info {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:41.373189 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "cp -r /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464_resize/disk.info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.info" returned: 0 in 0.041s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:41.498053 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a2da8d3f-7b25-4d23-9b1d-1a9afbc28905 req-51fd5061-3137-4913-a1e3-174ddb9d6393 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:41.499791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a2da8d3f-7b25-4d23-9b1d-1a9afbc28905 req-51fd5061-3137-4913-a1e3-174ddb9d6393 service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:41.500159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a2da8d3f-7b25-4d23-9b1d-1a9afbc28905 req-51fd5061-3137-4913-a1e3-174ddb9d6393 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:41.500760 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a2da8d3f-7b25-4d23-9b1d-1a9afbc28905 req-51fd5061-3137-4913-a1e3-174ddb9d6393 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:41.501106 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a2da8d3f-7b25-4d23-9b1d-1a9afbc28905 req-51fd5061-3137-4913-a1e3-174ddb9d6393 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] No waiting events found dispatching network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:41.501395 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-a2da8d3f-7b25-4d23-9b1d-1a9afbc28905 req-51fd5061-3137-4913-a1e3-174ddb9d6393 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received unexpected event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f for instance with vm_state active and task_state resize_migrating.
May 27 23:03:41.660861 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:41.810389 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Creating config drive at /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.config
May 27 23:03:41.815865 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpecgw16eo {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:41.861055 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpecgw16eo" returned: 0 in 0.045s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:42.135220 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:03:42.135546 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:03:42.258021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:42.284227 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:42.286173 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:42.387903 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:42.419448 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:42.508106 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:42.508382 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:42.603264 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Port 61892495-669a-42b8-9d49-04d6990d3b8f binding to destination host np0000001565 is already ACTIVE {{(pid=98289) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 23:03:42.638792 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:03:42.838643 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:42.839048 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:42.839048 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:42.839140 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:62:f3:f7, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:43.089522 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923023.089174, 8eb4bd8d-577c-4065-a466-d943fd51ef8e => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:43.089932 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] VM Started (Lifecycle Event)
May 27 23:03:43.121187 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:03:43.121622 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:03:43.145692 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.919s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:43.195628 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Deleted allocations for instance 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d
May 27 23:03:43.260046 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:43.581495 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e8e4d909-5a17-4e83-af73-eb924ce2cc03 req-2e10a325-433c-4ddf-8ae3-111d879d9a85 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:43.582549 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e4d909-5a17-4e83-af73-eb924ce2cc03 req-2e10a325-433c-4ddf-8ae3-111d879d9a85 service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:43.582790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e4d909-5a17-4e83-af73-eb924ce2cc03 req-2e10a325-433c-4ddf-8ae3-111d879d9a85 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:43.582978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e4d909-5a17-4e83-af73-eb924ce2cc03 req-2e10a325-433c-4ddf-8ae3-111d879d9a85 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:43.583190 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e8e4d909-5a17-4e83-af73-eb924ce2cc03 req-2e10a325-433c-4ddf-8ae3-111d879d9a85 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Processing event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:03:43.583391 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e8e4d909-5a17-4e83-af73-eb924ce2cc03 req-2e10a325-433c-4ddf-8ae3-111d879d9a85 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:43.583524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e4d909-5a17-4e83-af73-eb924ce2cc03 req-2e10a325-433c-4ddf-8ae3-111d879d9a85 service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:43.583770 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e4d909-5a17-4e83-af73-eb924ce2cc03 req-2e10a325-433c-4ddf-8ae3-111d879d9a85 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:43.583887 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e4d909-5a17-4e83-af73-eb924ce2cc03 req-2e10a325-433c-4ddf-8ae3-111d879d9a85 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:43.584992 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e8e4d909-5a17-4e83-af73-eb924ce2cc03 req-2e10a325-433c-4ddf-8ae3-111d879d9a85 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] No waiting events found dispatching network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:43.585157 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e8e4d909-5a17-4e83-af73-eb924ce2cc03 req-2e10a325-433c-4ddf-8ae3-111d879d9a85 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received unexpected event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 for instance with vm_state building and task_state spawning.
May 27 23:03:43.585652 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:03:43.589277 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:03:43.591416 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Instance spawned successfully.
May 27 23:03:43.592248 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:43.593405 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:03:43.602766 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:43.611589 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:03:43.629460 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:43.629654 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:43.629810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:44.101521 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:44.101890 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:44.102072 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:44.103325 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:44.103325 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:44.103612 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:03:44.107726 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:03:44.110824 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923024.1104813, 8eb4bd8d-577c-4065-a466-d943fd51ef8e => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:44.111970 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] VM Paused (Lifecycle Event)
May 27 23:03:44.206011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5764713-e06b-4c41-ab66-ffcceaab5945 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "602b3e68-4ea1-48f7-a212-af3d9f8ddf7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.013s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:44.406240 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fbbd50c7-c402-4149-99ed-ba077d34025c tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.272s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:44.608359 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Took 9.11 seconds to spawn the instance on the hypervisor.
May 27 23:03:44.609300 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:44.615607 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:44.616543 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:44.618050 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923024.617859, 8eb4bd8d-577c-4065-a466-d943fd51ef8e => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:44.618180 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] VM Resumed (Lifecycle Event)
May 27 23:03:44.645353 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:44.758530 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:44.758940 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquired lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:44.758940 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:03:45.119745 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:03:45.120256 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:03:45.121734 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Took 20.60 seconds to build instance.
May 27 23:03:45.123568 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:03:45.123846 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:03:45.127564 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:45.129195 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:45.266494 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:45.458719 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6a99f05a-6544-4994-9a1a-d98c320d088a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:45.458873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:45.603920 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:45.623661 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-21f082e1-d669-46eb-a9e0-8719926e0d4f tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.124s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:45.628444 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:45.628643 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:45.628779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:45.628918 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:03:45.768707 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating instance_info_cache with network_info: [{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:45.961404 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Detaching volume efb4a267-4a4f-4d87-a669-59ae752f46d7
May 27 23:03:46.013598 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Attempting to driver detach volume efb4a267-4a4f-4d87-a669-59ae752f46d7 from mountpoint /dev/vdb
May 27 23:03:46.024421 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found disk vdb by alias ua-efb4a267-4a4f-4d87-a669-59ae752f46d7 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:03:46.026667 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found disk vdb by alias ua-efb4a267-4a4f-4d87-a669-59ae752f46d7 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:03:46.026855 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Attempting to detach device vdb from instance 6a99f05a-6544-4994-9a1a-d98c320d088a from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:03:46.027213 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:03:46.027213 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:46.027213 np0000001565 nova-compute[98289]:   <alias name="ua-efb4a267-4a4f-4d87-a669-59ae752f46d7"/>
May 27 23:03:46.027213 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-11"/>
May 27 23:03:46.027213 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:03:46.027213 np0000001565 nova-compute[98289]:   <serial>efb4a267-4a4f-4d87-a669-59ae752f46d7</serial>
May 27 23:03:46.027213 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:03:46.027213 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:03:46.027213 np0000001565 nova-compute[98289]: </disk>
May 27 23:03:46.027213 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:03:46.036132 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully detached device vdb from instance 6a99f05a-6544-4994-9a1a-d98c320d088a from the persistent domain config.
May 27 23:03:46.036415 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] (1/8): Attempting to detach device vdb with device alias ua-efb4a267-4a4f-4d87-a669-59ae752f46d7 from instance 6a99f05a-6544-4994-9a1a-d98c320d088a from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:03:46.036748 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:03:46.036748 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:46.036748 np0000001565 nova-compute[98289]:   <alias name="ua-efb4a267-4a4f-4d87-a669-59ae752f46d7"/>
May 27 23:03:46.036748 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-11"/>
May 27 23:03:46.036748 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:03:46.036748 np0000001565 nova-compute[98289]:   <serial>efb4a267-4a4f-4d87-a669-59ae752f46d7</serial>
May 27 23:03:46.036748 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:03:46.036748 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:03:46.036748 np0000001565 nova-compute[98289]: </disk>
May 27 23:03:46.036748 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:03:46.270835 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Releasing lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:46.496283 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Rescuing
May 27 23:03:46.496529 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:46.496668 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquired lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:46.496796 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:03:46.565543 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923026.5651205, 6a99f05a-6544-4994-9a1a-d98c320d088a => ua-efb4a267-4a4f-4d87-a669-59ae752f46d7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:03:46.568280 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-efb4a267-4a4f-4d87-a669-59ae752f46d7 for instance 6a99f05a-6544-4994-9a1a-d98c320d088a {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:03:46.570237 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully detached device vdb from instance 6a99f05a-6544-4994-9a1a-d98c320d088a from the live domain config.
May 27 23:03:46.679431 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:03:46.682278 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:46.779565 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:46.780176 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:46.782661 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:46.795615 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:03:46.820629 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:46.864481 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:03:46.864797 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:03:46.869872 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:46.870710 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:03:46.874593 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:03:46.881243 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::5852:89ff:fe9b:78ce', 'fe80::fc16:3eff:fe67:1ba1', 'fe80::fc16:3eff:fe9e:b77a', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fea8:ff85', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe09:383a', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe33:9245', 'fe80::fc16:3eff:fe03:d498', 'fe80::fc16:3eff:fe8b:84b8', 'fe80::dcd4:d2ff:fef1:b456', 'fe80::fc16:3eff:fe26:6a6', 'fe80::fc16:3eff:fef8:60af', 'fe80::fc16:3eff:fee6:c4ae', 'fe80::fc16:3eff:fe57:4518', 'fe80::fc16:3eff:fe81:5e14', 'fe80::e0fd:1fff:feda:75a7', 'fe80::4893:9bff:fe5d:9403', 'fe80::fc16:3eff:feaa:7056'] 
May 27 23:03:46.881413 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:03:46.881556 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:03:46.881882 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:46.887828 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:03:46.891989 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:46.978388 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:46.980079 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:47.000637 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:47.070319 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:47.075697 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:47.128912 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Detected multiple connections on this host for volume: efb4a267-4a4f-4d87-a669-59ae752f46d7, skipping target disconnect.
May 27 23:03:47.159926 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:47.160532 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:47.237779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:47.240940 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:47.262223 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:47.263151 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:47.263763 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:47.264023 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:47.264293 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:47.274367 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Terminating instance
May 27 23:03:47.479413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:47.479968 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:47.552776 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:47.584391 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:47.587672 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:03:47.590167 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:47.680918 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:47.681565 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:47.700776 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid 6a99f05a-6544-4994-9a1a-d98c320d088a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:47.708709 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Updating instance_info_cache with network_info: [{"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:47.766888 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:47.767395 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:03:47.771193 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:47.787925 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:03:47.824302 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:47.830317 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:47.857827 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:47.880825 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json" returned: 0 in 0.110s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:47.881297 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:47.972080 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk.rescue --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:47.974364 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.013670 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6026b096-a42f-4037-a4cc-d1981e04afa5 req-960e53d2-6a86-4c32-84cb-c4ee3dfe0a38 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:48.013670 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6026b096-a42f-4037-a4cc-d1981e04afa5 req-960e53d2-6a86-4c32-84cb-c4ee3dfe0a38 service nova] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:48.013670 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6026b096-a42f-4037-a4cc-d1981e04afa5 req-960e53d2-6a86-4c32-84cb-c4ee3dfe0a38 service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:48.013670 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6026b096-a42f-4037-a4cc-d1981e04afa5 req-960e53d2-6a86-4c32-84cb-c4ee3dfe0a38 service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:48.014036 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6026b096-a42f-4037-a4cc-d1981e04afa5 req-960e53d2-6a86-4c32-84cb-c4ee3dfe0a38 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] No waiting events found dispatching network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:48.014171 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6026b096-a42f-4037-a4cc-d1981e04afa5 req-960e53d2-6a86-4c32-84cb-c4ee3dfe0a38 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:03:48.032444 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:48.041471 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:48.087254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.089542 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Starting finish_migration {{(pid=98289) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 27 23:03:48.091479 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.091559 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance directory exists: not creating {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 23:03:48.091691 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Creating image(s)
May 27 23:03:48.108613 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:48.114479 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.158349 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999050117000024 future=<Future at 0x726e38766c90 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:48.162933 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Instance destroyed successfully.
May 27 23:03:48.165214 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'resources' on Instance uuid 489adb12-811c-408c-af3f-24edcfc9d4bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:48.185628 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.188448 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.215246 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Releasing lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:48.238485 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.127s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.239777 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:03:48.243351 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.273924 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:48.286111 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.286701 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.337824 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.338157 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Cannot resize image /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:03:48.391132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.397358 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.498961 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.499390 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.579776 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.583131 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.663436 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.663436 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.677240 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-602165631',display_name='tempest-ServerRescueNegativeTestJSON-server-602165631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-602165631',id=2,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:01:09Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-0koevn0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:01:09Z,user_data=None,user_id='8d33b630152d4b96949f3afbb65d7115',uuid=489adb12-811c-408c-af3f-24edcfc9d4bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:03:48.679679 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "address": "fa:16:3e:67:1b:a1", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc65314-8d", "ovs_interfaceid": "4dc65314-8dc9-4ca6-a74b-2cb818efd866", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:48.683348 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=4dc65314-8dc9-4ca6-a74b-2cb818efd866,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc65314-8d') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:48.683348 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=4dc65314-8dc9-4ca6-a74b-2cb818efd866,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc65314-8d') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:03:48.689595 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:48.690111 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dc65314-8d, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:48.699595 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:48.700513 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:48.700667 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=792c39c2-d0ee-4176-971d-ab3c038b3610) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:48.704005 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:48.705938 np0000001565 nova-compute[98289]: INFO os_vif [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=4dc65314-8dc9-4ca6-a74b-2cb818efd866,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc65314-8d')
May 27 23:03:48.706420 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Deleting instance files /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb_del
May 27 23:03:48.707802 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Deletion of /opt/stack/data/nova/instances/489adb12-811c-408c-af3f-24edcfc9d4bb_del complete
May 27 23:03:48.728046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ac2904b-90c0-4d25-820e-1e4cad388e84 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.269s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:48.765276 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.769605 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:03:48.769739 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:03:48.769874 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-9 (vdc) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:03:48.771498 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:03:48.772605 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.812141 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.039s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.812499 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=10698MB free_disk=74.24652099609375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:03:48.812628 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:48.813029 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:48.843355 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:03:48.843355 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Ensure instance console log exists: /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:03:48.843355 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:48.843355 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:48.843355 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:48.844308 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Start _get_guest_xml network_info=[{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099632896-network", "vif_mac": "fa:16:3e:c3:7f:1b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a9df6c7c-1309-46cd-a04f-28af18ad85ca', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '80c6eabe-0192-4030-a194-2d87bb638464', 'attached_at': '2026-05-27T23:03:47.000000', 'detached_at': '', 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'serial': '065ce712-bac2-49ae-b684-5600689bfd55'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:03:48.846321 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:03:48.847588 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-373770128', uuid='80c6eabe-0192-4030-a194-2d87bb638464'), owner=OwnerMeta(userid='6fb24b22559e4715a196b40ce9948d74', username='tempest-ServerActionsTestOtherB-1638868194-project-member', projectid='9dbf5952ce9242a38d3c1881a1604223', projectname='tempest-ServerActionsTestOtherB-1638868194'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099632896-network", "vif_mac": "fa:16:3e:c3:7f:1b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923028.8472576) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:03:48.848859 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:03:48.849250 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:03:48.850396 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:03:48.850634 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:03:48.851572 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:03:48.851966 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:03:48.852192 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:03:48.852365 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:03:48.852544 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:03:48.852692 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:03:48.852885 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:03:48.853088 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:03:48.853252 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:03:48.853458 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:03:48.853637 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:03:48.853823 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:03:48.863033 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:48.894237 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:48.894587 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:48.944209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config --force-share --output=json" returned: 0 in 0.081s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:48.946962 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:48.946962 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:48.946962 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:48.946962 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:03:48.946962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:48.946962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:48.946962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:48.946962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:03:48.959405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:48.960072 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:48.960816 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:48.961251 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:48.961520 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:48.961819 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:48.976596 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:48.976596 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:48.987930 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55] added
May 27 23:03:48.987930 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:48.987930 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:48.987930 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:48.987930 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:48.987930 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:48.987930 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:48.988263 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:48.988491 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:48.988646 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:48.989075 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:03:48.989075 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:49.005824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55] added
May 27 23:03:49.005824 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:03:49.005824 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:49.005824 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:49.005824 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:03:49.005824 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:03:49.005824 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:49.006031 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:03:49.006199 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0447(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:03:49.006352 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:03:49.216742 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Took 1.43 seconds to destroy the instance on the hypervisor.
May 27 23:03:49.217819 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:03:49.218265 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:03:49.218491 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:03:49.219032 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:49.300075 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:49.397063 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Detaching volume efb4a267-4a4f-4d87-a669-59ae752f46d7
May 27 23:03:49.456092 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Attempting to driver detach volume efb4a267-4a4f-4d87-a669-59ae752f46d7 from mountpoint /dev/vdb
May 27 23:03:49.460617 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found disk vdb by alias ua-efb4a267-4a4f-4d87-a669-59ae752f46d7 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:03:49.465262 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found disk vdb by alias ua-efb4a267-4a4f-4d87-a669-59ae752f46d7 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:03:49.465430 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Attempting to detach device vdb from instance 6ab04c1a-7858-471e-95fd-5b04d1da3061 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:03:49.465709 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:03:49.465709 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:49.465709 np0000001565 nova-compute[98289]:   <alias name="ua-efb4a267-4a4f-4d87-a669-59ae752f46d7"/>
May 27 23:03:49.465709 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-11"/>
May 27 23:03:49.465709 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:03:49.465709 np0000001565 nova-compute[98289]:   <serial>efb4a267-4a4f-4d87-a669-59ae752f46d7</serial>
May 27 23:03:49.465709 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:03:49.465709 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:03:49.465709 np0000001565 nova-compute[98289]: </disk>
May 27 23:03:49.465709 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:03:49.478182 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully detached device vdb from instance 6ab04c1a-7858-471e-95fd-5b04d1da3061 from the persistent domain config.
May 27 23:03:49.478373 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] (1/8): Attempting to detach device vdb with device alias ua-efb4a267-4a4f-4d87-a669-59ae752f46d7 from instance 6ab04c1a-7858-471e-95fd-5b04d1da3061 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:03:49.478669 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:03:49.478669 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:49.478669 np0000001565 nova-compute[98289]:   <alias name="ua-efb4a267-4a4f-4d87-a669-59ae752f46d7"/>
May 27 23:03:49.478669 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-11"/>
May 27 23:03:49.478669 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:03:49.478669 np0000001565 nova-compute[98289]:   <serial>efb4a267-4a4f-4d87-a669-59ae752f46d7</serial>
May 27 23:03:49.478669 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:03:49.478669 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:03:49.478669 np0000001565 nova-compute[98289]: </disk>
May 27 23:03:49.478669 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:03:49.655771 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e832c364-fa8e-47a3-a950-976fb5caee2e req-7a2fc6b5-599e-4f45-bc37-535fc50d0462 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-deleted-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:49.656099 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-e832c364-fa8e-47a3-a950-976fb5caee2e req-7a2fc6b5-599e-4f45-bc37-535fc50d0462 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Neutron deleted interface 4dc65314-8dc9-4ca6-a74b-2cb818efd866; detaching it from the instance and deleting it from the info cache
May 27 23:03:49.661341 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e832c364-fa8e-47a3-a950-976fb5caee2e req-7a2fc6b5-599e-4f45-bc37-535fc50d0462 service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Detach interface failed, port_id=4dc65314-8dc9-4ca6-a74b-2cb818efd866, reason: Instance 489adb12-811c-408c-af3f-24edcfc9d4bb could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:03:49.827116 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Applying migration context for instance 80c6eabe-0192-4030-a194-2d87bb638464 as it has an incoming, in-progress migration 4a7aa81e-26f8-4cea-920c-a9f1b709c270. Migration status is post-migrating {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 27 23:03:49.828580 np0000001565 nova-compute[98289]: INFO nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating resource usage from migration 4a7aa81e-26f8-4cea-920c-a9f1b709c270
May 27 23:03:49.872832 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 119d02f0-0974-4fa4-9d6a-ecfefe01e029 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.873256 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 489adb12-811c-408c-af3f-24edcfc9d4bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.873310 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance efc3328c-5e17-4eb2-b8fb-e645a6805b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.873406 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 7cb7c255-4b3c-493e-9a31-e554576a0525 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.873500 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance f47a00cc-da92-40c9-a668-9a160670addd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.873583 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 3eb890c1-c528-489f-8109-4b7870bfcf33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.873701 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6a99f05a-6544-4994-9a1a-d98c320d088a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.873861 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.873861 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.874000 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6ab04c1a-7858-471e-95fd-5b04d1da3061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.874000 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 09a47014-23a8-4dad-ab17-6df274ed8cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.874103 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 8eb4bd8d-577c-4065-a466-d943fd51ef8e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.874154 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Migration 4a7aa81e-26f8-4cea-920c-a9f1b709c270 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 27 23:03:49.874194 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 80c6eabe-0192-4030-a194-2d87bb638464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:03:49.874389 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:03:49.874509 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=3264MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:03:48 up 32 min,  2 users,  load average: 10.37, 6.31, 2.95\n', 'num_instances': '13', 'num_vm_active': '12', 'num_task_None': '10', 'num_os_type_None': '13', 'num_proj_7efe372c67374c55bd40d7757474f80a': '2', 'io_workload': '1', 'num_vm_rescued': '1', 'num_task_deleting': '1', 'num_proj_9818a7ed096346eb92128648c4280071': '4', 'num_proj_0ec877dc7b2240969ac89c13673f8799': '3', 'num_proj_d6f15f51479c4e37ab880af2031170be': '2', 'num_task_resize_finish': '1', 'num_proj_9dbf5952ce9242a38d3c1881a1604223': '1', 'num_proj_e8214904c18049c086910b7b20b109b2': '1', 'num_task_rescuing': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:03:49.906976 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:49.940058 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:49.989437 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:50.004451 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:50.004451 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:50.013907 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:50.021037 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:50.027935 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:50.027935 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:50.043022 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.051731 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.052004 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.073783 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.074094 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:50.095587 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b4109ac6-4235-46ce-b597-0619223aa6a6 req-7355d88f-45a4-4371-8cdf-a11598764f3d service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:50.095587 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:50.096464 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b4109ac6-4235-46ce-b597-0619223aa6a6 req-7355d88f-45a4-4371-8cdf-a11598764f3d service nova] Acquiring lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:50.096464 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b4109ac6-4235-46ce-b597-0619223aa6a6 req-7355d88f-45a4-4371-8cdf-a11598764f3d service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:50.096464 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b4109ac6-4235-46ce-b597-0619223aa6a6 req-7355d88f-45a4-4371-8cdf-a11598764f3d service nova] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:50.096600 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b4109ac6-4235-46ce-b597-0619223aa6a6 req-7355d88f-45a4-4371-8cdf-a11598764f3d service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] No waiting events found dispatching network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:50.097001 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b4109ac6-4235-46ce-b597-0619223aa6a6 req-7355d88f-45a4-4371-8cdf-a11598764f3d service nova] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Received event network-vif-unplugged-4dc65314-8dc9-4ca6-a74b-2cb818efd866 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:03:50.100013 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:50.116862 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:50.118320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260]
May 27 23:03:50.118320 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260] successful.
May 27 23:03:50.118320 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:50.127752 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260]
May 27 23:03:50.127752 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260] successful.
May 27 23:03:50.127752 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:50.134873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:50.141021 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:50.159649 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:50.162052 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:50.164032 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:50.164032 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:50.166413 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] HCTL ('19', '-', '-', 0) found on session 36 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:50.166534 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:50.172525 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:50.172996 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:50.172996 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:50.173388 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:50.174823 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] HCTL ('20', '-', '-', 0) found on session 37 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:50.174954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:50.185916 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching for a device in session 36 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:50.185916 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:50.196380 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching for a device in session 37 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:50.196380 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:50.233539 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999533558999929 future=<Future at 0x726e58210770 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:50.240222 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Instance destroyed successfully.
May 27 23:03:50.243552 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'numa_topology' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:50.619457 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Took 1.40 seconds to deallocate network for instance.
May 27 23:03:50.652993 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:03:50.653265 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:03:50.748110 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Attempting a stable device rescue
May 27 23:03:50.829684 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98289) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 23:03:50.834917 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Instance directory exists: not creating {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 23:03:50.834917 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Creating image(s)
May 27 23:03:50.834917 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "/opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:50.834917 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:50.834917 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:50.834917 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:50.961929 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:03:51.126526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:51.156276 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:03:51.339456 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<8eb4bd8d-577c-4065-a466-d943fd51ef8e> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:03:51.339456 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "969a736820e6d43e8dc4cd0445c46676c7cfdea4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:51.339456 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "969a736820e6d43e8dc4cd0445c46676c7cfdea4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:51.662617 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:03:51.664437 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.851s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:51.664886 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:03:51.665211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.539s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:51.981663 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Found WWN 330000000493f2b88 for multipath device dm-10 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:03:51.981990 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:51.982220 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000493f2b88', 'path': '/dev/dm-10', 'multipath_id': '330000000493f2b88'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:51.982398 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000493f2b88', 'path': '/dev/dm-10', 'multipath_id': '330000000493f2b88'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:03:51.995034 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:51.999219 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:51.999807 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4.part --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:52.084617 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4.part --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:52.085097 np0000001565 nova-compute[98289]: DEBUG nova.virt.images [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] 08156e20-0811-44a6-a9d4-d9634cd2612d was qcow2, converting to raw {{(pid=98289) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 23:03:52.085660 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:03:52.085935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4.part /opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4.converted {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:52.167365 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4.part /opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4.converted" returned: 0 in 0.081s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:52.173229 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4.converted --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:52.194842 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:52.197922 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:52.198369 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:52.198576 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:52.198812 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] No waiting events found dispatching network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:52.198994 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received unexpected event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 for instance with vm_state active and task_state rescuing.
May 27 23:03:52.199100 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:52.199470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:52.199662 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:52.199787 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:52.199889 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] No waiting events found dispatching network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:52.200098 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3138ebbd-b435-4bf2-9797-ecff58cf7c20 req-cbcb0c9a-60d9-4ddd-8db1-0c67c101f896 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received unexpected event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 for instance with vm_state active and task_state rescuing.
May 27 23:03:52.269611 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4.converted --force-share --output=json" returned: 0 in 0.096s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:52.270084 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "969a736820e6d43e8dc4cd0445c46676c7cfdea4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.933s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:52.270629 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:52.277774 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:52.279081 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "969a736820e6d43e8dc4cd0445c46676c7cfdea4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:52.279535 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "969a736820e6d43e8dc4cd0445c46676c7cfdea4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:52.279916 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:52.284157 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:03:52.284987 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:52.366534 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4 --force-share --output=json" returned: 0 in 0.081s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:52.367645 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4,backing_fmt=raw /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.rescue {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:52.429719 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/969a736820e6d43e8dc4cd0445c46676c7cfdea4,backing_fmt=raw /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.rescue" returned: 0 in 0.062s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:52.430133 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "969a736820e6d43e8dc4cd0445c46676c7cfdea4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:52.430548 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'migration_context' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:52.488606 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-373770128',display_name='tempest-ServerActionsTestOtherB-server-373770128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='tempest-serveractionstestotherb-server-373770128',id=16,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkuCpnXkvttUUkvybNqerRfpglzcntgI2LbNRFPS1WvoMpreQBqFxBf2ldcA5vcM/zSM/QMd+MwRw2lJY1injdu+2h30nJE+SFIeu7eI9MVi5k22eYdTlR/lcnOcp4shQ==',key_name='tempest-keypair-47837674',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:02:36Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dbf5952ce9242a38d3c1881a1604223',ramdisk_id='',reservation_id='r-qn417ctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1638868194',owner_user_name='tempest-ServerActionsTestOtherB-1638868194-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb24b22559e4715a196b40ce9948d74',uuid=80c6eabe-0192-4030-a194-2d87bb638464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099632896-network", "vif_mac": "fa:16:3e:c3:7f:1b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:52.488823 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converting VIF {"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099632896-network", "vif_mac": "fa:16:3e:c3:7f:1b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:52.489697 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:52.491953 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] End _get_guest_xml xml=<domain type="qemu">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <uuid>80c6eabe-0192-4030-a194-2d87bb638464</uuid>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <name>instance-00000010</name>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <memory>262144</memory>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerActionsTestOtherB-server-373770128</nova:name>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:03:48</nova:creationTime>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.micro" id="84">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:memory>256</nova:memory>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:user uuid="6fb24b22559e4715a196b40ce9948d74">tempest-ServerActionsTestOtherB-1638868194-project-member</nova:user>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:project uuid="9dbf5952ce9242a38d3c1881a1604223">tempest-ServerActionsTestOtherB-1638868194</nova:project>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         <nova:port uuid="61892495-669a-42b8-9d49-04d6990d3b8f">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <system>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <entry name="serial">80c6eabe-0192-4030-a194-2d87bb638464</entry>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <entry name="uuid">80c6eabe-0192-4030-a194-2d87bb638464</entry>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     </system>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <os>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   </os>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <features>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   </features>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   <devices>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <alias name="ua-065ce712-bac2-49ae-b684-5600689bfd55"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-10"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <serial>065ce712-bac2-49ae-b684-5600689bfd55</serial>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:c3:7f:1b"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <target dev="tap61892495-66"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/console.log" append="off"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     </serial>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <video>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     </video>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     </rng>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:   </devices>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]: </domain>
May 27 23:03:52.491953 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:03:52.494445 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-373770128',display_name='tempest-ServerActionsTestOtherB-server-373770128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='tempest-serveractionstestotherb-server-373770128',id=16,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkuCpnXkvttUUkvybNqerRfpglzcntgI2LbNRFPS1WvoMpreQBqFxBf2ldcA5vcM/zSM/QMd+MwRw2lJY1injdu+2h30nJE+SFIeu7eI9MVi5k22eYdTlR/lcnOcp4shQ==',key_name='tempest-keypair-47837674',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:02:36Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dbf5952ce9242a38d3c1881a1604223',ramdisk_id='',reservation_id='r-qn417ctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1638868194',owner_user_name='tempest-ServerActionsTestOtherB-1638868194-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb24b22559e4715a196b40ce9948d74',uuid=80c6eabe-0192-4030-a194-2d87bb638464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099632896-network", "vif_mac": "fa:16:3e:c3:7f:1b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:03:52.494445 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converting VIF {"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099632896-network", "vif_mac": "fa:16:3e:c3:7f:1b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:52.494445 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:52.494445 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:03:52.494445 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:52.494711 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:52.494953 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:03:52.496819 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:52.497039 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0c4fd31-295a-5627-9c1c-b82a07e8038a', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:52.497908 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:52.499556 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:52.507995 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:52.509680 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923032.5092833, 6ab04c1a-7858-471e-95fd-5b04d1da3061 => ua-efb4a267-4a4f-4d87-a669-59ae752f46d7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:03:52.510343 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:52.510599 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61892495-66, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:52.512205 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61892495-66, col_values=(('qos', UUID('8427e6c3-4c63-43aa-b185-bd0d76f217c8')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:52.512880 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-efb4a267-4a4f-4d87-a669-59ae752f46d7 for instance 6ab04c1a-7858-471e-95fd-5b04d1da3061 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:03:52.513298 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61892495-66, col_values=(('external_ids', {'iface-id': '61892495-669a-42b8-9d49-04d6990d3b8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:7f:1b', 'vm-uuid': '80c6eabe-0192-4030-a194-2d87bb638464'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:52.517158 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:52.518941 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully detached device vdb from instance 6ab04c1a-7858-471e-95fd-5b04d1da3061 from the live domain config.
May 27 23:03:52.525123 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:52.526595 np0000001565 nova-compute[98289]: INFO os_vif [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66')
May 27 23:03:52.528603 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:03:52.528946 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:03:52.564750 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:03:52.565154 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efb4a267-4a4f-4d87-a669-59ae752f46d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:52.565313 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:52.565678 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:52.566089 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efb4a267-4a4f-4d87-a669-59ae752f46d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:03:52.566089 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:52.602007 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:52.602451 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '37')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:03:52.602451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', '33')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:03:52.603534 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7', '32')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:03:52.604451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e6012aa20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7'): ({'sdp'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:03:52.604660 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Removing multipathed devices sdp, sdq {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:03:52.604881 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flush multipath device 330000000888da0d7 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:03:52.641678 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:03:52.674983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:03:52.717318 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking to see if SCSI volumes sdp, sdq have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:03:52.717549 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] SCSI volumes sdp, sdq have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:03:52.719162 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking to see if device paths {'sdp', 'sdq'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:03:52.729112 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Device paths {'sdp', 'sdq'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:03:52.729345 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:03:52.741311 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:52.784494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7, portal: 192.168.40.100,3260]
May 27 23:03:52.784494 np0000001565 nova-compute[98289]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7, portal: 192.168.40.100,3260] successful.
May 27 23:03:52.784494 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:52.807264 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:52.819209 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:52.856531 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7, portal: 192.168.50.100,3260]
May 27 23:03:52.856531 np0000001565 nova-compute[98289]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-efb4a267-4a4f-4d87-a669-59ae752f46d7, portal: 192.168.50.100,3260] successful.
May 27 23:03:52.856531 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:52.877883 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:52.878161 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:52.878265 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== disconnect_volume: return (312ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:52.878450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:03:52.933657 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<8eb4bd8d-577c-4065-a466-d943fd51ef8e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:03:52.934165 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:03:52.935041 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Start _get_guest_xml network_info=[{"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "vif_mac": "fa:16:3e:aa:70:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '08156e20-0811-44a6-a9d4-d9634cd2612d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e6ba6514-1edb-4da4-a841-125c86c88f26', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': '8eb4bd8d-577c-4065-a466-d943fd51ef8e', 'attached_at': '', 'detached_at': '', 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'serial': '0f68fa49-46d6-4139-a993-b907a1188ed0'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:03:52.935465 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'resources' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:53.032507 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00041624199980105914 future=<Future at 0x726e38640f20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:53.033281 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Emitting event <LifecycleEvent: 1779923018.0319731, 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:53.035116 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:53.035366 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:03:53.040265 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] VM Stopped (Lifecycle Event)
May 27 23:03:53.043785 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=1.476761002999865 future=<Future at 0x726e581e6e70 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:53.049132 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=1.4714016059999722 future=<Future at 0x726e581e6e70 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:53.280093 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:53.422060 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid 6ab04c1a-7858-471e-95fd-5b04d1da3061 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:53.438906 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<8eb4bd8d-577c-4065-a466-d943fd51ef8e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:03:53.441743 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:03:53.441743 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-65006145', uuid='8eb4bd8d-577c-4065-a466-d943fd51ef8e'), owner=OwnerMeta(userid='6037b0819a94463e8e45d96f834c4341', username='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member', projectid='9818a7ed096346eb92128648c4280071', projectname='tempest-ServerBootFromVolumeStableRescueTest-800872693'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "vif_mac": "fa:16:3e:aa:70:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923033.441314) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:03:53.443423 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:03:53.443969 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:03:53.444926 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:03:53.445174 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:03:53.446196 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:03:53.446603 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:03:53.446871 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:03:53.447051 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:03:53.447299 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:03:53.447488 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:03:53.447701 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:03:53.447991 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:03:53.448207 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:03:53.448417 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:03:53.448631 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:03:53.448822 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:03:53.449021 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:53.550465 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-acb50f41-0be0-4482-b383-baf0d746bce1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 602b3e68-4ea1-48f7-a212-af3d9f8ddf7d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:53.552068 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.887s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:53.623753 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Deleted allocations for instance 489adb12-811c-408c-af3f-24edcfc9d4bb
May 27 23:03:53.951890 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<8eb4bd8d-577c-4065-a466-d943fd51ef8e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:03:53.977374 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:03:54.059731 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.config --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:03:54.063354 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "/opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:54.063354 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:54.063354 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "/opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:54.063354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:03:54.063354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:03:54.063354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:54.063354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:54.064790 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:03:54.066365 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:54.066365 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:54.066365 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:54.066365 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] No VIF found with MAC fa:16:3e:c3:7f:1b, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:54.066365 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Using config drive
May 27 23:03:54.082171 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:54.082910 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:54.083198 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:03:54.085954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:03:54.087095 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:03:54.087324 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:54.096885 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:54.096885 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:03:54.103215 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:03:54.103215 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:54.114642 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:54.121036 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:54.137621 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:54.138020 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:54.138498 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:54.138498 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:54.139255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] HCTL ('12', '0', '0', 0) found on session 35 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:54.139397 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:03:54.147321 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:54.147321 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:03:54.151525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] HCTL ('11', '0', '0', 0) found on session 34 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:03:54.151525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:03:54.156343 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching for a device in session 35 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:54.156555 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:54.159315 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Searching for a device in session 34 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:03:54.159841 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:03:54.427503 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c7e689ab-b59f-478d-993e-f9acd390ce16 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.533s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:54.520666 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:54.522798 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.002247765999982221 future=<Future at 0x726e581e6e70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:54.523398 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Emitting event <LifecycleEvent: 1779923019.5204391, 80c6eabe-0192-4030-a194-2d87bb638464 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:54.527005 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:54.527005 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] VM Stopped (Lifecycle Event)
May 27 23:03:54.527005 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.632431629000166 future=<Future at 0x726e38766c90 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:54.527005 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.632290093000165 future=<Future at 0x726e38766c90 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:54.552911 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:54.616144 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:54.638810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-11463d88-255e-4f12-ab17-a91fd2d45325 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "489adb12-811c-408c-af3f-24edcfc9d4bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.376s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:54.744317 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e6094c70-9da7-40fe-842e-9b29880ff2d1 req-eac9d9ad-cd6a-4607-9a5a-d1316b454ffa service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:54.744744 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e6094c70-9da7-40fe-842e-9b29880ff2d1 req-eac9d9ad-cd6a-4607-9a5a-d1316b454ffa service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:54.746242 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e6094c70-9da7-40fe-842e-9b29880ff2d1 req-eac9d9ad-cd6a-4607-9a5a-d1316b454ffa service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:54.746665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e6094c70-9da7-40fe-842e-9b29880ff2d1 req-eac9d9ad-cd6a-4607-9a5a-d1316b454ffa service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:54.746830 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e6094c70-9da7-40fe-842e-9b29880ff2d1 req-eac9d9ad-cd6a-4607-9a5a-d1316b454ffa service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] No waiting events found dispatching network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:54.746965 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e6094c70-9da7-40fe-842e-9b29880ff2d1 req-eac9d9ad-cd6a-4607-9a5a-d1316b454ffa service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received unexpected event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f for instance with vm_state active and task_state resize_finish.
May 27 23:03:54.885977 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:54.896064 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:54.898209 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:54.931282 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:54.936302 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:54.967798 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:55.031181 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:55.087705 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:03:55.339853 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923035.3393748, 80c6eabe-0192-4030-a194-2d87bb638464 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:55.340473 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] VM Resumed (Lifecycle Event)
May 27 23:03:55.341619 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance event wait completed in 0 seconds for  {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:03:55.345084 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance running successfully.
May 27 23:03:55.346109 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Failed to set time: agent not configured {{(pid=98289) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 27 23:03:55.346266 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-102c7ed4-0b4d-4edb-a682-1976f1cc9984 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] finish_migration finished successfully. {{(pid=98289) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 27 23:03:55.665047 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:03:55.665464 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:03:55.665698 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:03:55.665914 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:03:55.666114 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:03:55.666224 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:03:55.666494 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.45 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:03:55.715953 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:55.715953 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:55.715953 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:55.717476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:55.717476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:55.718547 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Terminating instance
May 27 23:03:55.843804 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:55.845579 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:56.110144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Found WWN 3300000008e8dca8f for multipath device dm-4 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:03:56.110144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.046s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:03:56.110144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] <== connect_volume: return (2047ms) {'type': 'block', 'scsi_wwn': '3300000008e8dca8f', 'path': '/dev/dm-4', 'multipath_id': '3300000008e8dca8f'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:03:56.110144 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008e8dca8f', 'path': '/dev/dm-4', 'multipath_id': '3300000008e8dca8f'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:03:56.221210 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:03:56.250961 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:56.253066 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:56.282131 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:56.284787 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:56.300742 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:56.300742 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:56.306518 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:56.317976 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:56.348304 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 27 23:03:56.348611 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923036.3483846, 80c6eabe-0192-4030-a194-2d87bb638464 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:03:56.348787 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] VM Started (Lifecycle Event)
May 27 23:03:56.580200 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Instance destroyed successfully.
May 27 23:03:56.580399 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lazy-loading 'resources' on Instance uuid 119d02f0-0974-4fa4-9d6a-ecfefe01e029 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:56.615750 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-65006145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-65006145',id=24,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:44Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-bj8x2age',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:03:45Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=8eb4bd8d-577c-4065-a466-d943fd51ef8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "vif_mac": "fa:16:3e:aa:70:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:03:56.615912 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "vif_mac": "fa:16:3e:aa:70:56"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:56.616492 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:70:56,bridge_name='br-int',has_traffic_filtering=True,id=7343ba63-a626-4bbe-b9bd-b4668c6593a7,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7343ba63-a6') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:56.617122 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'pci_devices' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:56.801652 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:03:56.830273 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:56.834047 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:56.834047 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:56.834047 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:56.834047 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] No waiting events found dispatching network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:56.834047 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received unexpected event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f for instance with vm_state resized and task_state resize_reverting.
May 27 23:03:56.834047 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:56.834247 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:56.834569 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:56.834625 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:56.834710 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No waiting events found dispatching network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:56.834817 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:03:56.834940 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:56.835105 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] Acquiring lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:56.835170 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:56.835266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:03:56.835896 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] No waiting events found dispatching network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:03:56.835896 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7311d77d-3796-4bf1-87b0-73f2532328e6 req-3a7dcf64-41f5-41fe-bc1e-6a8d5031afed service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-unplugged-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:03:56.853715 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:03:56.855370 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:03:57.082900 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:00:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2120896372',display_name='tempest-ServerRescueNegativeTestJSON-server-2120896372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverrescuenegativetestjson-server-2120896372',id=1,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:01:23Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7efe372c67374c55bd40d7757474f80a',ramdisk_id='',reservation_id='r-8c5lw0uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-550001831',owner_user_name='tempest-ServerRescueNegativeTestJSON-550001831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:01:30Z,user_data=None,user_id='8d33b630152d4b96949f3afbb65d7115',uuid=119d02f0-0974-4fa4-9d6a-ecfefe01e029,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:03:57.083009 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converting VIF {"id": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "address": "fa:16:3e:9e:b7:7a", "network": {"id": "4079d638-2822-4f77-ad99-a74a3c50ed41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-146711107-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7efe372c67374c55bd40d7757474f80a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e9f6b2-ff", "ovs_interfaceid": "c2e9f6b2-ff45-449c-89c3-b661ae2ee33a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:03:57.083562 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b7:7a,bridge_name='br-int',has_traffic_filtering=True,id=c2e9f6b2-ff45-449c-89c3-b661ae2ee33a,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e9f6b2-ff') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:03:57.083796 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b7:7a,bridge_name='br-int',has_traffic_filtering=True,id=c2e9f6b2-ff45-449c-89c3-b661ae2ee33a,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e9f6b2-ff') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:03:57.084965 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:57.085210 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2e9f6b2-ff, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:57.095891 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:57.097091 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:57.104718 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:57.106562 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:57.106720 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b77c1a3e-75a5-40e5-8866-7759ca0eae2d) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:03:57.107171 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:57.107641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:03:57.113958 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:57.115839 np0000001565 nova-compute[98289]: INFO os_vif [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b7:7a,bridge_name='br-int',has_traffic_filtering=True,id=c2e9f6b2-ff45-449c-89c3-b661ae2ee33a,network=Network(4079d638-2822-4f77-ad99-a74a3c50ed41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e9f6b2-ff')
May 27 23:03:57.116259 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Deleting instance files /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029_del
May 27 23:03:57.117313 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Deletion of /opt/stack/data/nova/instances/119d02f0-0974-4fa4-9d6a-ecfefe01e029_del complete
May 27 23:03:57.119941 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<8eb4bd8d-577c-4065-a466-d943fd51ef8e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:03:57.121514 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] End _get_guest_xml xml=<domain type="qemu">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <uuid>8eb4bd8d-577c-4065-a466-d943fd51ef8e</uuid>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <name>instance-00000018</name>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-65006145</nova:name>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:03:53</nova:creationTime>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:user uuid="6037b0819a94463e8e45d96f834c4341">tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member</nova:user>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:project uuid="9818a7ed096346eb92128648c4280071">tempest-ServerBootFromVolumeStableRescueTest-800872693</nova:project>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         <nova:port uuid="7343ba63-a626-4bbe-b9bd-b4668c6593a7">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <system>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <entry name="serial">8eb4bd8d-577c-4065-a466-d943fd51ef8e</entry>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <entry name="uuid">8eb4bd8d-577c-4065-a466-d943fd51ef8e</entry>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     </system>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <os>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   </os>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <features>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   </features>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   <devices>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.config"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <alias name="ua-0f68fa49-46d6-4139-a993-b907a1188ed0"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-4"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <serial>0f68fa49-46d6-4139-a993-b907a1188ed0</serial>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.rescue"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <boot order="1"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     </disk>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:aa:70:56"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <target dev="tap7343ba63-a6"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     </interface>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/console.log" append="off"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     </serial>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <video>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     </video>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     </rng>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:   </devices>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]: </domain>
May 27 23:03:57.121514 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:03:57.129040 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:57.130757 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Instance destroyed successfully.
May 27 23:03:57.257453 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:57.257739 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:57.257908 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:57.341544 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Port 61892495-669a-42b8-9d49-04d6990d3b8f binding to destination host np0000001565 is already ACTIVE {{(pid=98289) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 23:03:57.341745 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:03:57.341848 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquired lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:03:57.341998 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:03:57.357654 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 27 23:03:57.358159 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999838286999875 future=<Future at 0x726e58219cd0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:03:57.367219 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:57.367473 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:03:57.370467 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:03:57.370632 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Claim successful on node np0000001565
May 27 23:03:57.623666 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Took 1.40 seconds to destroy the instance on the hypervisor.
May 27 23:03:57.624255 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:03:57.624467 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:03:57.624558 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:03:57.624769 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:57.685615 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:57.843907 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:57.995842 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1df170b5-a9e3-46ce-b8ca-e5aea35bdefd req-d7b22f54-1086-48ce-9cc5-a36162ecaa4b service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Received event network-vif-deleted-c2e9f6b2-ff45-449c-89c3-b661ae2ee33a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:03:57.996000 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-1df170b5-a9e3-46ce-b8ca-e5aea35bdefd req-d7b22f54-1086-48ce-9cc5-a36162ecaa4b service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Neutron deleted interface c2e9f6b2-ff45-449c-89c3-b661ae2ee33a; detaching it from the instance and deleting it from the info cache
May 27 23:03:57.999383 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1df170b5-a9e3-46ce-b8ca-e5aea35bdefd req-d7b22f54-1086-48ce-9cc5-a36162ecaa4b service nova] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Detach interface failed, port_id=c2e9f6b2-ff45-449c-89c3-b661ae2ee33a, reason: Instance 119d02f0-0974-4fa4-9d6a-ecfefe01e029 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:03:58.209834 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:03:58.285165 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:58.331246 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating instance_info_cache with network_info: [{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:58.438885 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:03:58.647652 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:58.647783 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:58.647898 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:03:58.647985 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] No VIF found with MAC fa:16:3e:aa:70:56, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:03:58.648460 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Using config drive
May 27 23:03:58.833476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Releasing lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:03:58.941461 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Took 1.32 seconds to deallocate network for instance.
May 27 23:03:59.006573 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:03:59.006860 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:03:59.151004 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'ec2_ids' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:59.336805 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Creating tmpfile /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/tmpveiw2n9w to verify with other compute node that the instance is on the same shared storage. {{(pid=98289) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 27 23:03:59.337275 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:03:59.446548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:03:59.512357 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:03:59.654754 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<8eb4bd8d-577c-4065-a466-d943fd51ef8e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:03:59.654952 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'keypairs' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:03:59.862434 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:59.867860 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:59.886304 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:59.895155 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:59.915167 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:03:59.926514 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.018803 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5a24a92c-b830-4f38-b438-f83490db584a req-1783161d-bd2a-4b65-bcff-d4a7dd793bc9 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:00.019658 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.652s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:00.020394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5a24a92c-b830-4f38-b438-f83490db584a req-1783161d-bd2a-4b65-bcff-d4a7dd793bc9 service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:00.020716 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.573s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:00.021352 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:04:00.022845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5a24a92c-b830-4f38-b438-f83490db584a req-1783161d-bd2a-4b65-bcff-d4a7dd793bc9 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:00.023456 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5a24a92c-b830-4f38-b438-f83490db584a req-1783161d-bd2a-4b65-bcff-d4a7dd793bc9 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:00.023667 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5a24a92c-b830-4f38-b438-f83490db584a req-1783161d-bd2a-4b65-bcff-d4a7dd793bc9 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] No waiting events found dispatching network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:00.027983 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5a24a92c-b830-4f38-b438-f83490db584a req-1783161d-bd2a-4b65-bcff-d4a7dd793bc9 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received unexpected event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f for instance with vm_state resized and task_state resize_reverting.
May 27 23:04:00.157832 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<8eb4bd8d-577c-4065-a466-d943fd51ef8e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:04:00.162512 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:00.167358 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999129861000029 future=<Future at 0x726e38764410 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:00.170067 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance destroyed successfully.
May 27 23:04:00.170159 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lazy-loading 'resources' on Instance uuid 80c6eabe-0192-4030-a194-2d87bb638464 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:00.311849 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Creating config drive at /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.config.rescue
May 27 23:04:00.318395 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp606crvrk {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:00.366211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp606crvrk" returned: 0 in 0.048s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:00.533171 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:04:00.534518 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:04:00.534962 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:00.535306 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:00.644055 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c6d94c1e6da4237aa5dd517c31e03d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec877dc7b2240969ac89c13673f8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:04:00.672663 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-373770128',display_name='tempest-ServerActionsTestOtherB-server-373770128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='tempest-serveractionstestotherb-server-373770128',id=16,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkuCpnXkvttUUkvybNqerRfpglzcntgI2LbNRFPS1WvoMpreQBqFxBf2ldcA5vcM/zSM/QMd+MwRw2lJY1injdu+2h30nJE+SFIeu7eI9MVi5k22eYdTlR/lcnOcp4shQ==',key_name='tempest-keypair-47837674',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:55Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dbf5952ce9242a38d3c1881a1604223',ramdisk_id='',reservation_id='r-qn417ctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1638868194',owner_user_name='tempest-ServerActionsTestOtherB-1638868194-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb24b22559e4715a196b40ce9948d74',uuid=80c6eabe-0192-4030-a194-2d87bb638464,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:00.672916 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converting VIF {"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:00.673786 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:00.674073 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:00.677522 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.677797 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61892495-66, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:00.679073 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.680110 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:00.686123 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.687442 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.687930 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8427e6c3-4c63-43aa-b185-bd0d76f217c8) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:00.688883 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.689296 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:00.706710 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.708666 np0000001565 nova-compute[98289]: INFO os_vif [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66')
May 27 23:04:00.710074 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:04:00.710418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:00.710559 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:00.710913 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:00.711209 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:04:00.711360 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:00.743663 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '37')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:04:00.743663 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '36')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:00.744296 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '37')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:00.745013 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e587b7060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'): ({'sdo'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:04:00.745227 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Removing multipathed devices sdo, sdn {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:04:00.745595 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Flush multipath device 330000000493f2b88 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:04:00.784324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:00.800927 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.819591 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:00.819909 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:00.832960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:00.833422 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.839834 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.891352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:04:00.891352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:04:00.891604 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:04:00.903914 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:04:00.904284 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:04:00.917754 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:00.937824 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.950614 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:00.958879 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260]
May 27 23:04:00.958879 np0000001565 nova-compute[98289]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260] successful.
May 27 23:04:00.958879 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:00.981102 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:00.992295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:01.039126 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:04:01.045416 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260]
May 27 23:04:01.045416 np0000001565 nova-compute[98289]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260] successful.
May 27 23:04:01.045416 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:01.069820 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:01.070140 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:01.070256 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] <== disconnect_volume: return (359ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:01.070426 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:04:01.323146 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:01.433563 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Successfully created port: e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:04:01.542217 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:04:01.643020 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 8eb4bd8d-577c-4065-a466-d943fd51ef8e due to new event <LifecycleEvent: 1779923041.6425521, 8eb4bd8d-577c-4065-a466-d943fd51ef8e => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:04:01.643792 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923041.6425521, 8eb4bd8d-577c-4065-a466-d943fd51ef8e => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:01.643862 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] VM Resumed (Lifecycle Event)
May 27 23:04:01.646434 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6cb3969a-019f-46c4-a8e3-0564c19edbe1 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:01.832524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.813s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:01.900403 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Deleted allocations for instance 119d02f0-0974-4fa4-9d6a-ecfefe01e029
May 27 23:04:01.969671 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Successfully updated port: e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:04:02.032515 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0d0b086d-bc10-48bb-b331-9bdce204c803 req-554f8075-c06e-43fa-9a12-d52405cb0fcb service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-changed-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:02.032515 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0d0b086d-bc10-48bb-b331-9bdce204c803 req-554f8075-c06e-43fa-9a12-d52405cb0fcb service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Refreshing instance network info cache due to event network-changed-e837edcc-48f7-475e-ab37-e584deffe1c5. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:04:02.033524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0d0b086d-bc10-48bb-b331-9bdce204c803 req-554f8075-c06e-43fa-9a12-d52405cb0fcb service nova] Acquiring lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:02.034125 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0d0b086d-bc10-48bb-b331-9bdce204c803 req-554f8075-c06e-43fa-9a12-d52405cb0fcb service nova] Acquired lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:02.034585 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0d0b086d-bc10-48bb-b331-9bdce204c803 req-554f8075-c06e-43fa-9a12-d52405cb0fcb service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Refreshing network info cache for port e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:04:02.122762 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:02.122762 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:02.123904 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:02.124579 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:02.124853 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] No waiting events found dispatching network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:02.125161 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received unexpected event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f for instance with vm_state resized and task_state resize_reverting.
May 27 23:04:02.125420 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:02.127470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:02.127470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:02.127470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:02.127470 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] No waiting events found dispatching network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:02.127470 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received unexpected event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 for instance with vm_state rescued and task_state None.
May 27 23:04:02.127470 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:02.127470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:02.127470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:02.127470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:02.127470 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] No waiting events found dispatching network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:02.127470 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-26a8ccf8-6843-4a78-bb84-179ba2c20c6a req-f7852d8f-e4c1-4bad-ab1b-adea8245862e service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received unexpected event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 for instance with vm_state rescued and task_state None.
May 27 23:04:02.148310 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:02.149801 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:02.228968 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:02.229170 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:02.322992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:02.322992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:02.471873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:02.539504 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-0d0b086d-bc10-48bb-b331-9bdce204c803 req-554f8075-c06e-43fa-9a12-d52405cb0fcb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:02.553997 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:04:02.555129 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:04:02.555356 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Creating image(s)
May 27 23:04:02.555900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:02.556108 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:02.556627 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:02.557293 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:02.561269 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:02.562212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:02.630920 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0d0b086d-bc10-48bb-b331-9bdce204c803 req-554f8075-c06e-43fa-9a12-d52405cb0fcb service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:04:02.652035 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:02.654703 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:02.656053 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923042.6556792, 8eb4bd8d-577c-4065-a466-d943fd51ef8e => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:02.656229 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] VM Started (Lifecycle Event)
May 27 23:04:02.658616 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:02.659284 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:02.662030 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:02.662389 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:02.732065 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lazy-loading 'migration_context' on Instance uuid 80c6eabe-0192-4030-a194-2d87bb638464 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:02.756823 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:02.757254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:02.798672 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0d0b086d-bc10-48bb-b331-9bdce204c803 req-554f8075-c06e-43fa-9a12-d52405cb0fcb service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:02.819958 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk 1073741824" returned: 0 in 0.063s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:02.820475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:02.820843 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:02.833469 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Unrescuing
May 27 23:04:02.833879 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:02.834071 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquired lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:02.834792 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:04:02.841185 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'flavor' on Instance uuid 09a47014-23a8-4dad-ab17-6df274ed8cf7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:02.911929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.091s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:02.912286 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:04:02.914799 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:02.925096 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4487e7e1-f9a8-471f-bab1-8907db12ef21 tempest-ServerRescueNegativeTestJSON-550001831 tempest-ServerRescueNegativeTestJSON-550001831-project-member] Lock "119d02f0-0974-4fa4-9d6a-ecfefe01e029" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.208s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:02.999113 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:02.999521 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Cannot resize image /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:04:03.002645 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:04:03.002645 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Ensure instance console log exists: /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:04:03.002645 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:03.002645 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:03.002645 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:03.157800 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00046099099995444703 future=<Future at 0x726e38766c90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:03.158697 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:03.159036 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Emitting event <LifecycleEvent: 1779923028.1571815, 489adb12-811c-408c-af3f-24edcfc9d4bb => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:03.160173 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] VM Stopped (Lifecycle Event)
May 27 23:04:03.161545 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:03.161689 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.071343049999996 future=<Future at 0x726e58210770 state=cancelled>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:03.162447 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.0712033989998417 future=<Future at 0x726e58210770 state=cancelled>) was cancelled while queued, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:03.162447 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:03.162447 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.19598043499991 future=<Future at 0x726e58219cd0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:03.162447 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.195907211999838 future=<Future at 0x726e58219cd0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:03.164624 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:03.235547 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Object Instance<80c6eabe-0192-4030-a194-2d87bb638464> lazy-loaded attributes: resources,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:04:03.296817 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:03.301475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0d0b086d-bc10-48bb-b331-9bdce204c803 req-554f8075-c06e-43fa-9a12-d52405cb0fcb service nova] Releasing lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:03.301663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:03.301818 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:04:03.345076 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:03.664624 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d800804c-8c3b-40fe-892a-fbad21e0955f tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 489adb12-811c-408c-af3f-24edcfc9d4bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:03.667656 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 27 23:04:03.711116 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:03.854155 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.532s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:03.868132 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Updating instance_info_cache with network_info: [{"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:03.908054 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:04:04.018214 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:04.018440 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:04.099289 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:04.234211 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating instance_info_cache with network_info: [{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:04.370200 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Releasing lock "refresh_cache-8eb4bd8d-577c-4065-a466-d943fd51ef8e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:04.370845 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'flavor' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:04.521377 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:04.737747 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:04.738262 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Instance network_info: |[{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:04:04.739800 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Start _get_guest_xml network_info=[{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:04:04.741510 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:04:04.742624 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='a7839c43-8fd9-4deb-81c9-f128963f09ec'), owner=OwnerMeta(userid='2c6d94c1e6da4237aa5dd517c31e03d7', username='tempest-AttachVolumeMultiAttachTest-781715127-project-member', projectid='0ec877dc7b2240969ac89c13673f8799', projectname='tempest-AttachVolumeMultiAttachTest-781715127'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923044.742291) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:04:04.743508 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:04:04.743827 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:04:04.744595 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:04:04.744757 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:04:04.745610 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:04:04.745934 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:04:04.746098 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:04:04.746191 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:04:04.746302 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:04:04.746395 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:04:04.746486 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:04:04.746642 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:04:04.746741 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:04:04.746846 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:04:04.746968 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:04:04.747101 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:04:04.757984 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-0',id=25,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-wa242kn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a7839c43-8fd9-4deb-81c9-f128963f09ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:04:04.757984 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:04.757984 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:04.758264 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'pci_devices' on Instance uuid a7839c43-8fd9-4deb-81c9-f128963f09ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:04.895071 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:04.895318 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:04.895522 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Attaching volume 74b600c6-b367-47cd-9bd1-b58615626e8c to /dev/vdb
May 27 23:04:04.942399 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:04.946813 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:04.954072 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:04.955459 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:04:04.974940 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:04.982024 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:05.034603 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:04:05.034892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:04:05.046165 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:04:05.048653 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fea8:ff85', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe09:383a', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe33:9245', 'fe80::fc16:3eff:fe03:d498', 'fe80::fc16:3eff:fe8b:84b8', 'fe80::dcd4:d2ff:fef1:b456', 'fe80::fc16:3eff:fe26:6a6', 'fe80::fc16:3eff:fef8:60af', 'fe80::fc16:3eff:fee6:c4ae', 'fe80::fc16:3eff:fe57:4518', 'fe80::fc16:3eff:fe81:5e14', 'fe80::e0fd:1fff:feda:75a7', 'fe80::4893:9bff:fe5d:9403'] 
May 27 23:04:05.048936 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:04:05.049094 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:04:05.049443 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:05.049742 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Updating existing volume attachment record: 8356527a-ffa1-4851-89dd-558195ea7fa1 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:04:05.131440 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5b3668f7-be0c-4aa2-97e8-de6c36f2f05e req-513d9c4a-535c-4d83-a527-71659ae099be service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:05.133107 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5b3668f7-be0c-4aa2-97e8-de6c36f2f05e req-513d9c4a-535c-4d83-a527-71659ae099be service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:05.133764 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5b3668f7-be0c-4aa2-97e8-de6c36f2f05e req-513d9c4a-535c-4d83-a527-71659ae099be service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:05.133996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5b3668f7-be0c-4aa2-97e8-de6c36f2f05e req-513d9c4a-535c-4d83-a527-71659ae099be service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:05.134511 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5b3668f7-be0c-4aa2-97e8-de6c36f2f05e req-513d9c4a-535c-4d83-a527-71659ae099be service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] No waiting events found dispatching network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:05.134633 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5b3668f7-be0c-4aa2-97e8-de6c36f2f05e req-513d9c4a-535c-4d83-a527-71659ae099be service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received unexpected event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 for instance with vm_state rescued and task_state unrescuing.
May 27 23:04:05.136684 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:05.144656 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:05.249908 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99964705299999 future=<Future at 0x726e387064e0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:05.252411 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Instance destroyed successfully.
May 27 23:04:05.252804 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'numa_topology' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:05.261427 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] End _get_guest_xml xml=<domain type="qemu">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <uuid>a7839c43-8fd9-4deb-81c9-f128963f09ec</uuid>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <name>instance-00000019</name>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <nova:name>multiattach-server-0</nova:name>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:04:04</nova:creationTime>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:user uuid="2c6d94c1e6da4237aa5dd517c31e03d7">tempest-AttachVolumeMultiAttachTest-781715127-project-member</nova:user>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:project uuid="0ec877dc7b2240969ac89c13673f8799">tempest-AttachVolumeMultiAttachTest-781715127</nova:project>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         <nova:port uuid="e837edcc-48f7-475e-ab37-e584deffe1c5">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <system>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <entry name="serial">a7839c43-8fd9-4deb-81c9-f128963f09ec</entry>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <entry name="uuid">a7839c43-8fd9-4deb-81c9-f128963f09ec</entry>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     </system>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <os>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   </os>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <features>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   </features>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   <devices>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.config"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:4e:05:0c"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <target dev="tape837edcc-48"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     </interface>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/console.log" append="off"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     </serial>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <video>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     </video>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     </rng>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:   </devices>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]: </domain>
May 27 23:04:05.261427 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:04:05.263171 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Preparing to wait for external event network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:04:05.263171 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:05.263171 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:05.263171 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:05.263723 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-0',id=25,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-wa242kn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a7839c43-8fd9-4deb-81c9-f128963f09ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:04:05.263969 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:05.264756 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:05.271215 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:04:05.271215 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:05.271215 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:05.271215 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:04:05.271215 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:05.271215 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f774876-5b3f-554b-9281-4166f66ec1f9', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:05.271806 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:05.273485 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:05.279270 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:05.284436 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:05.285518 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape837edcc-48, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:05.285518 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape837edcc-48, col_values=(('qos', UUID('60fddb14-013e-47c6-92f3-c3c6095a5a5d')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:05.285518 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape837edcc-48, col_values=(('external_ids', {'iface-id': 'e837edcc-48f7-475e-ab37-e584deffe1c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:05:0c', 'vm-uuid': 'a7839c43-8fd9-4deb-81c9-f128963f09ec'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:05.288934 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:05.300908 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:05.302866 np0000001565 nova-compute[98289]: INFO os_vif [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48')
May 27 23:04:05.537217 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.308s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:05.537511 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:04:05.606996 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:04:05.607289 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:05.607519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:05.607879 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:05.608054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:04:05.628983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:05.630064 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:05.630368 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:05.630956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:05.631477 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:04:05.631868 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:04:05.643383 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:04:05.643383 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:05.647931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:04:05.647931 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:05.655356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c] added
May 27 23:04:05.655356 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:04:05.655356 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:05.655356 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:05.655356 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:05.655356 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:05.655356 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:05.655356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:04:05.655356 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0238(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:04:05.655356 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:04:05.658711 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c] added
May 27 23:04:05.658711 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:04:05.658711 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:05.658711 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:05.658711 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:05.658711 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:05.658711 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:05.658936 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:04:05.659118 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:04:05.659258 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:04:05.755760 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Object Instance<8eb4bd8d-577c-4065-a466-d943fd51ef8e> lazy-loaded attributes: flavor,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:04:06.193624 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:06.229212 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:06.237053 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:06.304110 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:06.346118 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:06.351622 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:06.655731 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:04:06.659943 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:04:06.668586 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:04:06.668586 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:04:06.676533 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:04:06.676533 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:06.685353 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:06.691497 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.705061 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.705594 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.709534 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.709842 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:06.756486 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.50.100,3260]
May 27 23:04:06.756486 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.50.100,3260] successful.
May 27 23:04:06.756486 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:06.764420 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.40.100,3260]
May 27 23:04:06.764420 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.40.100,3260] successful.
May 27 23:04:06.764420 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:06.768633 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:06.776520 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:06.795621 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:06.795982 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:06.796285 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:06.796285 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:06.797632 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:06.797954 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:06.798355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:06.798355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:04:06.798920 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] HCTL ('19', '-', '-', 0) found on session 38 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:04:06.799120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:04:06.800479 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] HCTL ('20', '-', '-', 0) found on session 39 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:04:06.800589 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:04:06.815655 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching for a device in session 38 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:04:06.815655 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:04:06.818143 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:06.818264 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:06.819039 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:4e:05:0c, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:04:06.819039 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Using config drive
May 27 23:04:06.824025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching for a device in session 39 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:04:06.824256 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:04:07.020170 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 8eb4bd8d-577c-4065-a466-d943fd51ef8e due to new event <LifecycleEvent: 1779923047.0197992, 8eb4bd8d-577c-4065-a466-d943fd51ef8e => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:04:07.020394 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923047.0197992, 8eb4bd8d-577c-4065-a466-d943fd51ef8e => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:07.020627 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] VM Resumed (Lifecycle Event)
May 27 23:04:07.022775 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-609c07e7-2711-4e27-a8ac-47c00d5c0929 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:07.109294 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Swapping old allocation on dict_keys(['6afc4609-00ff-4946-93f6-3f759c4c1e43']) held by migration 4a7aa81e-26f8-4cea-920c-a9f1b709c270 for instance
May 27 23:04:07.196227 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:07.196227 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:07.196227 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:07.196227 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:07.196410 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] No waiting events found dispatching network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:07.196437 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received unexpected event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 for instance with vm_state active and task_state None.
May 27 23:04:07.196540 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:07.197456 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:07.197633 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:07.197693 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:07.197820 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] No waiting events found dispatching network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:07.197919 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received unexpected event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 for instance with vm_state active and task_state None.
May 27 23:04:07.198010 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:07.198156 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:07.198294 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:07.198473 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:07.198568 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] No waiting events found dispatching network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:07.198665 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-6ae549bc-363c-4741-801c-fdd849c5f465 req-7263c771-8974-42a4-b11a-b8d592d91b87 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received unexpected event network-vif-plugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 for instance with vm_state active and task_state None.
May 27 23:04:07.217512 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Overwriting current allocation {'allocations': {'6afc4609-00ff-4946-93f6-3f759c4c1e43': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 29}}, 'project_id': '9dbf5952ce9242a38d3c1881a1604223', 'user_id': '6fb24b22559e4715a196b40ce9948d74', 'consumer_generation': 1} on consumer 80c6eabe-0192-4030-a194-2d87bb638464 {{(pid=98289) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 27 23:04:07.319027 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:07.325819 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:07.398960 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:07.399156 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquired lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:07.399226 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:04:07.501504 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Creating config drive at /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.config
May 27 23:04:07.514586 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnmeqxyzx {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:07.538456 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:07.547147 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:07.576300 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnmeqxyzx" returned: 0 in 0.059s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:07.631582 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:04:07.901765 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:08.007269 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:08.007708 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:08.007985 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:08.008201 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:08.008440 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:08.013249 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Terminating instance
May 27 23:04:08.056223 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.056899 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] During sync_power_state the instance has a pending task (deleting). Skip.
May 27 23:04:08.057281 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923048.0570476, 8eb4bd8d-577c-4065-a466-d943fd51ef8e => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:08.057458 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] VM Started (Lifecycle Event)
May 27 23:04:08.091750 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.091750 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.215613 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.267175 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.268881 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.301214 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.397897 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:08.520608 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:04:08.541246 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.544831 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.567755 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:08.569998 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.583605 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating instance_info_cache with network_info: [{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:08.658435 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Found WWN 33000000043123953 for multipath device dm-10 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:04:08.658845 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:08.659053 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '33000000043123953', 'path': '/dev/dm-10', 'multipath_id': '33000000043123953'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:08.659215 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000043123953', 'path': '/dev/dm-10', 'multipath_id': '33000000043123953'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:04:08.662906 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'flavor' on Instance uuid 09a47014-23a8-4dad-ab17-6df274ed8cf7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:08.695195 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.701604 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:08.741425 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:04:08.862163 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999715746999982 future=<Future at 0x726e38720f50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:08.863356 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Instance destroyed successfully.
May 27 23:04:08.865048 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'resources' on Instance uuid 8eb4bd8d-577c-4065-a466-d943fd51ef8e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:09.019846 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923049.0194802, a7839c43-8fd9-4deb-81c9-f128963f09ec => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:09.020261 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] VM Started (Lifecycle Event)
May 27 23:04:09.075490 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:09.085607 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Releasing lock "refresh_cache-80c6eabe-0192-4030-a194-2d87bb638464" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:09.086012 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:09.102247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:04:09.125430 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:09.162864 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:04:09.163094 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:04:09.168186 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Attempting to attach volume 74b600c6-b367-47cd-9bd1-b58615626e8c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:04:09.169968 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:04:09.169968 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:04:09.169968 np0000001565 nova-compute[98289]:   <alias name="ua-74b600c6-b367-47cd-9bd1-b58615626e8c"/>
May 27 23:04:09.169968 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-10"/>
May 27 23:04:09.169968 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:04:09.169968 np0000001565 nova-compute[98289]:   <serial>74b600c6-b367-47cd-9bd1-b58615626e8c</serial>
May 27 23:04:09.169968 np0000001565 nova-compute[98289]: </disk>
May 27 23:04:09.169968 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:04:09.172753 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:04:09.173314 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fea8:ff85', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe09:383a', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe33:9245', 'fe80::fc16:3eff:fe03:d498', 'fe80::fc16:3eff:fe8b:84b8', 'fe80::dcd4:d2ff:fef1:b456', 'fe80::fc16:3eff:fe26:6a6', 'fe80::fc16:3eff:fef8:60af', 'fe80::fc16:3eff:fee6:c4ae', 'fe80::fc16:3eff:fe57:4518', 'fe80::fc16:3eff:fe81:5e14', 'fe80::e0fd:1fff:feda:75a7', 'fe80::4893:9bff:fe5d:9403', 'fe80::fc16:3eff:fe4e:50c'] 
May 27 23:04:09.173461 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:04:09.173559 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:04:09.173832 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:09.270391 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:09.270673 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:09.270883 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:09.271062 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:09.271189 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Processing event network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:04:09.271385 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:09.271722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:09.271722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:09.271788 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:09.271920 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] No waiting events found dispatching network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:09.272166 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received unexpected event network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 for instance with vm_state building and task_state spawning.
May 27 23:04:09.272166 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:09.272315 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:09.272542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:09.272866 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:09.272866 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] No waiting events found dispatching network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:09.272982 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:09.273121 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:09.274485 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:04:09.274635 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Acquiring lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:09.274795 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:09.274848 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:09.274964 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] No waiting events found dispatching network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:09.275040 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-76a70f2b-a64a-4b60-bf42-cd2ec4016bb0 req-80a48337-fdc9-4576-b546-907099b97894 service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-unplugged-7343ba63-a626-4bbe-b9bd-b4668c6593a7 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:09.283094 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:04:09.285184 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Instance spawned successfully.
May 27 23:04:09.285497 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:04:09.367498 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-65006145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-65006145',id=24,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:01Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-bj8x2age',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:04:07Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=8eb4bd8d-577c-4065-a466-d943fd51ef8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:09.367727 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "address": "fa:16:3e:aa:70:56", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7343ba63-a6", "ovs_interfaceid": "7343ba63-a626-4bbe-b9bd-b4668c6593a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:09.368453 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:70:56,bridge_name='br-int',has_traffic_filtering=True,id=7343ba63-a626-4bbe-b9bd-b4668c6593a7,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7343ba63-a6') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:09.368680 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:70:56,bridge_name='br-int',has_traffic_filtering=True,id=7343ba63-a626-4bbe-b9bd-b4668c6593a7,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7343ba63-a6') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:09.375006 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:09.375424 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7343ba63-a6, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:09.376996 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:09.378558 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:09.382503 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:09.382503 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37ab3cb2-5ccc-4204-ac4f-776ee3d1c8a2) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:09.383261 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:09.385199 np0000001565 nova-compute[98289]: INFO os_vif [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:70:56,bridge_name='br-int',has_traffic_filtering=True,id=7343ba63-a626-4bbe-b9bd-b4668c6593a7,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7343ba63-a6')
May 27 23:04:09.387807 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:04:09.387807 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:09.387807 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:09.387807 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:09.388072 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f68fa49-46d6-4139-a993-b907a1188ed0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:04:09.388748 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:09.428787 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0 (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:09.429409 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '39')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:04:09.429409 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', '35')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:09.430917 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0', '34')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:09.433082 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e60583ba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0'): ({'sdf'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:04:09.433318 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:04:09.433635 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flush multipath device 3300000008e8dca8f {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:04:09.480667 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:09.522913 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:09.526137 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:09.528281 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:09.571846 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:04:09.572042 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:04:09.573684 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:04:09.586479 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:04:09.586788 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:04:09.602754 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:09.648868 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0, portal: 192.168.40.100,3260]
May 27 23:04:09.648868 np0000001565 nova-compute[98289]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0, portal: 192.168.40.100,3260] successful.
May 27 23:04:09.648868 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:09.688791 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:09.702137 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:09.746326 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0, portal: 192.168.50.100,3260]
May 27 23:04:09.746326 np0000001565 nova-compute[98289]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-0f68fa49-46d6-4139-a993-b907a1188ed0, portal: 192.168.50.100,3260] successful.
May 27 23:04:09.746326 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:09.774358 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:09.774648 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:09.774796 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] <== disconnect_volume: return (387ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:09.774974 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:04:09.775288 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Deleting instance files /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e_del
May 27 23:04:09.776123 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Deletion of /opt/stack/data/nova/instances/8eb4bd8d-577c-4065-a466-d943fd51ef8e_del complete
May 27 23:04:09.794545 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:09.794683 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:09.795002 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:09.796324 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:09.798264 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:09.798989 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:10.029124 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:04:10.029653 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923050.0292766, a7839c43-8fd9-4deb-81c9-f128963f09ec => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:10.029856 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] VM Paused (Lifecycle Event)
May 27 23:04:10.282445 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Took 1.76 seconds to destroy the instance on the hypervisor.
May 27 23:04:10.283118 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:04:10.283595 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:04:10.283689 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:04:10.284055 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:10.293805 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Starting finish_revert_migration {{(pid=98289) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 27 23:04:10.304774 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Took 7.75 seconds to spawn the instance on the hypervisor.
May 27 23:04:10.305129 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:10.317366 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Start _get_guest_xml network_info=[{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0e2a5f27-0295-4564-92ed-26a87f44344e', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '80c6eabe-0192-4030-a194-2d87bb638464', 'attached_at': '2026-05-27T23:04:09.000000', 'detached_at': '', 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'serial': '065ce712-bac2-49ae-b684-5600689bfd55'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:04:10.327354 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:04:10.328366 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-373770128', uuid='80c6eabe-0192-4030-a194-2d87bb638464'), owner=OwnerMeta(userid='6fb24b22559e4715a196b40ce9948d74', username='tempest-ServerActionsTestOtherB-1638868194-project-member', projectid='9dbf5952ce9242a38d3c1881a1604223', projectname='tempest-ServerActionsTestOtherB-1638868194'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923050.327932) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:04:10.329317 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:04:10.329972 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:04:10.330899 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:04:10.332400 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:04:10.332619 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:04:10.332890 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:04:10.333010 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:04:10.333079 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:04:10.333198 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:04:10.333276 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:04:10.333419 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:04:10.333568 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:04:10.333662 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:04:10.333760 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:04:10.333847 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:04:10.333949 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:04:10.334092 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80c6eabe-0192-4030-a194-2d87bb638464 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:10.360051 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:10.533186 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:10.535895 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923050.5356815, a7839c43-8fd9-4deb-81c9-f128963f09ec => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:10.537469 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] VM Resumed (Lifecycle Event)
May 27 23:04:10.637749 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-da806edd-f18a-49d1-912c-c0d23051d104 req-b7b0e5d7-ca9d-410a-b24f-e0687762347e service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Received event network-vif-deleted-7343ba63-a626-4bbe-b9bd-b4668c6593a7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:10.637948 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-da806edd-f18a-49d1-912c-c0d23051d104 req-b7b0e5d7-ca9d-410a-b24f-e0687762347e service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Neutron deleted interface 7343ba63-a626-4bbe-b9bd-b4668c6593a7; detaching it from the instance and deleting it from the info cache
May 27 23:04:10.639238 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-da806edd-f18a-49d1-912c-c0d23051d104 req-b7b0e5d7-ca9d-410a-b24f-e0687762347e service nova] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Detach interface failed, port_id=7343ba63-a626-4bbe-b9bd-b4668c6593a7, reason: Instance 8eb4bd8d-577c-4065-a466-d943fd51ef8e could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:04:10.712977 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:10.821675 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Took 13.51 seconds to build instance.
May 27 23:04:10.846973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:10.867294 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:10.867584 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:10.867773 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:10.868769 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No VIF found with MAC fa:16:3e:33:92:45, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:04:10.944900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:10.945280 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:10.945526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:10.945980 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:10.946283 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:04:10.946683 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:10.946781 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:10.947070 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:10.947263 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:04:10.961418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:10.961904 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:10.963180 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:10.963180 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:10.963447 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:04:10.963754 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:04:10.977256 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:04:10.977256 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:10.986011 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:04:10.986011 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:10.993823 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55] added
May 27 23:04:10.993823 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:04:10.993823 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:10.993823 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:10.993823 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:10.993823 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:10.993823 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:10.994103 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:04:10.994350 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:04:10.994569 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:04:11.000830 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55] added
May 27 23:04:11.000830 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:04:11.000830 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:11.000830 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:11.000830 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:11.000830 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:11.000830 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:11.001103 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:04:11.001247 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0382(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:04:11.001444 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:04:11.039584 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:11.041629 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:11.093985 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:11.323353 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.023s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:11.596200 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Took 1.31 seconds to deallocate network for instance.
May 27 23:04:11.995010 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:04:12.003802 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:04:12.011461 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:04:12.011461 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:04:12.018785 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:04:12.018785 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:12.026503 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:12.035214 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.049435 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.050111 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.056603 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.057025 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:12.102221 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260]
May 27 23:04:12.102221 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260] successful.
May 27 23:04:12.102221 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:12.115100 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260]
May 27 23:04:12.115100 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260] successful.
May 27 23:04:12.115100 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:12.115262 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:12.127661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:12.139738 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:12.140516 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:12.140516 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:04:12.141759 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] HCTL ('11', '-', '-', 0) found on session 40 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:04:12.141865 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:12.149700 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:12.150085 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:12.150085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:12.152012 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:04:12.152012 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] HCTL ('12', '-', '-', 0) found on session 41 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:04:12.152012 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:04:12.165086 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Took 0.57 seconds to detach 1 volumes for instance.
May 27 23:04:12.168722 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Deleting volume: 0f68fa49-46d6-4139-a993-b907a1188ed0 {{(pid=98289) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 23:04:12.178183 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching for a device in session 40 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:04:12.178395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:04:12.183688 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Searching for a device in session 41 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:04:12.183816 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:04:12.358696 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004261589999714488 future=<Future at 0x726e58219cd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:12.358696 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:12.358871 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.8077280410000185 future=<Future at 0x726e38764410 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:12.358871 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.8076198660000955 future=<Future at 0x726e38764410 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:12.362383 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Emitting event <LifecycleEvent: 1779923037.3579211, 119d02f0-0974-4fa4-9d6a-ecfefe01e029 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:12.362383 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] VM Stopped (Lifecycle Event)
May 27 23:04:12.429378 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34ba1a2a-0871-42db-8e72-6ea403df80de tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.533s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:12.644977 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-70172eb8-5867-4467-ac97-9250c8bd6323 req-9b384c56-e0bd-446d-882a-107c238a38be service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Received event network-changed-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:12.645133 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-70172eb8-5867-4467-ac97-9250c8bd6323 req-9b384c56-e0bd-446d-882a-107c238a38be service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Refreshing instance network info cache due to event network-changed-fa19979e-8452-466d-983f-af63f239ced4. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:04:12.645349 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-70172eb8-5867-4467-ac97-9250c8bd6323 req-9b384c56-e0bd-446d-882a-107c238a38be service nova] Acquiring lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:12.645523 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-70172eb8-5867-4467-ac97-9250c8bd6323 req-9b384c56-e0bd-446d-882a-107c238a38be service nova] Acquired lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:12.645687 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-70172eb8-5867-4467-ac97-9250c8bd6323 req-9b384c56-e0bd-446d-882a-107c238a38be service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Refreshing network info cache for port fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:04:12.733014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:12.733813 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:12.866099 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 119d02f0-0974-4fa4-9d6a-ecfefe01e029] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:12.963515 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:04:13.150643 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-70172eb8-5867-4467-ac97-9250c8bd6323 req-9b384c56-e0bd-446d-882a-107c238a38be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:13.302753 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:13.522228 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-70172eb8-5867-4467-ac97-9250c8bd6323 req-9b384c56-e0bd-446d-882a-107c238a38be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:13.538752 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:13.538953 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:13.680192 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-70172eb8-5867-4467-ac97-9250c8bd6323 req-9b384c56-e0bd-446d-882a-107c238a38be service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Updated VIF entry in instance network info cache for port fa19979e-8452-466d-983f-af63f239ced4. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:04:13.682831 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-70172eb8-5867-4467-ac97-9250c8bd6323 req-9b384c56-e0bd-446d-882a-107c238a38be service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Updating instance_info_cache with network_info: [{"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:13.711683 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:13.711860 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:13.979939 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Found WWN 330000000493f2b88 for multipath device dm-4 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:04:13.980455 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:13.980589 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000493f2b88', 'path': '/dev/dm-4', 'multipath_id': '330000000493f2b88'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:13.980700 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000493f2b88', 'path': '/dev/dm-4', 'multipath_id': '330000000493f2b88'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:04:14.041742 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:14.118505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:14.118739 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:14.173437 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Rebuilding instance
May 27 23:04:14.182932 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-70172eb8-5867-4467-ac97-9250c8bd6323 req-9b384c56-e0bd-446d-882a-107c238a38be service nova] Releasing lock "refresh_cache-6ab04c1a-7858-471e-95fd-5b04d1da3061" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:14.215481 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:04:14.316681 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:14.383422 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:14.487049 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-373770128',display_name='tempest-ServerActionsTestOtherB-server-373770128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestotherb-server-373770128',id=16,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkuCpnXkvttUUkvybNqerRfpglzcntgI2LbNRFPS1WvoMpreQBqFxBf2ldcA5vcM/zSM/QMd+MwRw2lJY1injdu+2h30nJE+SFIeu7eI9MVi5k22eYdTlR/lcnOcp4shQ==',key_name='tempest-keypair-47837674',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:55Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dbf5952ce9242a38d3c1881a1604223',ramdisk_id='',reservation_id='r-qn417ctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1638868194',owner_user_name='tempest-ServerActionsTestOtherB-1638868194-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb24b22559e4715a196b40ce9948d74',uuid=80c6eabe-0192-4030-a194-2d87bb638464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:04:14.487293 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converting VIF {"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:14.487801 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:14.489132 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] End _get_guest_xml xml=<domain type="qemu">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <uuid>80c6eabe-0192-4030-a194-2d87bb638464</uuid>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <name>instance-00000010</name>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerActionsTestOtherB-server-373770128</nova:name>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:04:10</nova:creationTime>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:user uuid="6fb24b22559e4715a196b40ce9948d74">tempest-ServerActionsTestOtherB-1638868194-project-member</nova:user>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:project uuid="9dbf5952ce9242a38d3c1881a1604223">tempest-ServerActionsTestOtherB-1638868194</nova:project>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         <nova:port uuid="61892495-669a-42b8-9d49-04d6990d3b8f">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <system>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <entry name="serial">80c6eabe-0192-4030-a194-2d87bb638464</entry>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <entry name="uuid">80c6eabe-0192-4030-a194-2d87bb638464</entry>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     </system>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <os>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   </os>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <features>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   </features>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   <devices>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/disk.config"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <alias name="ua-065ce712-bac2-49ae-b684-5600689bfd55"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-4"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <serial>065ce712-bac2-49ae-b684-5600689bfd55</serial>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:c3:7f:1b"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <target dev="tap61892495-66"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     </interface>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464/console.log" append="off"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     </serial>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <video>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     </video>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     </rng>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:   </devices>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]: </domain>
May 27 23:04:14.489132 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:04:14.493150 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Preparing to wait for external event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:04:14.493150 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:14.493150 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:14.493150 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:14.493150 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-373770128',display_name='tempest-ServerActionsTestOtherB-server-373770128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestotherb-server-373770128',id=16,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkuCpnXkvttUUkvybNqerRfpglzcntgI2LbNRFPS1WvoMpreQBqFxBf2ldcA5vcM/zSM/QMd+MwRw2lJY1injdu+2h30nJE+SFIeu7eI9MVi5k22eYdTlR/lcnOcp4shQ==',key_name='tempest-keypair-47837674',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:55Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9dbf5952ce9242a38d3c1881a1604223',ramdisk_id='',reservation_id='r-qn417ctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1638868194',owner_user_name='tempest-ServerActionsTestOtherB-1638868194-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb24b22559e4715a196b40ce9948d74',uuid=80c6eabe-0192-4030-a194-2d87bb638464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:04:14.493150 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converting VIF {"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:14.493150 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:14.493150 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:04:14.493150 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:14.493150 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:14.493150 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:04:14.493616 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:14.493765 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0c4fd31-295a-5627-9c1c-b82a07e8038a', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:14.496801 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:14.496801 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:14.496801 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:14.497909 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:14.500005 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61892495-66, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:14.500005 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61892495-66, col_values=(('qos', UUID('77c3df26-4df2-48ea-bf34-61715f3bc06f')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:14.500005 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61892495-66, col_values=(('external_ids', {'iface-id': '61892495-669a-42b8-9d49-04d6990d3b8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:7f:1b', 'vm-uuid': '80c6eabe-0192-4030-a194-2d87bb638464'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:14.500200 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:14.506555 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:14.506722 np0000001565 nova-compute[98289]: INFO os_vif [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66')
May 27 23:04:14.548413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.815s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:14.608515 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Deleted allocations for instance 8eb4bd8d-577c-4065-a466-d943fd51ef8e
May 27 23:04:14.624193 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:04:14.716431 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2e39ae2f-8981-48f2-86f1-43cdaf7a70d1 req-754965cc-2dd3-4d6a-8dcd-b21fbb9e8270 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-changed-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:14.716431 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2e39ae2f-8981-48f2-86f1-43cdaf7a70d1 req-754965cc-2dd3-4d6a-8dcd-b21fbb9e8270 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Refreshing instance network info cache due to event network-changed-e837edcc-48f7-475e-ab37-e584deffe1c5. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:04:14.716431 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2e39ae2f-8981-48f2-86f1-43cdaf7a70d1 req-754965cc-2dd3-4d6a-8dcd-b21fbb9e8270 service nova] Acquiring lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:14.716431 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2e39ae2f-8981-48f2-86f1-43cdaf7a70d1 req-754965cc-2dd3-4d6a-8dcd-b21fbb9e8270 service nova] Acquired lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:14.716431 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2e39ae2f-8981-48f2-86f1-43cdaf7a70d1 req-754965cc-2dd3-4d6a-8dcd-b21fbb9e8270 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Refreshing network info cache for port e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:04:14.772376 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:14.772531 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:14.775277 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:04:14.775621 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Claim successful on node np0000001565
May 27 23:04:14.934636 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:14.964880 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:14.971614 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:14.974776 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:14.975240 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:14.975526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:14.975681 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:14.975897 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:14.983225 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Terminating instance
May 27 23:04:15.058998 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.168930 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0018801019998591073 future=<Future at 0x726e38764410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:15.168930 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Emitting event <LifecycleEvent: 1779923040.1664016, 80c6eabe-0192-4030-a194-2d87bb638464 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:15.169284 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] VM Stopped (Lifecycle Event)
May 27 23:04:15.170838 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:15.171023 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.077791872000034 future=<Future at 0x726e387064e0 state=cancelled>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:15.171148 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.077666596000199 future=<Future at 0x726e387064e0 state=cancelled>) was cancelled while queued, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:15.171224 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:15.171289 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.690575587000012 future=<Future at 0x726e38720f50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:15.171820 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.690360860000055 future=<Future at 0x726e38720f50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:15.189254 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-20974240-9c92-4193-958e-41d6263b45bd req-ddd049a9-ceac-4421-98eb-d602954ce83f service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:15.189254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-20974240-9c92-4193-958e-41d6263b45bd req-ddd049a9-ceac-4421-98eb-d602954ce83f service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:15.189254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-20974240-9c92-4193-958e-41d6263b45bd req-ddd049a9-ceac-4421-98eb-d602954ce83f service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:15.189254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-20974240-9c92-4193-958e-41d6263b45bd req-ddd049a9-ceac-4421-98eb-d602954ce83f service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:15.189758 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-20974240-9c92-4193-958e-41d6263b45bd req-ddd049a9-ceac-4421-98eb-d602954ce83f service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Processing event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:04:15.199726 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:15.227064 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2e39ae2f-8981-48f2-86f1-43cdaf7a70d1 req-754965cc-2dd3-4d6a-8dcd-b21fbb9e8270 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:15.306347 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.311007 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.315663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.340538 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.347180 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.350673 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.383103 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.487959 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:04:15.523910 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.526314 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.570965 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.577870 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.614926 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2e39ae2f-8981-48f2-86f1-43cdaf7a70d1 req-754965cc-2dd3-4d6a-8dcd-b21fbb9e8270 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:15.620812 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0dd35810-0fad-4070-bd99-703752deca46 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "8eb4bd8d-577c-4065-a466-d943fd51ef8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.613s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:15.652777 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.678253 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:15.680208 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.709570 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.718205 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999148865000052 future=<Future at 0x726e387537d0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:15.728414 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Instance destroyed successfully.
May 27 23:04:15.759584 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.762064 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.763161 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.823769 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Detaching volume 74b600c6-b367-47cd-9bd1-b58615626e8c
May 27 23:04:15.862438 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.888209 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.900295 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Attempting to driver detach volume 74b600c6-b367-47cd-9bd1-b58615626e8c from mountpoint /dev/vdb
May 27 23:04:15.912423 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Found disk vdb by alias ua-74b600c6-b367-47cd-9bd1-b58615626e8c {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:04:15.912566 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Attempting to detach device vdb from instance 09a47014-23a8-4dad-ab17-6df274ed8cf7 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:04:15.912849 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:04:15.912849 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:04:15.912849 np0000001565 nova-compute[98289]:   <alias name="ua-74b600c6-b367-47cd-9bd1-b58615626e8c"/>
May 27 23:04:15.912849 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-10"/>
May 27 23:04:15.912849 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:04:15.912849 np0000001565 nova-compute[98289]:   <serial>74b600c6-b367-47cd-9bd1-b58615626e8c</serial>
May 27 23:04:15.912849 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:04:15.912849 np0000001565 nova-compute[98289]: </disk>
May 27 23:04:15.912849 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:04:15.927256 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully detached device vdb from instance 09a47014-23a8-4dad-ab17-6df274ed8cf7 from the persistent domain config.
May 27 23:04:15.927970 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:04:15.928408 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:15.929489 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:15.930154 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:15.930425 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:04:15.934608 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:04:15.938290 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:04:15.939210 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923055.9388664, 80c6eabe-0192-4030-a194-2d87bb638464 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:15.941445 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] VM Started (Lifecycle Event)
May 27 23:04:15.967696 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:15.981191 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-010eb0c5-0044-4f9a-80fe-e71176b0bd65 req-86f57f4c-17c9-4b9a-bd6c-7c98cff1b119 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-433e6524-50fc-4b98-84b7-9921a6b8f731 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:15.981511 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-010eb0c5-0044-4f9a-80fe-e71176b0bd65 req-86f57f4c-17c9-4b9a-bd6c-7c98cff1b119 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:15.981757 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-010eb0c5-0044-4f9a-80fe-e71176b0bd65 req-86f57f4c-17c9-4b9a-bd6c-7c98cff1b119 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:15.981963 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-010eb0c5-0044-4f9a-80fe-e71176b0bd65 req-86f57f4c-17c9-4b9a-bd6c-7c98cff1b119 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:15.984427 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-010eb0c5-0044-4f9a-80fe-e71176b0bd65 req-86f57f4c-17c9-4b9a-bd6c-7c98cff1b119 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-433e6524-50fc-4b98-84b7-9921a6b8f731 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:15.986114 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2e39ae2f-8981-48f2-86f1-43cdaf7a70d1 req-754965cc-2dd3-4d6a-8dcd-b21fbb9e8270 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updated VIF entry in instance network info cache for port e837edcc-48f7-475e-ab37-e584deffe1c5. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:04:15.987989 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-010eb0c5-0044-4f9a-80fe-e71176b0bd65 req-86f57f4c-17c9-4b9a-bd6c-7c98cff1b119 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-433e6524-50fc-4b98-84b7-9921a6b8f731 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:15.987989 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance running successfully.
May 27 23:04:15.988195 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2e39ae2f-8981-48f2-86f1-43cdaf7a70d1 req-754965cc-2dd3-4d6a-8dcd-b21fbb9e8270 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating instance_info_cache with network_info: [{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:15.989009 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] finish_revert_migration finished successfully. {{(pid=98289) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:16.008682 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:16.009784 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '41')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:04:16.009784 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '39')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:16.012511 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '38')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:16.013932 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e605dbec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'): ({'sdn'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:04:16.015596 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Removing multipathed devices sdo, sdn {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:04:16.015596 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flush multipath device 33000000043123953 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:04:16.055452 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:16.065257 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.104544 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.132551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:16.180929 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.196362 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:04:16.196660 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:04:16.198570 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:04:16.214600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:04:16.214600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:04:16.233387 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:16.245229 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Instance destroyed successfully.
May 27 23:04:16.245831 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lazy-loading 'resources' on Instance uuid 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:16.316201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.40.100,3260]
May 27 23:04:16.316201 np0000001565 nova-compute[98289]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.40.100,3260] successful.
May 27 23:04:16.316201 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:16.332017 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.353609 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:16.368380 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:16.397404 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.411094 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.50.100,3260]
May 27 23:04:16.411094 np0000001565 nova-compute[98289]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.50.100,3260] successful.
May 27 23:04:16.411094 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:16.443119 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:16.443362 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.514s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:16.443499 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== disconnect_volume: return (514ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:16.443549 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:04:16.490791 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:16.493163 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:16.496014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2e39ae2f-8981-48f2-86f1-43cdaf7a70d1 req-754965cc-2dd3-4d6a-8dcd-b21fbb9e8270 service nova] Releasing lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:16.759260 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:31Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:16.759556 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "address": "fa:16:3e:03:d4:98", "network": {"id": "9b8fa309-a1c3-4439-b6a8-c2689abd3092", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-770790164-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7259562-65", "ovs_interfaceid": "d7259562-6553-4ef1-8d96-bc9e7b64bf75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:16.760241 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:d4:98,bridge_name='br-int',has_traffic_filtering=True,id=d7259562-6553-4ef1-8d96-bc9e7b64bf75,network=Network(9b8fa309-a1c3-4439-b6a8-c2689abd3092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7259562-65') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:16.760561 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:d4:98,bridge_name='br-int',has_traffic_filtering=True,id=d7259562-6553-4ef1-8d96-bc9e7b64bf75,network=Network(9b8fa309-a1c3-4439-b6a8-c2689abd3092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7259562-65') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:16.767043 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.768145 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7259562-65, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:16.768392 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.769364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:16.800542 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:16.800542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:16.800542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:16.800542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:16.800542 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] No waiting events found dispatching network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:16.801189 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received unexpected event network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 for instance with vm_state active and task_state rebuilding.
May 27 23:04:16.805240 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.805529 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:16.807049 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:16.807049 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:16.807049 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:16.807049 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] No waiting events found dispatching network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:16.807049 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received unexpected event network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 for instance with vm_state active and task_state rebuilding.
May 27 23:04:16.812344 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.812840 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:16.814069 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=481d913c-0d34-4cb0-9d01-41c40bae052d) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:16.814069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:16.814069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:16.814069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:16.814069 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:16.814069 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c03bf597-744d-4fd1-9950-94a314acb391 req-ceb88bf8-fd61-4b53-8fb9-b2a381d5f554 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:16.815533 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:16.816077 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:16.816358 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:16.847535 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.850496 np0000001565 nova-compute[98289]: INFO os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:d4:98,bridge_name='br-int',has_traffic_filtering=True,id=d7259562-6553-4ef1-8d96-bc9e7b64bf75,network=Network(9b8fa309-a1c3-4439-b6a8-c2689abd3092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7259562-65')
May 27 23:04:16.850496 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:31Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:16.850496 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "address": "fa:16:3e:8b:84:b8", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b25fb47-07", "ovs_interfaceid": "8b25fb47-0737-4f1d-a87b-c6a5eb87176b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:16.852081 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b25fb47-0737-4f1d-a87b-c6a5eb87176b,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b25fb47-07') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:16.852081 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b25fb47-0737-4f1d-a87b-c6a5eb87176b,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b25fb47-07') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:16.852533 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.852779 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b25fb47-07, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:16.854327 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.854761 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:16.881192 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.882226 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.882432 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ea7492e-de0c-40cd-8645-31589145c925) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:16.883281 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.883469 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:16.910502 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.911451 np0000001565 nova-compute[98289]: INFO os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=8b25fb47-0737-4f1d-a87b-c6a5eb87176b,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b25fb47-07')
May 27 23:04:16.912051 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:31Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:16.912201 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "433e6524-50fc-4b98-84b7-9921a6b8f731", "address": "fa:16:3e:26:06:a6", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap433e6524-50", "ovs_interfaceid": "433e6524-50fc-4b98-84b7-9921a6b8f731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:16.912687 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:06:a6,bridge_name='br-int',has_traffic_filtering=True,id=433e6524-50fc-4b98-84b7-9921a6b8f731,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap433e6524-50') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:16.912878 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:06:a6,bridge_name='br-int',has_traffic_filtering=True,id=433e6524-50fc-4b98-84b7-9921a6b8f731,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap433e6524-50') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:16.914048 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.914048 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap433e6524-50, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:16.916253 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:16.943871 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.946459 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.946901 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39bf7270-b16e-444a-8748-e8bb96607de3) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:16.947597 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.948410 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:16.970378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.973068 np0000001565 nova-compute[98289]: INFO os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:06:a6,bridge_name='br-int',has_traffic_filtering=True,id=433e6524-50fc-4b98-84b7-9921a6b8f731,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap433e6524-50')
May 27 23:04:16.974205 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:31Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:16.974498 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "address": "fa:16:3e:f8:60:af", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f186912-a4", "ovs_interfaceid": "8f186912-a40c-40b0-9cc1-808a4f92aa20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:16.975250 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:af,bridge_name='br-int',has_traffic_filtering=True,id=8f186912-a40c-40b0-9cc1-808a4f92aa20,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f186912-a4') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:16.975546 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:af,bridge_name='br-int',has_traffic_filtering=True,id=8f186912-a40c-40b0-9cc1-808a4f92aa20,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f186912-a4') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:16.976565 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.977497 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f186912-a4, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:16.978777 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:16.978777 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:16.995600 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 27 23:04:16.996196 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923056.9957125, 80c6eabe-0192-4030-a194-2d87bb638464 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:16.996348 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] VM Paused (Lifecycle Event)
May 27 23:04:17.000830 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.002462 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.002462 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc269afc-ef1d-4b30-be2b-e64edb23a4be) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:17.006282 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.008587 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:17.027435 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.029160 np0000001565 nova-compute[98289]: INFO os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:af,bridge_name='br-int',has_traffic_filtering=True,id=8f186912-a40c-40b0-9cc1-808a4f92aa20,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f186912-a4')
May 27 23:04:17.029962 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:31Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:17.030288 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "address": "fa:16:3e:e6:c4:ae", "network": {"id": "6bf86d62-b3c7-44ae-bc39-4f757d816f0a", "bridge": "br-int", "label": "tempest-device-tagging-net1-531464229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a9c0da-75", "ovs_interfaceid": "22a9c0da-759e-45d4-8c4a-0f0afe6d472e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:17.031030 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=22a9c0da-759e-45d4-8c4a-0f0afe6d472e,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a9c0da-75') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:17.031550 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=22a9c0da-759e-45d4-8c4a-0f0afe6d472e,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a9c0da-75') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:17.032585 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.032764 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22a9c0da-75, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:17.034281 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.034965 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:17.048438 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.049277 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.049504 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=664da3df-fd08-4c2b-802f-dfbf3fb42111) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:17.050922 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.052043 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:17.063267 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.065307 np0000001565 nova-compute[98289]: INFO os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c4:ae,bridge_name='br-int',has_traffic_filtering=True,id=22a9c0da-759e-45d4-8c4a-0f0afe6d472e,network=Network(6bf86d62-b3c7-44ae-bc39-4f757d816f0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a9c0da-75')
May 27 23:04:17.066087 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:31Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:17.066087 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "address": "fa:16:3e:57:45:18", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35b0820-2c", "ovs_interfaceid": "b35b0820-2c57-46ab-8bf6-81d591b179e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:17.066538 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:18,bridge_name='br-int',has_traffic_filtering=True,id=b35b0820-2c57-46ab-8bf6-81d591b179e2,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35b0820-2c') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:17.066723 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:18,bridge_name='br-int',has_traffic_filtering=True,id=b35b0820-2c57-46ab-8bf6-81d591b179e2,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35b0820-2c') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:17.068229 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.068629 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb35b0820-2c, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:17.070047 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a44208ab-6abf-4327-935f-fdace1ae7541 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating instance to original state: 'active'
May 27 23:04:17.072806 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.074065 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:17.080096 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.087699 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.087960 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfff5c5d-1172-4c29-a0cb-8ad50077cdd5) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:17.089870 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.090418 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:17.100124 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.105425 np0000001565 nova-compute[98289]: INFO os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:45:18,bridge_name='br-int',has_traffic_filtering=True,id=b35b0820-2c57-46ab-8bf6-81d591b179e2,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35b0820-2c')
May 27 23:04:17.107108 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620832723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-1620832723',id=19,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3rBxAAbFFBd4/Zo/aJ1T+xl4il9g78/1Gu9hkaO1T66CrAiSjXjcE59gBsX5QkT5YTL/8R0aW5obihMvO+09eRIRNhr8ZJEKTyIgCxcv7jgq38kQnDP45CjiJPeeNlMA==',key_name='tempest-keypair-1042523367',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:31Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8214904c18049c086910b7b20b109b2',ramdisk_id='',reservation_id='r-6h1rkrb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-439981373',owner_user_name='tempest-TaggedBootDevicesTest-439981373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e339645d1b454fa4b8bb89a20c0bf898',uuid=0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:17.108503 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converting VIF {"id": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "address": "fa:16:3e:81:5e:14", "network": {"id": "2d6750d7-84c5-4aac-8283-6a9f8d9db577", "bridge": "br-int", "label": "tempest-device-tagging-net2-1466913789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8214904c18049c086910b7b20b109b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22db9eb7-e5", "ovs_interfaceid": "22db9eb7-e550-46da-9fd0-082bc64ad74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:17.108503 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:5e:14,bridge_name='br-int',has_traffic_filtering=True,id=22db9eb7-e550-46da-9fd0-082bc64ad74f,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22db9eb7-e5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:17.108503 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5e:14,bridge_name='br-int',has_traffic_filtering=True,id=22db9eb7-e550-46da-9fd0-082bc64ad74f,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22db9eb7-e5') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:17.109665 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.109947 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22db9eb7-e5, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:17.111056 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.112117 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:17.117229 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.118320 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.118489 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09cd5d16-4a26-448c-a17c-e9075e39e5ff) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:17.118937 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.120096 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:17.125275 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.127011 np0000001565 nova-compute[98289]: INFO os_vif [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5e:14,bridge_name='br-int',has_traffic_filtering=True,id=22db9eb7-e550-46da-9fd0-082bc64ad74f,network=Network(2d6750d7-84c5-4aac-8283-6a9f8d9db577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22db9eb7-e5')
May 27 23:04:17.131031 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:04:17.131426 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc4f800f-0613-4549-b71f-5ee16605c497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:17.131606 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:17.131984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:17.132353 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc4f800f-0613-4549-b71f-5ee16605c497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:04:17.132551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.165049 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.165576 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:17.165923 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '41')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:04:17.165923 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '25')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:17.166715 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497', '24')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:17.167576 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e6012b880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497'): ({'sdh'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:04:17.170360 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Removing multipathed devices sdi, sdh {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:04:17.170360 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Flush multipath device 3300000006d1f1c02 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:04:17.188797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:17.188797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:17.188797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:17.188797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:17.188797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:17.192077 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Terminating instance
May 27 23:04:17.224479 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:17.267787 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:17.308822 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:04:17.308973 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:04:17.310424 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:04:17.318924 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:17.325103 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:04:17.325103 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:04:17.338849 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.340857 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:17.341039 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:17.341178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:17.341281 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:17.341704 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] No waiting events found dispatching network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:17.341704 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received unexpected event network-vif-plugged-61892495-669a-42b8-9d49-04d6990d3b8f for instance with vm_state active and task_state None.
May 27 23:04:17.341704 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:17.343200 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:17.343430 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:17.343579 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:17.343686 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:17.343800 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:17.343899 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:17.345234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:17.345386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:17.345492 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:17.345589 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:17.345720 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-8b25fb47-0737-4f1d-a87b-c6a5eb87176b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:17.346037 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:17.346037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:17.346037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:17.346185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:17.346185 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:17.346307 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-490b77e1-1e88-49b4-abc2-ccaa9cbde057 req-f7e25d44-1d6d-42a8-bcde-3099a004521f service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:17.374284 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497, portal: 192.168.40.100,3260]
May 27 23:04:17.374284 np0000001565 nova-compute[98289]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497, portal: 192.168.40.100,3260] successful.
May 27 23:04:17.374284 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.395769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.406226 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.438461 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497, portal: 192.168.50.100,3260]
May 27 23:04:17.438461 np0000001565 nova-compute[98289]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-fc4f800f-0613-4549-b71f-5ee16605c497, portal: 192.168.50.100,3260] successful.
May 27 23:04:17.438461 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.459280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.459539 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:17.459696 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] <== disconnect_volume: return (328ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:17.459851 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:04:17.460800 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:04:17.461167 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15648881-dc61-473b-8ee5-31bf6ade7f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:17.461451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:17.461574 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:17.461817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15648881-dc61-473b-8ee5-31bf6ade7f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:04:17.461923 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:04:17.487662 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.487662 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.487662 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.487662 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.487662 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:17.487662 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:17.487662 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.487662 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.487662 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.487662 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.487662 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:17.488083 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.488083 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.488083 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.488083 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.488083 np0000001565 nova-compute[98289]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:17.488083 np0000001565 nova-compute[98289]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69 (non-flash)
May 27 23:04:17.488083 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.488083 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.488083 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.488083 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.488083 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:17.488083 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '41')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:04:17.488502 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '27')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:17.489554 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69', '26')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:17.490319 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e602abba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69'): ({'sdj'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:04:17.490542 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Removing multipathed devices sdj, sdk {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:04:17.490776 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Flush multipath device 330000000b9a12dde {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:04:17.501679 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:17.503013 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923057.5028536, 80c6eabe-0192-4030-a194-2d87bb638464 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:17.503176 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] VM Resumed (Lifecycle Event)
May 27 23:04:17.520680 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:17.540728 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Instance destroyed successfully.
May 27 23:04:17.540914 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-739387005',display_name='tempest-ServerActionsTestOtherA-server-25719381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-tempest-common-compute-instance-739387005',id=23,image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnodhAb2AYguwUd5MV+nvPGMbjwA3r/emEznS8hSo46pEnn++o3pinPXblU18rNwX+gwoeQytYg7sLDlLIvv2OF+DTWF+VTfmRotWRCucjo1E6Z1kEn1QxneivXH8UZIg==',key_name='tempest-keypair-480643972',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:24Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-l3upe9iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=09a47014-23a8-4dad-ab17-6df274ed8cf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:17.541118 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:17.541682 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:17.541915 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:17.543354 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.543615 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5497c3f3-3f, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:17.544965 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.547828 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:17.548945 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.549222 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44b3b7fe-f361-4292-8556-ae900b9f73d6) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:17.549663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.550624 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:17.551927 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.553619 np0000001565 nova-compute[98289]: INFO os_vif [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f')
May 27 23:04:17.555261 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:04:17.555687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:17.555912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:17.556097 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:17.605534 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:04:17.605785 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:04:17.606913 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:04:17.620259 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:04:17.620259 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:04:17.631464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.665352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69, portal: 192.168.40.100,3260]
May 27 23:04:17.665352 np0000001565 nova-compute[98289]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69, portal: 192.168.40.100,3260] successful.
May 27 23:04:17.665352 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.685939 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.696804 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:04:17.702821 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.722922 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.744861 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69, portal: 192.168.50.100,3260]
May 27 23:04:17.744861 np0000001565 nova-compute[98289]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-15648881-dc61-473b-8ee5-31bf6ade7f69, portal: 192.168.50.100,3260] successful.
May 27 23:04:17.744861 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.751051 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.774980 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:17.775286 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:17.775466 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] <== disconnect_volume: return (313ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:17.775615 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:04:17.776241 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.220s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:17.776772 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:04:17.776938 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:04:17.782624 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:04:17.782975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7613ef2-f3e5-460b-b93b-ac85d1586207', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:17.783150 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:17.817636 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.817636 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.817636 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.817636 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.817636 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.817636 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.817636 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.817636 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.817636 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:17.817817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.817817 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.817817 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.817817 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.817817 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.817817 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.817817 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.817817 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.817817 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:17.817957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '41')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:04:17.818017 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, 0): [] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:17.818686 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c') {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 23:04:17.818796 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, 0): [] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:17.818886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c') {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 23:04:17.818985 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e602abba0>, {}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:04:17.819089 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Disconnecting from: [] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:04:17.819269 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.043s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:17.819408 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== disconnect_volume: return (263ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:17.819535 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:04:17.820205 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.037s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:17.821134 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7613ef2-f3e5-460b-b93b-ac85d1586207', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:04:17.821398 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:04:17.821838 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Deleting instance files /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7_del
May 27 23:04:17.827564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.054s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:17.828265 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.628s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:17.828558 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:04:17.831711 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Deletion of /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7_del complete
May 27 23:04:17.841245 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:04:17.841438 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Claim successful on node np0000001565
May 27 23:04:17.866994 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.866994 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.866994 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.866994 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.866994 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.866994 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.866994 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.866994 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.866994 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:17.867302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.867302 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:17.867302 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.867302 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:17.867302 np0000001565 nova-compute[98289]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.867302 np0000001565 nova-compute[98289]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207 (non-flash)
May 27 23:04:17.867302 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.867302 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:17.867302 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:17.867302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '41')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:04:17.867626 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '29')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:17.868758 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207', '28')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:17.869506 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e601e6660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207'): ({'sdm'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:04:17.869676 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Removing multipathed devices sdm, sdl {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:04:17.869874 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Flush multipath device 3300000002cf2e44b {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:04:17.906568 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:17.937751 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:17.958692 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:17.996778 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:18.002984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:04:18.004446 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:04:18.004446 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:04:18.006231 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:18.010924 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:18.017326 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:04:18.018055 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:04:18.021027 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-433e6524-50fc-4b98-84b7-9921a6b8f731 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:18.022004 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:18.023922 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:18.023922 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:18.023922 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-433e6524-50fc-4b98-84b7-9921a6b8f731 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:18.023922 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-433e6524-50fc-4b98-84b7-9921a6b8f731 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:18.023922 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:18.023922 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:18.024405 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:18.024405 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:18.024496 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:18.024585 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:18.024684 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:18.024810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:18.024919 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:18.025012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:18.025241 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:18.025701 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9b8f5f8b-36e8-41d1-be0b-0fea32997adc req-7398afcf-9089-48f0-9004-31c6abf71de5 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-8f186912-a40c-40b0-9cc1-808a4f92aa20 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:18.032032 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:18.066300 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Instance destroyed successfully.
May 27 23:04:18.067215 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'resources' on Instance uuid 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:18.076916 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207, portal: 192.168.40.100,3260]
May 27 23:04:18.076916 np0000001565 nova-compute[98289]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207, portal: 192.168.40.100,3260] successful.
May 27 23:04:18.076916 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:18.093172 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:18.105554 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:18.140280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207, portal: 192.168.50.100,3260]
May 27 23:04:18.140280 np0000001565 nova-compute[98289]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-a7613ef2-f3e5-460b-b93b-ac85d1586207, portal: 192.168.50.100,3260] successful.
May 27 23:04:18.140280 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:18.166459 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:18.166459 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:18.166459 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] <== disconnect_volume: return (381ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:18.166459 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:04:18.166459 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Deleting instance files /opt/stack/data/nova/instances/0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539_del
May 27 23:04:18.166459 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Deletion of /opt/stack/data/nova/instances/0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539_del complete
May 27 23:04:18.306458 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:18.344398 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:04:18.344584 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:04:18.344828 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:18.345052 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:18.471564 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd1c936280234ce2ab39aacb89c5af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475430e1d5044d9b97a65459543a1361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:04:18.514460 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999726858000031 future=<Future at 0x726e387a1760 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:18.514950 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999853556000062 future=<Future at 0x726e5821a0f0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:18.572247 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1449943138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-1449943138',id=21,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:12Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-9lo0ul3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:21Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=59ef4a49-bfd7-490d-8d17-a371b7ed4c4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "address": "fa:16:3e:09:38:3a", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd725ff-8e", "ovs_interfaceid": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:18.572877 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "address": "fa:16:3e:09:38:3a", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd725ff-8e", "ovs_interfaceid": "0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:18.572877 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:38:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd725ff-8e') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:18.573537 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:38:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd725ff-8e') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:18.574599 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:18.574801 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dd725ff-8e, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:18.580791 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:18.581660 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:18.582439 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:18.582581 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=355dfe2a-2136-4e6e-b643-98e1145a92f0) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:18.583174 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:18.584094 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:18.584151 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:18.587515 np0000001565 nova-compute[98289]: INFO os_vif [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:38:3a,bridge_name='br-int',has_traffic_filtering=True,id=0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd725ff-8e')
May 27 23:04:18.587802 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Deleting instance files /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d_del
May 27 23:04:18.588721 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Deletion of /opt/stack/data/nova/instances/59ef4a49-bfd7-490d-8d17-a371b7ed4c4d_del complete
May 27 23:04:18.681489 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Took 3.19 seconds to destroy the instance on the hypervisor.
May 27 23:04:18.682383 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:04:18.685455 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:04:18.685455 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:04:18.685455 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:18.785755 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:18.849360 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:04:18.864161 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Booting with volume 74b600c6-b367-47cd-9bd1-b58615626e8c at /dev/vdb
May 27 23:04:18.925545 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:18.941575 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:04:18.969405 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:19.016435 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:04:19.016766 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:04:19.026305 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:04:19.027734 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe1a:5b46', 'fe80::a4c2:94ff:feca:4de9', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fea8:ff85', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:fec3:7f1b', 'fe80::341f:bfff:fe55:81e6'] 
May 27 23:04:19.028437 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:04:19.028657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:04:19.028972 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:19.029260 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Updating existing volume attachment record: 389872f9-608c-4f45-9c8a-ada42d0c2bab {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:04:19.100960 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Took 1.40 seconds to destroy the instance on the hypervisor.
May 27 23:04:19.103089 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:04:19.104702 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:04:19.104702 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:04:19.104702 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:19.282166 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:19.284749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:19.284749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:19.286397 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:19.286719 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:19.292270 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Terminating instance
May 27 23:04:19.353232 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:04:19.509142 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Successfully created port: ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:04:19.560948 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:19.648082 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:19.651375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:19.652642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:19.652896 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:19.653791 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:19.653981 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-d7259562-6553-4ef1-8d96-bc9e7b64bf75 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:19.656410 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:19.660420 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:19.661255 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:19.661255 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:19.661255 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:19.661511 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-22db9eb7-e550-46da-9fd0-082bc64ad74f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:19.661614 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:19.661803 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:19.662046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:19.663047 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:19.663203 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:19.663373 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4533f617-10cc-4b82-9ba8-2eebfdd9388c req-c98604e0-6494-4b62-8725-ff337ad31156 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-22db9eb7-e550-46da-9fd0-082bc64ad74f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:19.725360 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:19.725360 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:19.798557 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:04:19.829309 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:19.831923 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:19.857290 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:19.860876 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:19.893846 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:19.925212 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:19.925526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:19.925738 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:19.925963 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:19.926662 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:19.926662 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-22a9c0da-759e-45d4-8c4a-0f0afe6d472e for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:19.926737 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:19.927025 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:19.927368 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:19.927530 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:19.927575 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:19.927719 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:19.927869 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:19.928057 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Acquiring lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:19.928308 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:19.930820 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:19.931000 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] No waiting events found dispatching network-vif-unplugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:19.932797 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-unplugged-b35b0820-2c57-46ab-8bf6-81d591b179e2 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:19.932797 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Received event network-vif-unplugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:19.932797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Acquiring lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:19.933425 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:19.933425 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:19.933425 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] No waiting events found dispatching network-vif-unplugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:19.936911 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b9a02176-5cba-4a58-a63a-b799e5203bbc req-af7a5292-5c62-4eab-bb23-17e012f2af02 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Received event network-vif-unplugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:20.156919 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998070480000024 future=<Future at 0x726e385ffa10 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:20.162449 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Instance destroyed successfully.
May 27 23:04:20.163612 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lazy-loading 'resources' on Instance uuid 80c6eabe-0192-4030-a194-2d87bb638464 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:20.227927 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:20.284738 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3eb8e147-146c-4dc1-b515-24acd9fe778a req-130e499d-3532-4b37-8871-c6797d81b15f service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Received event network-vif-deleted-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:20.285587 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-3eb8e147-146c-4dc1-b515-24acd9fe778a req-130e499d-3532-4b37-8871-c6797d81b15f service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Neutron deleted interface 0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6; detaching it from the instance and deleting it from the info cache
May 27 23:04:20.287181 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3eb8e147-146c-4dc1-b515-24acd9fe778a req-130e499d-3532-4b37-8871-c6797d81b15f service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Detach interface failed, port_id=0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6, reason: Instance 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:04:20.326081 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:20.368306 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:04:20.369432 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:04:20.369743 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Creating image(s)
May 27 23:04:20.370203 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:20.371697 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:20.373347 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:20.373910 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:20.377744 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:20.379022 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:20.484622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.104s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:20.484622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:20.484622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:20.484622 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:20.488415 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:20.488699 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:20.501833 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:20.514012 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Successfully updated port: ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:04:20.587035 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:20.587466 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:20.641473 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk 1073741824" returned: 0 in 0.053s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:20.642059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:20.642459 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:20.676074 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-373770128',display_name='tempest-ServerActionsTestOtherB-server-373770128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestotherb-server-373770128',id=16,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkuCpnXkvttUUkvybNqerRfpglzcntgI2LbNRFPS1WvoMpreQBqFxBf2ldcA5vcM/zSM/QMd+MwRw2lJY1injdu+2h30nJE+SFIeu7eI9MVi5k22eYdTlR/lcnOcp4shQ==',key_name='tempest-keypair-47837674',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:16Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dbf5952ce9242a38d3c1881a1604223',ramdisk_id='',reservation_id='r-qn417ctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1638868194',owner_user_name='tempest-ServerActionsTestOtherB-1638868194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb24b22559e4715a196b40ce9948d74',uuid=80c6eabe-0192-4030-a194-2d87bb638464,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:20.677797 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converting VIF {"id": "61892495-669a-42b8-9d49-04d6990d3b8f", "address": "fa:16:3e:c3:7f:1b", "network": {"id": "f997a58d-5fa0-4a7e-968e-20128fdc317b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099632896-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dbf5952ce9242a38d3c1881a1604223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61892495-66", "ovs_interfaceid": "61892495-669a-42b8-9d49-04d6990d3b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:20.679096 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:20.679580 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:20.683036 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:20.683282 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61892495-66, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:20.685093 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:20.686389 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:20.687933 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:20.689537 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:20.689537 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77c3df26-4df2-48ea-bf34-61715f3bc06f) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:20.690164 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:20.690715 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:20.692218 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:20.697991 np0000001565 nova-compute[98289]: INFO os_vif [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:7f:1b,bridge_name='br-int',has_traffic_filtering=True,id=61892495-669a-42b8-9d49-04d6990d3b8f,network=Network(f997a58d-5fa0-4a7e-968e-20128fdc317b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61892495-66')
May 27 23:04:20.705116 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:04:20.705896 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:20.706133 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:20.707607 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:20.708987 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '065ce712-bac2-49ae-b684-5600689bfd55', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:04:20.709200 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:04:20.735478 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.908s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:20.735988 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:04:20.747816 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:20.747816 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:20.747816 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:20.747816 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:20.747816 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:20.747816 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:20.747816 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:20.748246 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:20.748246 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:20.748246 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:20.748246 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:20.748246 np0000001565 nova-compute[98289]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:20.748246 np0000001565 nova-compute[98289]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55 (non-flash)
May 27 23:04:20.748246 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:20.748246 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '41')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:04:20.748548 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '40')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:20.749427 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55', '41')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:20.750279 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e5874c180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:04:20.750531 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:04:20.750885 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Flush multipath device 330000000493f2b88 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:04:20.751470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.109s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:20.751835 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:04:20.752288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:20.803248 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:20.831870 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Took 1.73 seconds to deallocate network for instance.
May 27 23:04:20.855237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:20.879114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:20.879428 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Cannot resize image /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:04:20.879765 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:04:20.879961 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Ensure instance console log exists: /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:04:20.880263 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:20.880639 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:20.880639 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:20.900247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:04:20.900489 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:04:20.906695 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:04:20.923126 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:04:20.923126 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:04:20.936782 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:20.975048 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260]
May 27 23:04:20.975048 np0000001565 nova-compute[98289]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.40.100,3260] successful.
May 27 23:04:20.975048 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:20.990593 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:21.003031 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:21.019368 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:21.021604 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquired lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:21.021864 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:04:21.034049 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260]
May 27 23:04:21.034049 np0000001565 nova-compute[98289]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-065ce712-bac2-49ae-b684-5600689bfd55, portal: 192.168.50.100,3260] successful.
May 27 23:04:21.034049 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:21.049004 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:21.049676 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:21.049829 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] <== disconnect_volume: return (344ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:21.050091 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:04:21.050255 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Deleting instance files /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464_del
May 27 23:04:21.055750 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Deletion of /opt/stack/data/nova/instances/80c6eabe-0192-4030-a194-2d87bb638464_del complete
May 27 23:04:21.179266 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:04:21.180116 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Creating image(s)
May 27 23:04:21.180987 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:21.181672 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:21.182577 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:21.182927 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "4e8a4429e465fb18f4b472fd5e59c4f487e7d890" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:21.183508 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "4e8a4429e465fb18f4b472fd5e59c4f487e7d890" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:21.246361 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:04:21.246361 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:04:21.246361 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:21.246361 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:21.348110 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:21.348347 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:21.376960 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c6d94c1e6da4237aa5dd517c31e03d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec877dc7b2240969ac89c13673f8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:04:21.573651 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Took 1.77 seconds to destroy the instance on the hypervisor.
May 27 23:04:21.578059 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:04:21.581775 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:04:21.581775 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:04:21.581775 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:21.683553 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:04:21.729417 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bbee8e9d-9112-4105-8a4a-65ddd941444d req-8372db51-ffa1-42c7-b44a-fc201d0c0370 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-changed-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:21.729637 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bbee8e9d-9112-4105-8a4a-65ddd941444d req-8372db51-ffa1-42c7-b44a-fc201d0c0370 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Refreshing instance network info cache due to event network-changed-ceb9d24a-c097-4869-8358-4b045b4e9d08. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:04:21.729812 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bbee8e9d-9112-4105-8a4a-65ddd941444d req-8372db51-ffa1-42c7-b44a-fc201d0c0370 service nova] Acquiring lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:21.750536 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:04:21.754956 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:21.954174 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:21.957117 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:21.957473 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890.part --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:22.035095 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Received event network-vif-unplugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:22.038356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] Acquiring lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:22.038356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:22.038356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:22.038356 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] No waiting events found dispatching network-vif-unplugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:22.038356 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Received unexpected event network-vif-unplugged-0dd725ff-8e3c-446d-8b3e-11d3bd6d41c6 for instance with vm_state deleted and task_state None.
May 27 23:04:22.038356 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:22.038356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:22.038356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:22.038356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:22.043769 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] No waiting events found dispatching network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:22.044557 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:22.044977 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:22.045209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] Acquiring lock "80c6eabe-0192-4030-a194-2d87bb638464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:22.045400 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:22.045531 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] Lock "80c6eabe-0192-4030-a194-2d87bb638464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:22.045683 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] No waiting events found dispatching network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:22.045824 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fd2c4fcf-35cc-4307-bd48-ad27b9426bfb req-dd4feeb8-7692-4204-9ca5-df9d4562af41 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-unplugged-61892495-669a-42b8-9d49-04d6990d3b8f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:22.076214 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890.part --force-share --output=json" returned: 0 in 0.119s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:22.077089 np0000001565 nova-compute[98289]: DEBUG nova.virt.images [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] 8ff2d219-b0c5-4008-bfa5-cea77f23c366 was qcow2, converting to raw {{(pid=98289) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 23:04:22.077575 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:04:22.077991 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890.part /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890.converted {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:22.112097 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Successfully created port: 112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:04:22.235175 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890.part /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890.converted" returned: 0 in 0.157s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:22.242028 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890.converted --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:22.261581 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:04:22.271084 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:22.271478 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:22.344219 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890.converted --force-share --output=json" returned: 0 in 0.103s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:22.345544 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "4e8a4429e465fb18f4b472fd5e59c4f487e7d890" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.162s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:22.346122 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:22.349703 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:22.350994 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:22.469148 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890 --force-share --output=json" returned: 0 in 0.118s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:22.469732 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "4e8a4429e465fb18f4b472fd5e59c4f487e7d890" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:22.470212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "4e8a4429e465fb18f4b472fd5e59c4f487e7d890" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:22.470700 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:22.474464 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:22.475418 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:22.600804 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890 --force-share --output=json" returned: 0 in 0.125s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:22.601257 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890,backing_fmt=raw /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:22.658363 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890,backing_fmt=raw /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk 1073741824" returned: 0 in 0.057s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:22.658877 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "4e8a4429e465fb18f4b472fd5e59c4f487e7d890" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:22.659198 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:22.756535 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:22.775014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e8a4429e465fb18f4b472fd5e59c4f487e7d890 --force-share --output=json" returned: 0 in 0.115s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:22.775014 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:04:22.775014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:22.777392 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:22.812802 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-056d5860-4ee4-4d12-812e-e38d7652e675 req-d533e81d-c895-4a43-946a-a4afaeadf293 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-deleted-d7259562-6553-4ef1-8d96-bc9e7b64bf75 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:22.817769 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-056d5860-4ee4-4d12-812e-e38d7652e675 req-d533e81d-c895-4a43-946a-a4afaeadf293 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Neutron deleted interface d7259562-6553-4ef1-8d96-bc9e7b64bf75; detaching it from the instance and deleting it from the info cache
May 27 23:04:22.830435 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-056d5860-4ee4-4d12-812e-e38d7652e675 req-d533e81d-c895-4a43-946a-a4afaeadf293 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Detach interface failed, port_id=d7259562-6553-4ef1-8d96-bc9e7b64bf75, reason: Instance 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:04:22.830628 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-056d5860-4ee4-4d12-812e-e38d7652e675 req-d533e81d-c895-4a43-946a-a4afaeadf293 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-deleted-8f186912-a40c-40b0-9cc1-808a4f92aa20 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:22.831280 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-056d5860-4ee4-4d12-812e-e38d7652e675 req-d533e81d-c895-4a43-946a-a4afaeadf293 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Neutron deleted interface 8f186912-a40c-40b0-9cc1-808a4f92aa20; detaching it from the instance and deleting it from the info cache
May 27 23:04:22.836051 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-056d5860-4ee4-4d12-812e-e38d7652e675 req-d533e81d-c895-4a43-946a-a4afaeadf293 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Detach interface failed, port_id=8f186912-a40c-40b0-9cc1-808a4f92aa20, reason: Instance 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:04:22.878137 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:22.878455 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Cannot resize image /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:04:22.878886 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:04:22.879187 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Ensure instance console log exists: /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:04:22.879563 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:22.879879 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:22.880061 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:22.883354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Start _get_guest_xml network_info=[{"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-27T22:58:06Z,direct_url=<?>,disk_format='qcow2',id=8ff2d219-b0c5-4008-bfa5-cea77f23c366,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-27T22:58:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '389872f9-608c-4f45-9c8a-ada42d0c2bab', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '09a47014-23a8-4dad-ab17-6df274ed8cf7', 'attached_at': '', 'detached_at': '', 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'serial': '74b600c6-b367-47cd-9bd1-b58615626e8c'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:04:22.886496 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 27 23:04:22.888980 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='8ff2d219-b0c5-4008-bfa5-cea77f23c366', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-25719381', uuid='09a47014-23a8-4dad-ab17-6df274ed8cf7'), owner=OwnerMeta(userid='8f0d298d70064eac8ffd4fe25b1e203b', username='tempest-ServerActionsTestOtherA-1786604563-project-member', projectid='d6f15f51479c4e37ab880af2031170be', projectname='tempest-ServerActionsTestOtherA-1786604563'), image=ImageMeta(id='8ff2d219-b0c5-4008-bfa5-cea77f23c366', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923062.888226) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:04:22.892241 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:04:22.892744 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:04:22.893715 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:04:22.894034 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:04:22.895317 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:04:22.896118 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-27T22:58:06Z,direct_url=<?>,disk_format='qcow2',id=8ff2d219-b0c5-4008-bfa5-cea77f23c366,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-27T22:58:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:04:22.896318 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:04:22.896452 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:04:22.896668 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:04:22.896791 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:04:22.896941 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:04:22.897128 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:04:22.897236 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:04:22.898004 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:04:22.898431 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:04:22.898698 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:04:22.898972 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'vcpu_model' on Instance uuid 09a47014-23a8-4dad-ab17-6df274ed8cf7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:22.961014 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Successfully updated port: 112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:04:23.002779 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updating instance_info_cache with network_info: [{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:23.044372 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:23.208409 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:23.277839 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:04:23.278851 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:04:23.279040 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Creating image(s)
May 27 23:04:23.279542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:23.279765 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:23.280264 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:23.281106 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:23.283580 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:23.284687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:23.303382 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.952s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:23.306997 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:23.353388 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Deleted allocations for instance 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d
May 27 23:04:23.367438 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:23.367944 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:23.368208 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:23.368619 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:23.371123 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:23.371423 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:23.414554 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:04:23.414924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:23.415071 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:23.415443 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:23.415632 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:04:23.425949 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:23.426478 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:23.426925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:23.427089 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:04:23.427453 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:23.427826 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:04:23.437703 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:04:23.437703 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:23.442976 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:04:23.442976 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:23.448748 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c] added
May 27 23:04:23.448748 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:04:23.448748 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:23.448748 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:23.448748 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:23.448748 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:23.448748 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:23.448942 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:04:23.449090 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.022(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:04:23.449219 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:04:23.452386 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c] added
May 27 23:04:23.452386 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:04:23.452386 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:23.452386 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:23.452386 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:23.452386 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:23.452386 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:23.452553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:04:23.452659 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:04:23.452755 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:04:23.456754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:23.457092 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:23.468833 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:23.469053 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:23.469297 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:04:23.504061 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk 1073741824" returned: 0 in 0.047s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:23.504448 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.136s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:23.504811 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:23.505533 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Releasing lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:23.506066 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Instance network_info: |[{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:04:23.506516 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bbee8e9d-9112-4105-8a4a-65ddd941444d req-8372db51-ffa1-42c7-b44a-fc201d0c0370 service nova] Acquired lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:23.506725 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-bbee8e9d-9112-4105-8a4a-65ddd941444d req-8372db51-ffa1-42c7-b44a-fc201d0c0370 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Refreshing network info cache for port ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:04:23.509254 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Start _get_guest_xml network_info=[{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:04:23.533351 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:04:23.536458 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-142893825', uuid='2b2f5344-3fbe-469b-bd1f-07b603ac1d33'), owner=OwnerMeta(userid='dd1c936280234ce2ab39aacb89c5af22', username='tempest-AttachVolumeShelveTestJSON-876504441-project-member', projectid='475430e1d5044d9b97a65459543a1361', projectname='tempest-AttachVolumeShelveTestJSON-876504441'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923063.5354598) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:04:23.537538 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:04:23.542424 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:04:23.543498 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:04:23.543716 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:04:23.545063 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:04:23.545482 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:04:23.545636 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:04:23.545745 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:04:23.545884 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:04:23.545970 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:04:23.546071 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:04:23.546248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:04:23.546374 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:04:23.546509 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:04:23.546689 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:04:23.546821 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:04:23.554702 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Took 1.97 seconds to deallocate network for instance.
May 27 23:04:23.561899 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-142893825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-142893825',id=26,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM62J859+2pEbRLjdd0fhBLRZfGayfP3B5a1x5kH0UqnsmLNgl1KQR/DwJ2a1t/AckJdkTll1d8uU014SH0svwq0a9RyZ286r4Ur1QP2gPVWcPtA6gTS/kM+gxaRXalFIA==',key_name='tempest-keypair-140352231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-p40b4hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=2b2f5344-3fbe-469b-bd1f-07b603ac1d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:04:23.562070 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:23.562705 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:23.563264 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:23.602490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:23.602881 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:04:23.603152 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:23.690083 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:23.690520 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Cannot resize image /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:04:23.691013 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:04:23.691175 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Ensure instance console log exists: /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:04:23.691380 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:23.691640 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:23.691839 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:23.710518 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Took 5.03 seconds to deallocate network for instance.
May 27 23:04:23.776741 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:23.810600 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8fa162dd-8d09-411d-85c0-1e02474d8d32 req-4044c7d1-1331-4149-81c1-e117d32746b7 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-deleted-22db9eb7-e550-46da-9fd0-082bc64ad74f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:23.863224 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.001117305999969176 future=<Future at 0x726e38720f50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:23.863398 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:23.863976 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Emitting event <LifecycleEvent: 1779923048.8617873, 8eb4bd8d-577c-4065-a466-d943fd51ef8e => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:23.863976 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.853342407000127 future=<Future at 0x726e387537d0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:23.864078 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.85321947500006 future=<Future at 0x726e387537d0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:23.864276 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] VM Stopped (Lifecycle Event)
May 27 23:04:24.024441 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-bbee8e9d-9112-4105-8a4a-65ddd941444d req-8372db51-ffa1-42c7-b44a-fc201d0c0370 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:24.043729 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:04:24.067049 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] End _get_guest_xml xml=<domain type="qemu">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <uuid>2b2f5344-3fbe-469b-bd1f-07b603ac1d33</uuid>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <name>instance-0000001a</name>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-142893825</nova:name>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:04:23</nova:creationTime>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:user uuid="dd1c936280234ce2ab39aacb89c5af22">tempest-AttachVolumeShelveTestJSON-876504441-project-member</nova:user>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:project uuid="475430e1d5044d9b97a65459543a1361">tempest-AttachVolumeShelveTestJSON-876504441</nova:project>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         <nova:port uuid="ceb9d24a-c097-4869-8358-4b045b4e9d08">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <system>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <entry name="serial">2b2f5344-3fbe-469b-bd1f-07b603ac1d33</entry>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <entry name="uuid">2b2f5344-3fbe-469b-bd1f-07b603ac1d33</entry>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     </system>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <os>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   </os>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <features>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   </features>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   <devices>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.config"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ad:f3:02"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <target dev="tapceb9d24a-c0"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     </interface>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/console.log" append="off"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     </serial>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <video>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     </video>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     </rng>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:   </devices>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]: </domain>
May 27 23:04:24.067049 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:04:24.072688 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Preparing to wait for external event network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:04:24.072688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:24.072688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:24.072688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:24.072688 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-142893825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-142893825',id=26,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM62J859+2pEbRLjdd0fhBLRZfGayfP3B5a1x5kH0UqnsmLNgl1KQR/DwJ2a1t/AckJdkTll1d8uU014SH0svwq0a9RyZ286r4Ur1QP2gPVWcPtA6gTS/kM+gxaRXalFIA==',key_name='tempest-keypair-140352231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-p40b4hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=2b2f5344-3fbe-469b-bd1f-07b603ac1d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:04:24.072688 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:24.072688 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:24.072688 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:04:24.072688 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:24.072688 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:24.072688 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:04:24.075797 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:24.076041 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbfd3e06-faa3-5f4d-bd77-1d53cc641dc5', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:24.076920 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:24.077803 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:24.080938 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:24.087891 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:24.087891 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapceb9d24a-c0, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:24.088277 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapceb9d24a-c0, col_values=(('qos', UUID('42cfb097-baa4-461a-b0b5-daa0954e729a')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:24.088441 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapceb9d24a-c0, col_values=(('external_ids', {'iface-id': 'ceb9d24a-c097-4869-8358-4b045b4e9d08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:f3:02', 'vm-uuid': '2b2f5344-3fbe-469b-bd1f-07b603ac1d33'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:24.090757 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:24.092605 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:24.095600 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:24.096491 np0000001565 nova-compute[98289]: INFO os_vif [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0')
May 27 23:04:24.141485 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Took 0.59 seconds to detach 1 volumes for instance.
May 27 23:04:24.151125 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-780ac0a2-9057-4322-ba17-ead34382ae71 req-da6f1bc8-1458-4a2a-8c53-30384328cec1 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-deleted-b35b0820-2c57-46ab-8bf6-81d591b179e2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:24.151494 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-780ac0a2-9057-4322-ba17-ead34382ae71 req-da6f1bc8-1458-4a2a-8c53-30384328cec1 service nova] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Received event network-vif-deleted-61892495-669a-42b8-9d49-04d6990d3b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:24.151607 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-780ac0a2-9057-4322-ba17-ead34382ae71 req-da6f1bc8-1458-4a2a-8c53-30384328cec1 service nova] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Received event network-vif-deleted-22a9c0da-759e-45d4-8c4a-0f0afe6d472e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:24.259672 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:24.363361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e69136e3-dc7f-453b-a857-0d978d2d3efc tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "59ef4a49-bfd7-490d-8d17-a371b7ed4c4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:24.366750 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 8eb4bd8d-577c-4065-a466-d943fd51ef8e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:24.397304 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-bbee8e9d-9112-4105-8a4a-65ddd941444d req-8372db51-ffa1-42c7-b44a-fc201d0c0370 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:24.431559 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating instance_info_cache with network_info: [{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:24.449672 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:04:24.453045 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:04:24.461178 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:04:24.461178 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:04:24.469479 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:04:24.469479 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:24.478817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:24.489925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:24.495875 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.495875 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.495875 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.495875 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.495875 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:24.495875 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.495875 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.495875 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.495875 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.495875 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:24.505588 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.505588 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.505588 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.505588 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.505588 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:24.505588 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.505588 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.505588 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.505588 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.505588 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:24.528488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.40.100,3260]
May 27 23:04:24.528488 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.40.100,3260] successful.
May 27 23:04:24.528488 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:24.541195 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:24.543389 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-bbee8e9d-9112-4105-8a4a-65ddd941444d req-8372db51-ffa1-42c7-b44a-fc201d0c0370 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updated VIF entry in instance network info cache for port ceb9d24a-c097-4869-8358-4b045b4e9d08. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:04:24.544081 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-bbee8e9d-9112-4105-8a4a-65ddd941444d req-8372db51-ffa1-42c7-b44a-fc201d0c0370 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updating instance_info_cache with network_info: [{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:24.547181 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.50.100,3260]
May 27 23:04:24.547181 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.50.100,3260] successful.
May 27 23:04:24.547181 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:24.556182 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.556182 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.556182 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.556182 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.556182 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:24.556182 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:24.556182 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:24.556567 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.556567 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.556567 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.556567 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.556567 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:24.556567 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:24.556567 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:24.556862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:24.556965 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:04:24.557889 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] HCTL ('11', '-', '-', 0) found on session 42 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:04:24.557993 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:04:24.562670 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:24.576121 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching for a device in session 42 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:04:24.576121 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:04:24.579064 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.579064 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.579064 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.579064 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.579064 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:24.579064 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:24.579064 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:24.583148 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.583148 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:24.583148 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.583148 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:24.583148 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:24.583148 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:24.583148 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:24.583148 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:24.583148 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:04:24.583148 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] HCTL ('12', '-', '-', 0) found on session 43 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:04:24.583148 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:04:24.598578 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching for a device in session 43 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:04:24.598578 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:04:24.613475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:24.614810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:24.614810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:24.614810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:24.614810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:24.617258 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Terminating instance
May 27 23:04:24.651859 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:24.651859 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:24.652942 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:24.722177 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Deleted allocations for instance 80c6eabe-0192-4030-a194-2d87bb638464
May 27 23:04:24.859423 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3aa4651b-6879-46ff-9d57-0f5e7dada241 req-cebfe2a0-1e39-42dd-92c1-d170fc5e73e8 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received event network-changed-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:24.860894 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3aa4651b-6879-46ff-9d57-0f5e7dada241 req-cebfe2a0-1e39-42dd-92c1-d170fc5e73e8 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Refreshing instance network info cache due to event network-changed-112f36c6-7fa0-4a72-9edf-c9421eccd857. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:04:24.860894 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3aa4651b-6879-46ff-9d57-0f5e7dada241 req-cebfe2a0-1e39-42dd-92c1-d170fc5e73e8 service nova] Acquiring lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:24.933957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:24.934252 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Instance network_info: |[{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:04:24.935954 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Start _get_guest_xml network_info=[{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:04:24.936342 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3aa4651b-6879-46ff-9d57-0f5e7dada241 req-cebfe2a0-1e39-42dd-92c1-d170fc5e73e8 service nova] Acquired lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:24.936569 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3aa4651b-6879-46ff-9d57-0f5e7dada241 req-cebfe2a0-1e39-42dd-92c1-d170fc5e73e8 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Refreshing network info cache for port 112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:04:24.938637 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:04:24.939781 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='a6723b2d-e0b1-495c-910d-3ef37d877c05'), owner=OwnerMeta(userid='2c6d94c1e6da4237aa5dd517c31e03d7', username='tempest-AttachVolumeMultiAttachTest-781715127-project-member', projectid='0ec877dc7b2240969ac89c13673f8799', projectname='tempest-AttachVolumeMultiAttachTest-781715127'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923064.9394474) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:04:24.940920 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:04:24.941392 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:04:24.942483 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:04:24.942837 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:04:24.943466 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:04:24.943762 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:04:24.943899 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:04:24.943988 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:04:24.944108 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:04:24.944205 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:04:24.944305 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:04:24.944489 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:04:24.944586 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:04:24.944906 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:04:24.945088 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:04:24.945478 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:04:24.958301 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-1',id=27,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-iujlpdk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a6723b2d-e0b1-495c-910d-3ef37d877c05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:04:24.958522 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:24.958944 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:24.959444 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'pci_devices' on Instance uuid a6723b2d-e0b1-495c-910d-3ef37d877c05 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:25.046535 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bbee8e9d-9112-4105-8a4a-65ddd941444d req-8372db51-ffa1-42c7-b44a-fc201d0c0370 service nova] Releasing lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:25.120508 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:04:25.150539 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.153027 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.179463 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.310496 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.319800 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.428546 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Took 1.72 seconds to detach 3 volumes for instance.
May 27 23:04:25.430298 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998475732000088 future=<Future at 0x726e38795160 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:25.436550 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:04:25.437024 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Instance destroyed successfully.
May 27 23:04:25.437406 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'resources' on Instance uuid 7cb7c255-4b3c-493e-9a31-e554576a0525 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:25.439625 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3aa4651b-6879-46ff-9d57-0f5e7dada241 req-cebfe2a0-1e39-42dd-92c1-d170fc5e73e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:25.461922 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] End _get_guest_xml xml=<domain type="qemu">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <uuid>a6723b2d-e0b1-495c-910d-3ef37d877c05</uuid>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <name>instance-0000001b</name>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <nova:name>multiattach-server-1</nova:name>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:04:24</nova:creationTime>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:user uuid="2c6d94c1e6da4237aa5dd517c31e03d7">tempest-AttachVolumeMultiAttachTest-781715127-project-member</nova:user>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:project uuid="0ec877dc7b2240969ac89c13673f8799">tempest-AttachVolumeMultiAttachTest-781715127</nova:project>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         <nova:port uuid="112f36c6-7fa0-4a72-9edf-c9421eccd857">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <system>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <entry name="serial">a6723b2d-e0b1-495c-910d-3ef37d877c05</entry>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <entry name="uuid">a6723b2d-e0b1-495c-910d-3ef37d877c05</entry>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     </system>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <os>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   </os>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <features>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   </features>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   <devices>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.config"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:df:36:53"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <target dev="tap112f36c6-7f"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     </interface>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/console.log" append="off"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     </serial>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <video>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     </video>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     </rng>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:   </devices>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]: </domain>
May 27 23:04:25.461922 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:04:25.463796 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Preparing to wait for external event network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:04:25.463796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:25.463796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:25.463796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:25.463796 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-1',id=27,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-iujlpdk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a6723b2d-e0b1-495c-910d-3ef37d877c05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:04:25.463796 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:25.463796 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:25.464155 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:04:25.464155 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.464230 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:25.464845 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:04:25.465237 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.465237 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f957b50-b023-518c-b04f-c80e38f82f59', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:25.465952 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.466585 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:25.476690 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.478880 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.479118 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap112f36c6-7f, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:25.479568 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap112f36c6-7f, col_values=(('qos', UUID('c80bc5f2-8b25-4c98-b516-0fafe0bb9a97')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:25.479790 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap112f36c6-7f, col_values=(('external_ids', {'iface-id': '112f36c6-7fa0-4a72-9edf-c9421eccd857', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:36:53', 'vm-uuid': 'a6723b2d-e0b1-495c-910d-3ef37d877c05'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:25.484901 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:25.498033 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.499380 np0000001565 nova-compute[98289]: INFO os_vif [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f')
May 27 23:04:25.622485 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:25.624088 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:25.624290 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No VIF found with MAC fa:16:3e:ad:f3:02, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:04:25.624875 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Using config drive
May 27 23:04:25.728895 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4d771f2a-85d7-4a84-bdf5-fcf6aceb6748 tempest-ServerActionsTestOtherB-1638868194 tempest-ServerActionsTestOtherB-1638868194-project-member] Lock "80c6eabe-0192-4030-a194-2d87bb638464" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.446s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:25.763677 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3aa4651b-6879-46ff-9d57-0f5e7dada241 req-cebfe2a0-1e39-42dd-92c1-d170fc5e73e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:25.891279 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3aa4651b-6879-46ff-9d57-0f5e7dada241 req-cebfe2a0-1e39-42dd-92c1-d170fc5e73e8 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updated VIF entry in instance network info cache for port 112f36c6-7fa0-4a72-9edf-c9421eccd857. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:04:25.891607 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3aa4651b-6879-46ff-9d57-0f5e7dada241 req-cebfe2a0-1e39-42dd-92c1-d170fc5e73e8 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating instance_info_cache with network_info: [{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:25.937563 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:25.938484 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:25.944466 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-652051971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-652051971',id=13,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:02:49Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-k00lkx6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:02:56Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=7cb7c255-4b3c-493e-9a31-e554576a0525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:25.944466 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "fe17e03b-0353-4478-8ccb-48bb8622d814", "address": "fa:16:3e:a8:ff:85", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe17e03b-03", "ovs_interfaceid": "fe17e03b-0353-4478-8ccb-48bb8622d814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:25.944466 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ff:85,bridge_name='br-int',has_traffic_filtering=True,id=fe17e03b-0353-4478-8ccb-48bb8622d814,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe17e03b-03') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:25.944466 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ff:85,bridge_name='br-int',has_traffic_filtering=True,id=fe17e03b-0353-4478-8ccb-48bb8622d814,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe17e03b-03') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:25.947668 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.948099 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe17e03b-03, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:25.948835 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.949639 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:25.961695 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.965986 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.965986 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c47e2b2-d17b-4fb5-b51a-cb85404ce7d1) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:25.966352 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.966920 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:25.974737 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:25.978718 np0000001565 nova-compute[98289]: INFO os_vif [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ff:85,bridge_name='br-int',has_traffic_filtering=True,id=fe17e03b-0353-4478-8ccb-48bb8622d814,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe17e03b-03')
May 27 23:04:25.980816 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:04:25.981207 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:25.983824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:26.131457 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:26.296243 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Creating config drive at /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.config
May 27 23:04:26.304325 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu6tvqbdu {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:26.356448 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu6tvqbdu" returned: 0 in 0.052s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:26.370032 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-73cf4ce0-775f-4efd-b403-6584b961241c req-4e118fa1-5c25-4ba2-b88d-28779c4453c1 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:26.370032 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-73cf4ce0-775f-4efd-b403-6584b961241c req-4e118fa1-5c25-4ba2-b88d-28779c4453c1 service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:26.370032 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-73cf4ce0-775f-4efd-b403-6584b961241c req-4e118fa1-5c25-4ba2-b88d-28779c4453c1 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:26.370032 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-73cf4ce0-775f-4efd-b403-6584b961241c req-4e118fa1-5c25-4ba2-b88d-28779c4453c1 service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:26.370032 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-73cf4ce0-775f-4efd-b403-6584b961241c req-4e118fa1-5c25-4ba2-b88d-28779c4453c1 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] No waiting events found dispatching network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:26.370032 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-73cf4ce0-775f-4efd-b403-6584b961241c req-4e118fa1-5c25-4ba2-b88d-28779c4453c1 service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:26.394255 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3aa4651b-6879-46ff-9d57-0f5e7dada241 req-cebfe2a0-1e39-42dd-92c1-d170fc5e73e8 service nova] Releasing lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:26.455771 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Found WWN 33000000043123953 for multipath device dm-4 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:04:26.456185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:26.456432 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '33000000043123953', 'path': '/dev/dm-4', 'multipath_id': '33000000043123953'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:26.456612 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000043123953', 'path': '/dev/dm-4', 'multipath_id': '33000000043123953'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:04:26.457072 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.473s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:26.457500 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b3985f1-9dc4-481b-9837-6caf308cc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:04:26.457662 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsi session list stdout=tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632 (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:26.486969 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '43')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:04:26.486969 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '17')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:26.487891 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632', '16')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:04:26.488873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e602e8540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632'): ({'sdb'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:04:26.489074 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:04:26.489505 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Flush multipath device 330000000f76b9838 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:04:26.519734 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:26.563844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:04:26.607813 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:04:26.608039 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:04:26.610365 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:04:26.631591 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:04:26.631591 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:04:26.645491 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:26.675340 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:26.675696 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:26.680791 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632, portal: 192.168.40.100,3260]
May 27 23:04:26.680791 np0000001565 nova-compute[98289]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632, portal: 192.168.40.100,3260] successful.
May 27 23:04:26.680791 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:26.689923 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:26.702547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:26.714257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:26.755147 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632, portal: 192.168.50.100,3260]
May 27 23:04:26.755147 np0000001565 nova-compute[98289]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-7b3985f1-9dc4-481b-9837-6caf308cc632, portal: 192.168.50.100,3260] successful.
May 27 23:04:26.755147 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:26.769099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:26.769299 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:26.769456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] <== disconnect_volume: return (785ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:26.769573 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:04:26.769824 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Deleting instance files /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525_del
May 27 23:04:26.771016 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Deletion of /opt/stack/data/nova/instances/7cb7c255-4b3c-493e-9a31-e554576a0525_del complete
May 27 23:04:26.831223 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:26.870197 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:26.874198 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:26.956963 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:26.972015 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-739387005',display_name='tempest-ServerActionsTestOtherA-server-25719381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-tempest-common-compute-instance-739387005',id=23,image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnodhAb2AYguwUd5MV+nvPGMbjwA3r/emEznS8hSo46pEnn++o3pinPXblU18rNwX+gwoeQytYg7sLDlLIvv2OF+DTWF+VTfmRotWRCucjo1E6Z1kEn1QxneivXH8UZIg==',key_name='tempest-keypair-480643972',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:24Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-l3upe9iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=09a47014-23a8-4dad-ab17-6df274ed8cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:04:26.972259 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:26.972920 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:26.976450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] End _get_guest_xml xml=<domain type="qemu">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <uuid>09a47014-23a8-4dad-ab17-6df274ed8cf7</uuid>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <name>instance-00000017</name>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerActionsTestOtherA-server-25719381</nova:name>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:04:22</nova:creationTime>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <nova:image uuid="8ff2d219-b0c5-4008-bfa5-cea77f23c366">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:user uuid="8f0d298d70064eac8ffd4fe25b1e203b">tempest-ServerActionsTestOtherA-1786604563-project-member</nova:user>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:project uuid="d6f15f51479c4e37ab880af2031170be">tempest-ServerActionsTestOtherA-1786604563</nova:project>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="8ff2d219-b0c5-4008-bfa5-cea77f23c366"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         <nova:port uuid="5497c3f3-3f6d-4932-b646-487b60e99781">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <system>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <entry name="serial">09a47014-23a8-4dad-ab17-6df274ed8cf7</entry>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <entry name="uuid">09a47014-23a8-4dad-ab17-6df274ed8cf7</entry>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     </system>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <os>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   </os>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <features>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   </features>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   <devices>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.config"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <alias name="ua-74b600c6-b367-47cd-9bd1-b58615626e8c"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-4"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <serial>74b600c6-b367-47cd-9bd1-b58615626e8c</serial>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:33:92:45"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <target dev="tap5497c3f3-3f"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     </interface>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/console.log" append="off"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     </serial>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <video>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     </video>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     </rng>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:   </devices>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]: </domain>
May 27 23:04:26.976450 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:04:26.976450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-739387005',display_name='tempest-ServerActionsTestOtherA-server-25719381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-tempest-common-compute-instance-739387005',id=23,image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnodhAb2AYguwUd5MV+nvPGMbjwA3r/emEznS8hSo46pEnn++o3pinPXblU18rNwX+gwoeQytYg7sLDlLIvv2OF+DTWF+VTfmRotWRCucjo1E6Z1kEn1QxneivXH8UZIg==',key_name='tempest-keypair-480643972',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:24Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-l3upe9iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=09a47014-23a8-4dad-ab17-6df274ed8cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:04:26.976450 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:26.976450 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:26.976450 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:04:26.981179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:26.981179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:26.981179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:04:26.981179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:26.982813 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58b994a7-8b17-5e31-98b2-a4cf100ffb4f', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:26.984571 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:26.985446 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:26.988757 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:26.990526 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:26.990713 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5497c3f3-3f, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:26.991001 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5497c3f3-3f, col_values=(('qos', UUID('e984adf7-9df6-4d4e-911d-83e7dd296aa7')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:26.991155 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5497c3f3-3f, col_values=(('external_ids', {'iface-id': '5497c3f3-3f6d-4932-b646-487b60e99781', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:92:45', 'vm-uuid': '09a47014-23a8-4dad-ab17-6df274ed8cf7'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:26.994355 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:27.005684 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:27.009649 np0000001565 nova-compute[98289]: INFO os_vif [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f')
May 27 23:04:27.022263 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:27.022441 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:27.022600 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:df:36:53, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:04:27.023063 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Using config drive
May 27 23:04:27.070725 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7c116926-f60d-4ba5-87d3-84ad37c4006e req-3f6c1dda-e67e-4bde-b244-dd221d982969 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:27.071123 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7c116926-f60d-4ba5-87d3-84ad37c4006e req-3f6c1dda-e67e-4bde-b244-dd221d982969 service nova] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:27.071244 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7c116926-f60d-4ba5-87d3-84ad37c4006e req-3f6c1dda-e67e-4bde-b244-dd221d982969 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:27.071384 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7c116926-f60d-4ba5-87d3-84ad37c4006e req-3f6c1dda-e67e-4bde-b244-dd221d982969 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:27.071526 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7c116926-f60d-4ba5-87d3-84ad37c4006e req-3f6c1dda-e67e-4bde-b244-dd221d982969 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Processing event network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:04:27.144235 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:27.153449 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:27.156780 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:27.178805 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:27.187360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:27.201295 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:27.277347 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Took 2.15 seconds to destroy the instance on the hypervisor.
May 27 23:04:27.277347 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:04:27.277347 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:04:27.277347 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:04:27.277347 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:27.377877 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:27.528811 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:27.616963 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923067.61644, 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:27.617324 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] VM Started (Lifecycle Event)
May 27 23:04:27.618858 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:04:27.621863 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:04:27.624876 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Instance spawned successfully.
May 27 23:04:27.624876 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:04:27.655358 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b8ba31e-bbf9-4340-a4f0-be9e7ad14ea2 req-1fefd67c-1fb0-42ad-bbc9-32ae17af322b service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-deleted-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:27.655507 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-3b8ba31e-bbf9-4340-a4f0-be9e7ad14ea2 req-1fefd67c-1fb0-42ad-bbc9-32ae17af322b service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Neutron deleted interface fe17e03b-0353-4478-8ccb-48bb8622d814; detaching it from the instance and deleting it from the info cache
May 27 23:04:27.662072 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Creating config drive at /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.config
May 27 23:04:27.663712 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b8ba31e-bbf9-4340-a4f0-be9e7ad14ea2 req-1fefd67c-1fb0-42ad-bbc9-32ae17af322b service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Detach interface failed, port_id=fe17e03b-0353-4478-8ccb-48bb8622d814, reason: Instance 7cb7c255-4b3c-493e-9a31-e554576a0525 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:04:27.670349 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpexegnmds {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:27.688675 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.750s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:27.716362 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpexegnmds" returned: 0 in 0.046s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:27.745134 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Deleted allocations for instance 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539
May 27 23:04:28.102637 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:28.120641 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:28.123343 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:28.132656 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:28.132656 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:28.132656 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:28.132656 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:28.132656 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:28.132656 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:28.218870 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:28.251073 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:28.307545 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:28.344466 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:28.379229 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:28.383010 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:28.425288 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-280d2251-e6df-4a22-810a-4ae38a1cac81 req-96388fbc-df13-4d9a-866c-9671f05aa71d service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:28.425615 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-280d2251-e6df-4a22-810a-4ae38a1cac81 req-96388fbc-df13-4d9a-866c-9671f05aa71d service nova] Acquiring lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:28.425852 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-280d2251-e6df-4a22-810a-4ae38a1cac81 req-96388fbc-df13-4d9a-866c-9671f05aa71d service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:28.425980 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-280d2251-e6df-4a22-810a-4ae38a1cac81 req-96388fbc-df13-4d9a-866c-9671f05aa71d service nova] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:28.426091 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-280d2251-e6df-4a22-810a-4ae38a1cac81 req-96388fbc-df13-4d9a-866c-9671f05aa71d service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] No waiting events found dispatching network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:28.426203 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-280d2251-e6df-4a22-810a-4ae38a1cac81 req-96388fbc-df13-4d9a-866c-9671f05aa71d service nova] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Received event network-vif-unplugged-fe17e03b-0353-4478-8ccb-48bb8622d814 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:28.532048 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:28.533494 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:28.533494 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:28.533494 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No VIF found with MAC fa:16:3e:33:92:45, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:04:28.533494 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Using config drive
May 27 23:04:28.605231 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Took 1.33 seconds to deallocate network for instance.
May 27 23:04:28.628780 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:04:28.629101 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923068.628913, 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:28.629205 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] VM Paused (Lifecycle Event)
May 27 23:04:28.642874 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Took 8.27 seconds to spawn the instance on the hypervisor.
May 27 23:04:28.647351 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:28.759806 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-925e7d83-0df5-409c-8d13-7e5c8da0e760 tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Lock "0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.784s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:29.037787 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'ec2_ids' on Instance uuid 09a47014-23a8-4dad-ab17-6df274ed8cf7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:29.132942 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:29.136224 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923069.135046, 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:29.136224 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] VM Resumed (Lifecycle Event)
May 27 23:04:29.161092 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Took 14.44 seconds to build instance.
May 27 23:04:29.169238 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Took 0.56 seconds to detach 1 volumes for instance.
May 27 23:04:29.171594 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Deleting volume: 7b3985f1-9dc4-481b-9837-6caf308cc632 {{(pid=98289) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 23:04:29.287188 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3012b7ae-345b-43b9-9a57-3e6998db102a req-f9222b7d-985e-4c9a-8896-26c4beb45e10 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:29.287188 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3012b7ae-345b-43b9-9a57-3e6998db102a req-f9222b7d-985e-4c9a-8896-26c4beb45e10 service nova] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:29.287188 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3012b7ae-345b-43b9-9a57-3e6998db102a req-f9222b7d-985e-4c9a-8896-26c4beb45e10 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:29.287188 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3012b7ae-345b-43b9-9a57-3e6998db102a req-f9222b7d-985e-4c9a-8896-26c4beb45e10 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:29.287359 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3012b7ae-345b-43b9-9a57-3e6998db102a req-f9222b7d-985e-4c9a-8896-26c4beb45e10 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] No waiting events found dispatching network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:29.287359 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3012b7ae-345b-43b9-9a57-3e6998db102a req-f9222b7d-985e-4c9a-8896-26c4beb45e10 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received unexpected event network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 for instance with vm_state active and task_state None.
May 27 23:04:29.463213 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:29.539431 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Object Instance<09a47014-23a8-4dad-ab17-6df274ed8cf7> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:04:29.539431 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'keypairs' on Instance uuid 09a47014-23a8-4dad-ab17-6df274ed8cf7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:29.637591 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:29.639196 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:29.662405 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-94127ec5-e575-480b-9c1f-7ea8f9e1f0db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.950s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:29.748356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:29.748950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:29.821644 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "848a1295-d91a-4522-bf36-7d6843c01a28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:29.821894 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:30.044151 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Object Instance<09a47014-23a8-4dad-ab17-6df274ed8cf7> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:04:30.048084 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 27 23:04:30.144108 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923070.1438146, a6723b2d-e0b1-495c-910d-3ef37d877c05 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:30.144310 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] VM Started (Lifecycle Event)
May 27 23:04:30.220915 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Creating config drive at /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.config
May 27 23:04:30.231904 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxvior33q {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:30.288053 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxvior33q" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:30.328252 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:04:30.400457 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:30.400708 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:30.646711 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:30.649709 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923070.6495094, a6723b2d-e0b1-495c-910d-3ef37d877c05 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:30.649831 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] VM Paused (Lifecycle Event)
May 27 23:04:30.717880 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0005025210000439984 future=<Future at 0x726e387537d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:30.718057 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:30.718134 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.7960470599998644 future=<Future at 0x726e387a1760 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:30.718214 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.7959557029998905 future=<Future at 0x726e387a1760 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:30.718520 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Emitting event <LifecycleEvent: 1779923055.717224, 09a47014-23a8-4dad-ab17-6df274ed8cf7 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:30.718713 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] VM Stopped (Lifecycle Event)
May 27 23:04:30.763315 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:30.786645 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:30.878469 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:30.883780 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:30.903590 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:30.939165 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:30.940239 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:31.010304 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d4e51919-258d-4e98-aa6a-982111259936 req-1e2c4d1c-44b7-4733-b122-86dec96de9b5 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:31.010528 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d4e51919-258d-4e98-aa6a-982111259936 req-1e2c4d1c-44b7-4733-b122-86dec96de9b5 service nova] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:31.010799 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d4e51919-258d-4e98-aa6a-982111259936 req-1e2c4d1c-44b7-4733-b122-86dec96de9b5 service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:31.010952 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d4e51919-258d-4e98-aa6a-982111259936 req-1e2c4d1c-44b7-4733-b122-86dec96de9b5 service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:31.011092 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d4e51919-258d-4e98-aa6a-982111259936 req-1e2c4d1c-44b7-4733-b122-86dec96de9b5 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] No waiting events found dispatching network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:31.011526 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-d4e51919-258d-4e98-aa6a-982111259936 req-1e2c4d1c-44b7-4733-b122-86dec96de9b5 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received unexpected event network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 for instance with vm_state active and task_state rebuild_spawning.
May 27 23:04:31.152176 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:31.157281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:31.222012 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:31.360801 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7a69f360-dec9-4109-80ea-43259ed2c49e req-3924de02-274a-4a9a-9f6d-3988721fe5fe service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-changed-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:31.360947 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7a69f360-dec9-4109-80ea-43259ed2c49e req-3924de02-274a-4a9a-9f6d-3988721fe5fe service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Refreshing instance network info cache due to event network-changed-ceb9d24a-c097-4869-8358-4b045b4e9d08. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:04:31.361118 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7a69f360-dec9-4109-80ea-43259ed2c49e req-3924de02-274a-4a9a-9f6d-3988721fe5fe service nova] Acquiring lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:31.361228 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7a69f360-dec9-4109-80ea-43259ed2c49e req-3924de02-274a-4a9a-9f6d-3988721fe5fe service nova] Acquired lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:31.361277 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7a69f360-dec9-4109-80ea-43259ed2c49e req-3924de02-274a-4a9a-9f6d-3988721fe5fe service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Refreshing network info cache for port ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:04:31.409483 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.661s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:31.414351 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.526s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:31.414351 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:04:31.414351 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Claim successful on node np0000001565
May 27 23:04:31.463566 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Deleted allocations for instance 7cb7c255-4b3c-493e-9a31-e554576a0525
May 27 23:04:31.528426 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Instance event wait completed in 0 seconds for  {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:04:31.528611 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:04:31.531017 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Instance spawned successfully.
May 27 23:04:31.531437 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:04:31.660744 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:04:31.660744 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923071.6597443, 09a47014-23a8-4dad-ab17-6df274ed8cf7 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:31.660744 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] VM Resumed (Lifecycle Event)
May 27 23:04:31.863681 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7a69f360-dec9-4109-80ea-43259ed2c49e req-3924de02-274a-4a9a-9f6d-3988721fe5fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:32.007011 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:32.038532 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:32.038748 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:32.039061 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:32.039650 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:32.040015 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:32.040294 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:32.163626 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:32.167186 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:32.208991 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7a69f360-dec9-4109-80ea-43259ed2c49e req-3924de02-274a-4a9a-9f6d-3988721fe5fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:32.346393 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7a69f360-dec9-4109-80ea-43259ed2c49e req-3924de02-274a-4a9a-9f6d-3988721fe5fe service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updated VIF entry in instance network info cache for port ceb9d24a-c097-4869-8358-4b045b4e9d08. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:04:32.346656 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7a69f360-dec9-4109-80ea-43259ed2c49e req-3924de02-274a-4a9a-9f6d-3988721fe5fe service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updating instance_info_cache with network_info: [{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:32.470757 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7261b138-1af5-4870-a16f-c9b778729574 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "7cb7c255-4b3c-493e-9a31-e554576a0525" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.856s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:32.549932 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:32.670003 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 27 23:04:32.673025 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923072.6727598, 09a47014-23a8-4dad-ab17-6df274ed8cf7 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:32.673526 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] VM Started (Lifecycle Event)
May 27 23:04:32.849161 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7a69f360-dec9-4109-80ea-43259ed2c49e req-3924de02-274a-4a9a-9f6d-3988721fe5fe service nova] Releasing lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:32.924200 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:32.924719 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:32.951685 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-91071f58-be30-46a7-af20-a60124eceb87 req-dca93859-d9aa-49f2-af14-e07fbfd82f26 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received event network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:32.951886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-91071f58-be30-46a7-af20-a60124eceb87 req-dca93859-d9aa-49f2-af14-e07fbfd82f26 service nova] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:32.952132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-91071f58-be30-46a7-af20-a60124eceb87 req-dca93859-d9aa-49f2-af14-e07fbfd82f26 service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:32.952724 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-91071f58-be30-46a7-af20-a60124eceb87 req-dca93859-d9aa-49f2-af14-e07fbfd82f26 service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:32.952724 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-91071f58-be30-46a7-af20-a60124eceb87 req-dca93859-d9aa-49f2-af14-e07fbfd82f26 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Processing event network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:04:32.954436 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:04:32.963011 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:04:32.965079 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Instance spawned successfully.
May 27 23:04:32.966462 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:04:33.061021 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:33.087790 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a1bcc140-41c3-48ea-b860-a42a67743531 req-1a71ab64-b226-4cdd-bc5d-4b70fb29eb46 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:33.087790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a1bcc140-41c3-48ea-b860-a42a67743531 req-1a71ab64-b226-4cdd-bc5d-4b70fb29eb46 service nova] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:33.087973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a1bcc140-41c3-48ea-b860-a42a67743531 req-1a71ab64-b226-4cdd-bc5d-4b70fb29eb46 service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:33.091352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a1bcc140-41c3-48ea-b860-a42a67743531 req-1a71ab64-b226-4cdd-bc5d-4b70fb29eb46 service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:33.091352 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a1bcc140-41c3-48ea-b860-a42a67743531 req-1a71ab64-b226-4cdd-bc5d-4b70fb29eb46 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] No waiting events found dispatching network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:33.091352 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-a1bcc140-41c3-48ea-b860-a42a67743531 req-1a71ab64-b226-4cdd-bc5d-4b70fb29eb46 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received unexpected event network-vif-plugged-5497c3f3-3f6d-4932-b646-487b60e99781 for instance with vm_state active and task_state None.
May 27 23:04:33.175566 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:33.177814 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:33.311582 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:33.426684 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:33.472819 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:33.472819 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:33.472819 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:33.472819 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:33.472819 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:33.472819 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:33.514662 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00042308100000809645 future=<Future at 0x726e387a1760 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:33.515242 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Emitting event <LifecycleEvent: 1779923058.5141177, 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:33.515456 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:33.515702 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] VM Stopped (Lifecycle Event)
May 27 23:04:33.516432 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0015802199998233846 future=<Future at 0x726e5821a0f0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:33.517673 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0029400739999800862 future=<Future at 0x726e5821a0f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:33.517771 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:33.517899 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=1.6358121789999132 future=<Future at 0x726e385ffa10 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:33.518090 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=1.635669673999928 future=<Future at 0x726e385ffa10 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:33.520322 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Emitting event <LifecycleEvent: 1779923058.5146596, 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:33.520322 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] VM Stopped (Lifecycle Event)
May 27 23:04:33.662359 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:33.662507 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:33.662663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:33.662776 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:33.662877 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:33.664983 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Terminating instance
May 27 23:04:33.683000 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923073.6826468, a6723b2d-e0b1-495c-910d-3ef37d877c05 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:33.683371 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] VM Resumed (Lifecycle Event)
May 27 23:04:33.781072 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:33.933206 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.523s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:33.934418 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:04:33.935722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.875s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:33.937150 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98289) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 27 23:04:33.976171 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Took 10.70 seconds to spawn the instance on the hypervisor.
May 27 23:04:33.976790 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:34.021907 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-dad1daa0-ade3-44db-85ef-b9cfec40831b tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: 0758666e-f4cd-4b0d-9e5b-a8ccd9dcc539] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:34.021907 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 59ef4a49-bfd7-490d-8d17-a371b7ed4c4d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:34.169707 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:04:34.202316 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:34.203187 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:34.207727 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:34.209078 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:34.234057 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:34.237613 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:34.268648 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:34.438709 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:04:34.438843 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:04:34.439075 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:34.439269 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:34.492643 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:34.495161 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Took 19.37 seconds to build instance.
May 27 23:04:34.501789 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:34.526009 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Instance destroyed successfully.
May 27 23:04:34.526475 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lazy-loading 'resources' on Instance uuid efc3328c-5e17-4eb2-b8fb-e645a6805b0e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:34.552409 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b7bee11-63ab-4256-8293-a2e99b1e6796 req-64f34c1b-0bf3-4d12-9d8a-ef7b0987ec9e service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Received event network-vif-unplugged-434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:34.552609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b7bee11-63ab-4256-8293-a2e99b1e6796 req-64f34c1b-0bf3-4d12-9d8a-ef7b0987ec9e service nova] Acquiring lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:34.552852 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b7bee11-63ab-4256-8293-a2e99b1e6796 req-64f34c1b-0bf3-4d12-9d8a-ef7b0987ec9e service nova] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:34.552935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b7bee11-63ab-4256-8293-a2e99b1e6796 req-64f34c1b-0bf3-4d12-9d8a-ef7b0987ec9e service nova] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:34.553056 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b7bee11-63ab-4256-8293-a2e99b1e6796 req-64f34c1b-0bf3-4d12-9d8a-ef7b0987ec9e service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] No waiting events found dispatching network-vif-unplugged-434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:34.554472 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b7bee11-63ab-4256-8293-a2e99b1e6796 req-64f34c1b-0bf3-4d12-9d8a-ef7b0987ec9e service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Received event network-vif-unplugged-434bf486-9c62-458f-b5d4-2be60504d9fd for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:34.591490 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e15e4b45c874974b28db7f3448a3945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b69ef10bedf41b48b1455ae48aa534e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:04:34.714301 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99973495900008 future=<Future at 0x726e58141d00 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:34.955650 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c23d6ce3-3f7c-4ea2-960e-c4a12c72ce0a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.020s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:34.957467 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:04:34.998013 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.879s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:35.029934 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1740959205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverbootfromvolumestablerescuetest-server-1740959205',id=12,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:01:52Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9818a7ed096346eb92128648c4280071',ramdisk_id='',reservation_id='r-qw9738qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-800872693',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:02:04Z,user_data=None,user_id='6037b0819a94463e8e45d96f834c4341',uuid=efc3328c-5e17-4eb2-b8fb-e645a6805b0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "434bf486-9c62-458f-b5d4-2be60504d9fd", "address": "fa:16:3e:1a:5b:46", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap434bf486-9c", "ovs_interfaceid": "434bf486-9c62-458f-b5d4-2be60504d9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:04:35.032934 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converting VIF {"id": "434bf486-9c62-458f-b5d4-2be60504d9fd", "address": "fa:16:3e:1a:5b:46", "network": {"id": "4c8c0cae-a04b-497e-8358-ae60c05e8eed", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1474488013-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9818a7ed096346eb92128648c4280071", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap434bf486-9c", "ovs_interfaceid": "434bf486-9c62-458f-b5d4-2be60504d9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:35.032934 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:46,bridge_name='br-int',has_traffic_filtering=True,id=434bf486-9c62-458f-b5d4-2be60504d9fd,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434bf486-9c') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:35.032934 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:46,bridge_name='br-int',has_traffic_filtering=True,id=434bf486-9c62-458f-b5d4-2be60504d9fd,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434bf486-9c') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:04:35.034733 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:35.035020 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap434bf486-9c, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:35.039363 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:35.039363 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:35.041733 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:35.042374 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:35.042831 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a76ce677-03d1-40fa-9057-705b1e667977) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:35.044833 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:35.045822 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:35.048353 np0000001565 nova-compute[98289]: INFO os_vif [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:46,bridge_name='br-int',has_traffic_filtering=True,id=434bf486-9c62-458f-b5d4-2be60504d9fd,network=Network(4c8c0cae-a04b-497e-8358-ae60c05e8eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434bf486-9c')
May 27 23:04:35.051349 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Deleting instance files /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e_del
May 27 23:04:35.051349 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Deletion of /opt/stack/data/nova/instances/efc3328c-5e17-4eb2-b8fb-e645a6805b0e_del complete
May 27 23:04:35.079502 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7ebed901-71a7-42fc-98fc-9941fc27bcc4 req-c2bf889a-93a8-4ce0-87cd-5b01af51747a service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received event network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:35.080059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7ebed901-71a7-42fc-98fc-9941fc27bcc4 req-c2bf889a-93a8-4ce0-87cd-5b01af51747a service nova] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:35.081732 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7ebed901-71a7-42fc-98fc-9941fc27bcc4 req-c2bf889a-93a8-4ce0-87cd-5b01af51747a service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:35.081913 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7ebed901-71a7-42fc-98fc-9941fc27bcc4 req-c2bf889a-93a8-4ce0-87cd-5b01af51747a service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:35.082057 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7ebed901-71a7-42fc-98fc-9941fc27bcc4 req-c2bf889a-93a8-4ce0-87cd-5b01af51747a service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] No waiting events found dispatching network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:35.082296 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-7ebed901-71a7-42fc-98fc-9941fc27bcc4 req-c2bf889a-93a8-4ce0-87cd-5b01af51747a service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received unexpected event network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 for instance with vm_state active and task_state None.
May 27 23:04:35.153997 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003009600000041246 future=<Future at 0x726e385ffa10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:35.154090 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:35.154238 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.274590220999926 future=<Future at 0x726e38795160 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:35.154238 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.274504475999947 future=<Future at 0x726e38795160 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:35.160617 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Emitting event <LifecycleEvent: 1779923060.153587, 80c6eabe-0192-4030-a194-2d87bb638464 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:35.160617 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] VM Stopped (Lifecycle Event)
May 27 23:04:35.254545 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Successfully created port: 7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:04:35.461471 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:04:35.557295 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 23:04:35.558248 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:04:35.558606 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:04:35.558763 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:04:35.559077 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:35.672397 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 80c6eabe-0192-4030-a194-2d87bb638464] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:35.839656 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Successfully updated port: 7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:04:35.919795 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:35.975981 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:36.019163 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5059bd79-7f63-4393-9331-ef86ff3dccfa req-d349e34a-ef37-46ff-9b86-777f633369b9 service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Received event network-changed-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:36.019163 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5059bd79-7f63-4393-9331-ef86ff3dccfa req-d349e34a-ef37-46ff-9b86-777f633369b9 service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Refreshing instance network info cache due to event network-changed-7f7e54f9-e9ef-4d69-b587-5a09865c22a2. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:04:36.019163 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5059bd79-7f63-4393-9331-ef86ff3dccfa req-d349e34a-ef37-46ff-9b86-777f633369b9 service nova] Acquiring lock "refresh_cache-848a1295-d91a-4522-bf36-7d6843c01a28" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:36.019163 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5059bd79-7f63-4393-9331-ef86ff3dccfa req-d349e34a-ef37-46ff-9b86-777f633369b9 service nova] Acquired lock "refresh_cache-848a1295-d91a-4522-bf36-7d6843c01a28" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:36.019163 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5059bd79-7f63-4393-9331-ef86ff3dccfa req-d349e34a-ef37-46ff-9b86-777f633369b9 service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Refreshing network info cache for port 7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:04:36.045032 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:36.349364 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "refresh_cache-848a1295-d91a-4522-bf36-7d6843c01a28" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:36.474195 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:04:36.475404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:04:36.475709 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Creating image(s)
May 27 23:04:36.476265 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "/opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:36.477655 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:36.477965 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:36.478984 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:36.485844 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:36.487649 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:36.524354 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5059bd79-7f63-4393-9331-ef86ff3dccfa req-d349e34a-ef37-46ff-9b86-777f633369b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:36.595473 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.108s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:36.596521 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:36.596959 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:36.597372 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:36.602076 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:36.602422 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:36.628106 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5059bd79-7f63-4393-9331-ef86ff3dccfa req-d349e34a-ef37-46ff-9b86-777f633369b9 service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:04:36.650823 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b8b7cc13-a646-49f3-b5fa-b908f595385b req-afa7c666-97c7-49db-9fa8-8cf8bb5a40ef service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Received event network-vif-unplugged-434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:36.654285 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b8b7cc13-a646-49f3-b5fa-b908f595385b req-afa7c666-97c7-49db-9fa8-8cf8bb5a40ef service nova] Acquiring lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:36.654285 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b8b7cc13-a646-49f3-b5fa-b908f595385b req-afa7c666-97c7-49db-9fa8-8cf8bb5a40ef service nova] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:36.654285 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b8b7cc13-a646-49f3-b5fa-b908f595385b req-afa7c666-97c7-49db-9fa8-8cf8bb5a40ef service nova] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:36.654285 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b8b7cc13-a646-49f3-b5fa-b908f595385b req-afa7c666-97c7-49db-9fa8-8cf8bb5a40ef service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] No waiting events found dispatching network-vif-unplugged-434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:36.654285 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b8b7cc13-a646-49f3-b5fa-b908f595385b req-afa7c666-97c7-49db-9fa8-8cf8bb5a40ef service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Received event network-vif-unplugged-434bf486-9c62-458f-b5d4-2be60504d9fd for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:04:36.716045 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.113s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:36.716797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:36.765978 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:36.771200 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk 1073741824" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:36.771891 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:36.772383 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:36.857923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:36.861350 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:04:36.861350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:36.887803 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5059bd79-7f63-4393-9331-ef86ff3dccfa req-d349e34a-ef37-46ff-9b86-777f633369b9 service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:36.980509 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:36.981398 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Cannot resize image /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:04:36.982359 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:04:36.982359 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Ensure instance console log exists: /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:04:36.982570 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:36.983209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:36.983484 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:37.196089 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Received event network-vif-deleted-434bf486-9c62-458f-b5d4-2be60504d9fd {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:37.197000 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-changed-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:37.197000 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Refreshing instance network info cache due to event network-changed-e837edcc-48f7-475e-ab37-e584deffe1c5. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:04:37.197000 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] Acquiring lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:37.197156 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] Acquired lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:37.197422 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Refreshing network info cache for port e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:04:37.273324 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Took 1.71 seconds to deallocate network for instance.
May 27 23:04:37.391964 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5059bd79-7f63-4393-9331-ef86ff3dccfa req-d349e34a-ef37-46ff-9b86-777f633369b9 service nova] Releasing lock "refresh_cache-848a1295-d91a-4522-bf36-7d6843c01a28" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:37.392807 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquired lock "refresh_cache-848a1295-d91a-4522-bf36-7d6843c01a28" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:37.393013 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:04:37.702601 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:37.782855 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:37.783116 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:38.030884 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:04:38.155422 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:38.312075 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:38.320600 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:38.370264 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updated VIF entry in instance network info cache for port e837edcc-48f7-475e-ab37-e584deffe1c5. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:04:38.370264 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating instance_info_cache with network_info: [{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:38.455242 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:38.455242 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:38.523191 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Updating instance_info_cache with network_info: [{"id": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "address": "fa:16:3e:a3:45:83", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7e54f9-e9", "ovs_interfaceid": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:38.850871 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:38.872254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] Releasing lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:38.872505 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received event network-changed-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:38.872604 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Refreshing instance network info cache due to event network-changed-112f36c6-7fa0-4a72-9edf-c9421eccd857. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:04:38.872747 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] Acquiring lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:38.872837 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] Acquired lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:38.872940 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Refreshing network info cache for port 112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:04:38.883911 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:38.884608 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:38.956687 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:39.027795 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Releasing lock "refresh_cache-848a1295-d91a-4522-bf36-7d6843c01a28" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:39.028017 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Instance network_info: |[{"id": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "address": "fa:16:3e:a3:45:83", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7e54f9-e9", "ovs_interfaceid": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:04:39.032182 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Start _get_guest_xml network_info=[{"id": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "address": "fa:16:3e:a3:45:83", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7e54f9-e9", "ovs_interfaceid": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:04:39.036744 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:04:39.037923 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-115844144', uuid='848a1295-d91a-4522-bf36-7d6843c01a28'), owner=OwnerMeta(userid='1e15e4b45c874974b28db7f3448a3945', username='tempest-TestEncryptedCinderVolumes-762189049-project-member', projectid='8b69ef10bedf41b48b1455ae48aa534e', projectname='tempest-TestEncryptedCinderVolumes-762189049'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "address": "fa:16:3e:a3:45:83", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7e54f9-e9", "ovs_interfaceid": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923079.0375984) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:04:39.039361 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:04:39.039718 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:04:39.042180 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:04:39.042461 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:04:39.043757 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:04:39.044260 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:04:39.044541 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:04:39.044734 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:04:39.044972 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:04:39.045162 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:04:39.045413 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:04:39.045863 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:04:39.046157 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:04:39.047579 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:04:39.049593 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:04:39.049890 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:04:39.073644 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-115844144',display_name='tempest-TestEncryptedCinderVolumes-server-115844144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-115844144',id=28,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz03M6Pp6+JXVyubKdP/48j2XS6503MAS8sWQc07W5KqxXl1uvnl7zYy8sBIiE5casLSvXJ9DEbyYjOTPnl1HWSQxdK5sCaLFkhMVFtUT8/ZoDQjidA3YWW6H5ehEvarw==',key_name='tempest-keypair-2021354636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-rnmgqdog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=848a1295-d91a-4522-bf36-7d6843c01a28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "address": "fa:16:3e:a3:45:83", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7e54f9-e9", "ovs_interfaceid": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:04:39.073863 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "address": "fa:16:3e:a3:45:83", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7e54f9-e9", "ovs_interfaceid": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:39.074979 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:45:83,bridge_name='br-int',has_traffic_filtering=True,id=7f7e54f9-e9ef-4d69-b587-5a09865c22a2,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7e54f9-e9') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:39.075373 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'pci_devices' on Instance uuid 848a1295-d91a-4522-bf36-7d6843c01a28 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:39.374719 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:39.387547 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid a7839c43-8fd9-4deb-81c9-f128963f09ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:39.464858 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.682s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:39.542404 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Deleted allocations for instance efc3328c-5e17-4eb2-b8fb-e645a6805b0e
May 27 23:04:39.580360 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] End _get_guest_xml xml=<domain type="qemu">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <uuid>848a1295-d91a-4522-bf36-7d6843c01a28</uuid>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <name>instance-0000001c</name>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-115844144</nova:name>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:04:39</nova:creationTime>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:user uuid="1e15e4b45c874974b28db7f3448a3945">tempest-TestEncryptedCinderVolumes-762189049-project-member</nova:user>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:project uuid="8b69ef10bedf41b48b1455ae48aa534e">tempest-TestEncryptedCinderVolumes-762189049</nova:project>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         <nova:port uuid="7f7e54f9-e9ef-4d69-b587-5a09865c22a2">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <system>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <entry name="serial">848a1295-d91a-4522-bf36-7d6843c01a28</entry>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <entry name="uuid">848a1295-d91a-4522-bf36-7d6843c01a28</entry>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     </system>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <os>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   </os>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <features>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   </features>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   <devices>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk.config"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:a3:45:83"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <target dev="tap7f7e54f9-e9"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     </interface>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/console.log" append="off"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     </serial>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <video>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     </video>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     </rng>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:   </devices>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]: </domain>
May 27 23:04:39.580360 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:04:39.580360 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Preparing to wait for external event network-vif-plugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:04:39.580360 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:39.580360 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:39.589269 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:39.589269 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-115844144',display_name='tempest-TestEncryptedCinderVolumes-server-115844144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-115844144',id=28,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz03M6Pp6+JXVyubKdP/48j2XS6503MAS8sWQc07W5KqxXl1uvnl7zYy8sBIiE5casLSvXJ9DEbyYjOTPnl1HWSQxdK5sCaLFkhMVFtUT8/ZoDQjidA3YWW6H5ehEvarw==',key_name='tempest-keypair-2021354636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-rnmgqdog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=848a1295-d91a-4522-bf36-7d6843c01a28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "address": "fa:16:3e:a3:45:83", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7e54f9-e9", "ovs_interfaceid": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:04:39.589269 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "address": "fa:16:3e:a3:45:83", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7e54f9-e9", "ovs_interfaceid": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:39.589269 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:45:83,bridge_name='br-int',has_traffic_filtering=True,id=7f7e54f9-e9ef-4d69-b587-5a09865c22a2,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7e54f9-e9') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:39.589269 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:45:83,bridge_name='br-int',has_traffic_filtering=True,id=7f7e54f9-e9ef-4d69-b587-5a09865c22a2,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7e54f9-e9') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:04:39.589269 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:39.591996 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:39.592798 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:04:39.593771 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:39.596414 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cde807c7-1e40-504d-a6d8-e5bad9cfbe04', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:39.596414 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:39.596414 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:39.598426 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:39.600351 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:39.603351 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f7e54f9-e9, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:39.603351 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f7e54f9-e9, col_values=(('qos', UUID('e048aad4-d680-426d-8c96-84eaaf076a21')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:39.603351 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f7e54f9-e9, col_values=(('external_ids', {'iface-id': '7f7e54f9-e9ef-4d69-b587-5a09865c22a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:45:83', 'vm-uuid': '848a1295-d91a-4522-bf36-7d6843c01a28'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:39.603351 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:39.603351 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:39.608234 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:39.610138 np0000001565 nova-compute[98289]: INFO os_vif [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:45:83,bridge_name='br-int',has_traffic_filtering=True,id=7f7e54f9-e9ef-4d69-b587-5a09865c22a2,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7e54f9-e9')
May 27 23:04:39.699289 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:39.699575 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:39.826126 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:39.967396 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updated VIF entry in instance network info cache for port 112f36c6-7fa0-4a72-9edf-c9421eccd857. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:04:39.967396 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating instance_info_cache with network_info: [{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:40.202139 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:04:40.399551 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:40.429109 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003233560000808211 future=<Future at 0x726e38795160 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:40.429477 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Emitting event <LifecycleEvent: 1779923065.428691, 7cb7c255-4b3c-493e-9a31-e554576a0525 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:40.429619 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] VM Stopped (Lifecycle Event)
May 27 23:04:40.430430 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:40.430702 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.283404702000098 future=<Future at 0x726e58141d00 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:40.430702 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.283326762000115 future=<Future at 0x726e58141d00 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:40.469413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1fac265c-375a-4a0d-9ef8-adfea34cb618 req-8564baad-96c9-4dd8-94ab-9a519e3d587c service nova] Releasing lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:40.551050 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1dbfa7fd-6bf6-4783-834e-a6e2e6903761 tempest-ServerBootFromVolumeStableRescueTest-800872693 tempest-ServerBootFromVolumeStableRescueTest-800872693-project-member] Lock "efc3328c-5e17-4eb2-b8fb-e645a6805b0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.888s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:40.751022 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:40.754671 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:40.759124 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:04:40.759402 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Claim successful on node np0000001565
May 27 23:04:40.931903 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b9b70a49-587f-45d2-af1a-6c70ba506256 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 7cb7c255-4b3c-493e-9a31-e554576a0525] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:41.135194 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:41.135347 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:41.135521 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No VIF found with MAC fa:16:3e:a3:45:83, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:04:41.136163 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Using config drive
May 27 23:04:41.482487 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:41.482906 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:41.482906 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Attaching volume dad32169-263d-43eb-a14f-f0ffa8abca81 to /dev/vdb
May 27 23:04:41.541933 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:41.554733 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:04:41.580058 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:41.627011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:04:41.627384 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:04:41.637090 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:04:41.638919 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:fead:f302', 'fe80::f886:b6ff:fe99:9ebe', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fe33:9245'] 
May 27 23:04:41.639040 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:04:41.639218 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:04:41.639572 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:41.639921 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating existing volume attachment record: 9a666c96-c7bd-44f0-8a92-1e8a31641650 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:04:41.651397 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:41.802857 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Creating config drive at /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk.config
May 27 23:04:41.810878 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwoqe4ngv {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:41.874421 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwoqe4ngv" returned: 0 in 0.063s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:42.215275 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:04:42.215275 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:42.215560 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:42.216060 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:42.216357 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:04:42.230578 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:42.231003 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:42.231817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:42.231817 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:04:42.232050 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:42.232285 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:04:42.249038 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:04:42.249038 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:42.250123 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:04:42.250123 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:42.260451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81] added
May 27 23:04:42.260451 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:04:42.260451 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:42.260451 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:42.260451 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:42.260451 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:42.260451 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:42.260721 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:04:42.260767 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:04:42.260918 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:04:42.264566 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81] added
May 27 23:04:42.264566 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:04:42.264566 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:42.264566 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:42.264566 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:04:42.264566 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:04:42.264566 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:42.264792 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:04:42.265549 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:04:42.265725 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:04:42.266989 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:42.267210 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:42.372855 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:42.399859 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:42.520683 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:42.737060 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:42.740159 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:42.742427 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:42.766570 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:42.771279 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:42.798320 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8af4708d-a867-40eb-bb04-2d24a4fff279 req-410a2af8-1125-4ef8-9bcd-160aa7cb4a77 service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Received event network-vif-plugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:42.799825 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8af4708d-a867-40eb-bb04-2d24a4fff279 req-410a2af8-1125-4ef8-9bcd-160aa7cb4a77 service nova] Acquiring lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:42.800738 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8af4708d-a867-40eb-bb04-2d24a4fff279 req-410a2af8-1125-4ef8-9bcd-160aa7cb4a77 service nova] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:42.800738 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8af4708d-a867-40eb-bb04-2d24a4fff279 req-410a2af8-1125-4ef8-9bcd-160aa7cb4a77 service nova] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:42.800738 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8af4708d-a867-40eb-bb04-2d24a4fff279 req-410a2af8-1125-4ef8-9bcd-160aa7cb4a77 service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Processing event network-vif-plugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:04:43.265145 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:04:43.268203 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:04:43.280871 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:04:43.280871 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:43.283209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.529s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:43.283659 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:04:43.287021 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:04:43.287021 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:43.297950 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:43.307619 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:43.316662 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.316662 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.316662 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.316662 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.316662 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:43.316927 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.316927 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.316927 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.316927 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.316927 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:43.327047 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.327047 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.327047 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.327047 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.327047 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:43.327307 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.327307 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.327307 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.327307 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.327307 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:43.365676 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:04:43.366710 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923083.3657556, 848a1295-d91a-4522-bf36-7d6843c01a28 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:43.368099 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] VM Started (Lifecycle Event)
May 27 23:04:43.370052 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:43.373958 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81, portal: 192.168.50.100,3260]
May 27 23:04:43.373958 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81, portal: 192.168.50.100,3260] successful.
May 27 23:04:43.373958 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:43.373958 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:04:43.376673 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81, portal: 192.168.40.100,3260]
May 27 23:04:43.376673 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81, portal: 192.168.40.100,3260] successful.
May 27 23:04:43.376673 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:43.380302 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Instance spawned successfully.
May 27 23:04:43.380302 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:04:43.394146 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:43.399061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:43.409881 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.409881 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.409881 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.409881 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.409881 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:43.409881 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:43.409881 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:43.410244 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.410244 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.410244 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.410244 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.410244 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:43.410244 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:43.410244 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:43.410244 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:43.410244 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:04:43.410244 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('7', '-', '-', 0) found on session 44 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:04:43.410244 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:43.418862 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:43.419567 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:43.419567 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:04:43.420107 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('8', '-', '-', 0) found on session 45 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:04:43.420250 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:04:43.432464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 44 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:04:43.432464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:04:43.438995 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 45 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:04:43.438995 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:04:43.795885 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:04:43.796451 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:04:43.796451 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:43.796732 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:43.874456 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:43.881950 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:43.891875 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:43.891875 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:43.892058 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:43.892417 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:43.892770 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:43.893256 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:43.937368 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '079fa79ceda94eba85570c510d7e8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9dde83267d415abbd137e795ac45e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:04:44.232576 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:04:44.299233 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:04:44.390345 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:04:44.390541 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923084.3904052, 848a1295-d91a-4522-bf36-7d6843c01a28 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:44.390644 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] VM Paused (Lifecycle Event)
May 27 23:04:44.400709 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Took 7.93 seconds to spawn the instance on the hypervisor.
May 27 23:04:44.400920 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:44.602927 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:44.802471 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:04:44.889399 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1f400a0b-6bbd-452e-bc50-faf2eadf73bd req-cdfd925c-6a48-4951-9610-ebb5dbad32a1 service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Received event network-vif-plugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:44.889624 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1f400a0b-6bbd-452e-bc50-faf2eadf73bd req-cdfd925c-6a48-4951-9610-ebb5dbad32a1 service nova] Acquiring lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:44.889851 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1f400a0b-6bbd-452e-bc50-faf2eadf73bd req-cdfd925c-6a48-4951-9610-ebb5dbad32a1 service nova] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:44.889989 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1f400a0b-6bbd-452e-bc50-faf2eadf73bd req-cdfd925c-6a48-4951-9610-ebb5dbad32a1 service nova] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:44.890108 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1f400a0b-6bbd-452e-bc50-faf2eadf73bd req-cdfd925c-6a48-4951-9610-ebb5dbad32a1 service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] No waiting events found dispatching network-vif-plugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:44.890255 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-1f400a0b-6bbd-452e-bc50-faf2eadf73bd req-cdfd925c-6a48-4951-9610-ebb5dbad32a1 service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Received unexpected event network-vif-plugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 for instance with vm_state active and task_state None.
May 27 23:04:44.897487 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:44.905324 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923084.9038975, 848a1295-d91a-4522-bf36-7d6843c01a28 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:44.905324 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] VM Resumed (Lifecycle Event)
May 27 23:04:44.916691 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Took 14.08 seconds to build instance.
May 27 23:04:45.060756 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Successfully created port: a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:04:45.118988 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:04:45.119931 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:04:45.124053 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:04:45.257133 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:45.266182 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found WWN 3300000004f18c080 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:04:45.266182 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:45.266182 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '3300000004f18c080', 'path': '/dev/dm-0', 'multipath_id': '3300000004f18c080'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:45.266523 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004f18c080', 'path': '/dev/dm-0', 'multipath_id': '3300000004f18c080'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:04:45.274798 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid a7839c43-8fd9-4deb-81c9-f128963f09ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:45.406893 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:45.409193 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:45.418237 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.596s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:45.628087 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:45.628369 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:45.628476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:45.629288 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:04:45.755211 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Successfully updated port: a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:04:45.777304 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Attempting to attach volume dad32169-263d-43eb-a14f-f0ffa8abca81 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:04:45.778576 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:04:45.778576 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:04:45.778576 np0000001565 nova-compute[98289]:   <alias name="ua-dad32169-263d-43eb-a14f-f0ffa8abca81"/>
May 27 23:04:45.778576 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:04:45.778576 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:04:45.778576 np0000001565 nova-compute[98289]:   <serial>dad32169-263d-43eb-a14f-f0ffa8abca81</serial>
May 27 23:04:45.778576 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:04:45.778576 np0000001565 nova-compute[98289]: </disk>
May 27 23:04:45.778576 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:04:45.813869 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:04:45.816072 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:04:45.816480 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Creating image(s)
May 27 23:04:45.816759 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:45.816930 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:45.819942 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:45.821465 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:45.826701 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:45.828941 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:45.853652 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-96caa171-b27e-4079-98f2-537204fd5256 req-84fc07d5-730b-4368-be2f-f7fb6ccbcd19 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-changed-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:45.854476 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-96caa171-b27e-4079-98f2-537204fd5256 req-84fc07d5-730b-4368-be2f-f7fb6ccbcd19 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Refreshing instance network info cache due to event network-changed-a298890f-00ec-4f5b-9f68-df34a845fd8f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:04:45.854476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-96caa171-b27e-4079-98f2-537204fd5256 req-84fc07d5-730b-4368-be2f-f7fb6ccbcd19 service nova] Acquiring lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:45.855254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-96caa171-b27e-4079-98f2-537204fd5256 req-84fc07d5-730b-4368-be2f-f7fb6ccbcd19 service nova] Acquired lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:45.855563 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-96caa171-b27e-4079-98f2-537204fd5256 req-84fc07d5-730b-4368-be2f-f7fb6ccbcd19 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Refreshing network info cache for port a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:04:45.913207 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:45.913384 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:45.914119 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:45.915261 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:45.919718 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:04:45.920208 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:46.013938 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:46.014411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:46.079209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk 1073741824" returned: 0 in 0.065s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:46.079807 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:46.080251 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:46.186941 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.106s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:46.188228 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:04:46.188228 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:46.257944 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:46.296715 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:46.297219 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Cannot resize image /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:04:46.297642 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:04:46.297856 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Ensure instance console log exists: /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:04:46.298148 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:46.298368 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:46.298549 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:46.365262 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-96caa171-b27e-4079-98f2-537204fd5256 req-84fc07d5-730b-4368-be2f-f7fb6ccbcd19 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:46.483236 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-96caa171-b27e-4079-98f2-537204fd5256 req-84fc07d5-730b-4368-be2f-f7fb6ccbcd19 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:04:46.633287 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-66457de2-d1d9-40e6-8d8b-00555331ee9e req-e6121234-4b13-4712-888b-330703e1e6ab service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Received event network-changed-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:46.634700 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-66457de2-d1d9-40e6-8d8b-00555331ee9e req-e6121234-4b13-4712-888b-330703e1e6ab service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Refreshing instance network info cache due to event network-changed-7f7e54f9-e9ef-4d69-b587-5a09865c22a2. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:04:46.634909 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-66457de2-d1d9-40e6-8d8b-00555331ee9e req-e6121234-4b13-4712-888b-330703e1e6ab service nova] Acquiring lock "refresh_cache-848a1295-d91a-4522-bf36-7d6843c01a28" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:04:46.635024 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-66457de2-d1d9-40e6-8d8b-00555331ee9e req-e6121234-4b13-4712-888b-330703e1e6ab service nova] Acquired lock "refresh_cache-848a1295-d91a-4522-bf36-7d6843c01a28" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:46.635165 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-66457de2-d1d9-40e6-8d8b-00555331ee9e req-e6121234-4b13-4712-888b-330703e1e6ab service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Refreshing network info cache for port 7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:04:46.647751 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-96caa171-b27e-4079-98f2-537204fd5256 req-84fc07d5-730b-4368-be2f-f7fb6ccbcd19 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:46.669580 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:46.756958 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:46.757555 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:46.839200 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:46.843149 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:04:46.845070 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:46.932797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:46.933464 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:47.036265 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:47.040594 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:47.116983 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:47.117464 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:47.139617 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-66457de2-d1d9-40e6-8d8b-00555331ee9e req-e6121234-4b13-4712-888b-330703e1e6ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:47.150524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-96caa171-b27e-4079-98f2-537204fd5256 req-84fc07d5-730b-4368-be2f-f7fb6ccbcd19 service nova] Releasing lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:47.151970 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquired lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:04:47.152258 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:04:47.213551 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:47.215220 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:04:47.220862 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:47.301093 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:47.301578 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:47.393465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:47.399469 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:47.466534 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:47.466712 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:47.466915 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:47.467086 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:4e:05:0c, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:04:47.505861 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-66457de2-d1d9-40e6-8d8b-00555331ee9e req-e6121234-4b13-4712-888b-330703e1e6ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:47.510896 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:47.511452 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:47.606032 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:47.614798 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:47.688898 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-66457de2-d1d9-40e6-8d8b-00555331ee9e req-e6121234-4b13-4712-888b-330703e1e6ab service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Updated VIF entry in instance network info cache for port 7f7e54f9-e9ef-4d69-b587-5a09865c22a2. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:04:47.689382 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-66457de2-d1d9-40e6-8d8b-00555331ee9e req-e6121234-4b13-4712-888b-330703e1e6ab service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Updating instance_info_cache with network_info: [{"id": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "address": "fa:16:3e:a3:45:83", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7e54f9-e9", "ovs_interfaceid": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:47.738607 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:47.739663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:47.757060 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:04:47.829674 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:47.830114 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:04:47.837284 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:47.920826 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:47.921235 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:47.946352 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:48.005553 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:48.008251 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:48.091412 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:48.091810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:48.106192 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updating instance_info_cache with network_info: [{"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:04:48.186820 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:48.193167 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:04:48.194413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:48.211966 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-66457de2-d1d9-40e6-8d8b-00555331ee9e req-e6121234-4b13-4712-888b-330703e1e6ab service nova] Releasing lock "refresh_cache-848a1295-d91a-4522-bf36-7d6843c01a28" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:48.236638 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.042s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:48.237171 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=11258MB free_disk=74.24708938598633GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:04:48.237470 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:48.238654 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:48.238956 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:48.369354 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:48.609688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Releasing lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:04:48.610078 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Instance network_info: |[{"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:04:48.611743 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Start _get_guest_xml network_info=[{"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:04:48.614106 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:04:48.615492 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1943859222', uuid='ad096c70-bfa7-4c5c-88bc-aacf02a9a386'), owner=OwnerMeta(userid='079fa79ceda94eba85570c510d7e8b24', username='tempest-ServerStableDeviceRescueTest-1802307985-project-member', projectid='0a9dde83267d415abbd137e795ac45e9', projectname='tempest-ServerStableDeviceRescueTest-1802307985'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923088.6150432) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:04:48.616775 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:04:48.617175 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:04:48.617995 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:04:48.618243 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:04:48.619221 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:04:48.619677 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:04:48.619936 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:04:48.620094 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:04:48.620287 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:04:48.620368 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:04:48.620469 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:04:48.620617 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:04:48.620709 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:04:48.620823 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:04:48.620920 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:04:48.621079 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:04:48.632606 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1943859222',display_name='tempest-ServerStableDeviceRescueTest-server-1943859222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverstabledevicerescuetest-server-1943859222',id=29,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4U9ViTrCULeRb7mQ/X1fO1QgXgc1LqIgnb6WCOaeMGhLLzqC0QHpKJ1Bbctl4NVcIQtYWdUqUMmwvYfkC1eR3iPLLrQTNmpQGvAlfRR6KOUaB1y+iwgjbjpPeOqqREDQ==',key_name='tempest-keypair-1511877382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a9dde83267d415abbd137e795ac45e9',ramdisk_id='',reservation_id='r-ereta0ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1802307985',owner_user_name='tempest-ServerStableDeviceRescueTest-1802307985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='079fa79ceda94eba85570c510d7e8b24',uuid=ad096c70-bfa7-4c5c-88bc-aacf02a9a386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:04:48.632863 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Converting VIF {"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:48.633507 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c5:82,bridge_name='br-int',has_traffic_filtering=True,id=a298890f-00ec-4f5b-9f68-df34a845fd8f,network=Network(72b5d6af-fd17-4011-9ac7-d7d70cf9f85f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa298890f-00') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:48.634079 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'pci_devices' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:48.857126 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:48.857350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:49.023850 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00a66336-7e6a-473e-b721-9dc38315b723 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.541s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:49.139399 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] End _get_guest_xml xml=<domain type="qemu">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <uuid>ad096c70-bfa7-4c5c-88bc-aacf02a9a386</uuid>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <name>instance-0000001d</name>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1943859222</nova:name>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:04:48</nova:creationTime>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:user uuid="079fa79ceda94eba85570c510d7e8b24">tempest-ServerStableDeviceRescueTest-1802307985-project-member</nova:user>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:project uuid="0a9dde83267d415abbd137e795ac45e9">tempest-ServerStableDeviceRescueTest-1802307985</nova:project>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         <nova:port uuid="a298890f-00ec-4f5b-9f68-df34a845fd8f">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <system>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <entry name="serial">ad096c70-bfa7-4c5c-88bc-aacf02a9a386</entry>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <entry name="uuid">ad096c70-bfa7-4c5c-88bc-aacf02a9a386</entry>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     </system>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <os>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   </os>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <features>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   </features>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   <devices>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.config"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     </disk>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:4e:c5:82"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <target dev="tapa298890f-00"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     </interface>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/console.log" append="off"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     </serial>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <video>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     </video>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     </rng>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:   </devices>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]: </domain>
May 27 23:04:49.139399 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:04:49.141707 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Preparing to wait for external event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:04:49.141707 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:49.141707 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:49.141707 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:49.141844 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1943859222',display_name='tempest-ServerStableDeviceRescueTest-server-1943859222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverstabledevicerescuetest-server-1943859222',id=29,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4U9ViTrCULeRb7mQ/X1fO1QgXgc1LqIgnb6WCOaeMGhLLzqC0QHpKJ1Bbctl4NVcIQtYWdUqUMmwvYfkC1eR3iPLLrQTNmpQGvAlfRR6KOUaB1y+iwgjbjpPeOqqREDQ==',key_name='tempest-keypair-1511877382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a9dde83267d415abbd137e795ac45e9',ramdisk_id='',reservation_id='r-ereta0ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1802307985',owner_user_name='tempest-ServerStableDeviceRescueTest-1802307985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='079fa79ceda94eba85570c510d7e8b24',uuid=ad096c70-bfa7-4c5c-88bc-aacf02a9a386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:04:49.142346 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Converting VIF {"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:04:49.142791 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c5:82,bridge_name='br-int',has_traffic_filtering=True,id=a298890f-00ec-4f5b-9f68-df34a845fd8f,network=Network(72b5d6af-fd17-4011-9ac7-d7d70cf9f85f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa298890f-00') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:04:49.143133 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c5:82,bridge_name='br-int',has_traffic_filtering=True,id=a298890f-00ec-4f5b-9f68-df34a845fd8f,network=Network(72b5d6af-fd17-4011-9ac7-d7d70cf9f85f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa298890f-00') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:04:49.143597 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:49.143798 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:49.144027 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:04:49.145252 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:49.145424 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd916b66f-e120-51ee-acd2-026cb693495d', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:49.146223 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:49.146874 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:49.147936 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:49.150035 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:49.150182 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa298890f-00, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:49.150504 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa298890f-00, col_values=(('qos', UUID('d22cc19d-362e-4648-951f-ea7a4b8b7f5d')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:49.150623 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa298890f-00, col_values=(('external_ids', {'iface-id': 'a298890f-00ec-4f5b-9f68-df34a845fd8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:c5:82', 'vm-uuid': 'ad096c70-bfa7-4c5c-88bc-aacf02a9a386'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:04:49.151345 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:49.152347 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:04:49.157753 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:49.158920 np0000001565 nova-compute[98289]: INFO os_vif [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c5:82,bridge_name='br-int',has_traffic_filtering=True,id=a298890f-00ec-4f5b-9f68-df34a845fd8f,network=Network(72b5d6af-fd17-4011-9ac7-d7d70cf9f85f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa298890f-00')
May 27 23:04:49.299495 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance f47a00cc-da92-40c9-a668-9a160670addd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:04:49.299611 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 3eb890c1-c528-489f-8109-4b7870bfcf33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:04:49.299747 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6a99f05a-6544-4994-9a1a-d98c320d088a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:04:49.299836 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6ab04c1a-7858-471e-95fd-5b04d1da3061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:04:49.299944 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 09a47014-23a8-4dad-ab17-6df274ed8cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:04:49.300025 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance a7839c43-8fd9-4deb-81c9-f128963f09ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:04:49.300462 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:04:49.300595 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance a6723b2d-e0b1-495c-910d-3ef37d877c05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:04:49.300687 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 848a1295-d91a-4522-bf36-7d6843c01a28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:04:49.300770 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance ad096c70-bfa7-4c5c-88bc-aacf02a9a386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:04:49.300925 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:04:49.301038 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:04:48 up 33 min,  2 users,  load average: 9.54, 6.78, 3.32\n', 'num_instances': '10', 'num_vm_active': '9', 'num_task_None': '9', 'num_os_type_None': '10', 'num_proj_0ec877dc7b2240969ac89c13673f8799': '5', 'io_workload': '1', 'num_proj_d6f15f51479c4e37ab880af2031170be': '2', 'num_proj_475430e1d5044d9b97a65459543a1361': '1', 'num_proj_8b69ef10bedf41b48b1455ae48aa534e': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_0a9dde83267d415abbd137e795ac45e9': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:04:49.362437 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid a6723b2d-e0b1-495c-910d-3ef37d877c05 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:49.715668 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.000435389999893232 future=<Future at 0x726e58141d00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:49.715668 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:04:49.715668 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Emitting event <LifecycleEvent: 1779923074.7139454, efc3328c-5e17-4eb2-b8fb-e645a6805b0e => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:49.715668 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] VM Stopped (Lifecycle Event)
May 27 23:04:49.808765 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:49.857266 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:04:49.857502 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:04:50.218679 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-34467303-da76-4e5a-8ff9-2838ef63f370 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: efc3328c-5e17-4eb2-b8fb-e645a6805b0e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:50.360105 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:04:50.370844 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:50.679609 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:50.679747 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:50.679872 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No VIF found with MAC fa:16:3e:4e:c5:82, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:04:50.680306 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Using config drive
May 27 23:04:50.866572 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:04:50.866764 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.628s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:50.867244 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:04:51.186601 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:04:51.367696 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Creating config drive at /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.config
May 27 23:04:51.371667 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp74dt6qa5 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:51.420320 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp74dt6qa5" returned: 0 in 0.048s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:04:51.432035 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:51.432625 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:51.432716 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Attaching volume dad32169-263d-43eb-a14f-f0ffa8abca81 to /dev/vdb
May 27 23:04:51.486855 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:51.501804 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:04:51.528963 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:04:51.580258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:04:51.580913 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:04:51.590067 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:04:51.592109 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:fead:f302', 'fe80::f886:b6ff:fe99:9ebe', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fe33:9245', 'fe80::fc16:3eff:fea3:4583', 'fe80::4cb6:a6ff:feaf:184a'] 
May 27 23:04:51.592316 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:04:51.592653 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:04:51.593074 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:51.593541 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating existing volume attachment record: e441f55b-be3a-48ce-b55d-95699f2827fd {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:04:51.947208 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:51.985198 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:52.092562 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:52.165609 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:04:52.165609 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:04:52.165609 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:52.166113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:52.168222 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:04:52.183228 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:52.184890 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:04:52.185430 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:52.185603 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:04:52.186047 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:04:52.186281 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:04:52.199305 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:04:52.199305 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:04:52.208259 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:04:52.208259 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:52.214061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:52.219474 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:04:52.228901 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:52.228901 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:52.228901 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:52.228901 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:52.228901 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:52.228901 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:52.228901 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:52.229162 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:52.229162 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:52.229162 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:52.229162 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:52.229162 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:52.229162 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:52.229162 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:52.229378 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.044s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:52.229378 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:04:52.229884 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('8', '0', '0', 0) found on session 45 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:04:52.229987 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:04:52.234399 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:52.234399 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:52.234399 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:52.234399 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:52.234399 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:52.234399 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:52.234399 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:04:52.234638 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:52.234638 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:04:52.234638 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:52.234638 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:04:52.234638 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:52.234638 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:04:52.234638 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:04:52.234853 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.049s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:52.234988 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:04:52.235403 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('7', '0', '0', 0) found on session 44 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:04:52.235504 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:04:52.241433 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 45 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:04:52.241566 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:04:52.243175 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 44 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:04:52.243372 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:04:52.278313 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:52.281879 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:52.305760 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:52.716514 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923092.7160978, ad096c70-bfa7-4c5c-88bc-aacf02a9a386 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:52.716905 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] VM Started (Lifecycle Event)
May 27 23:04:52.867065 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:04:52.867324 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:04:52.867503 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:04:52.867746 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:04:52.867947 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:04:52.868160 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:04:52.868449 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:04:52.868584 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.25 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:04:53.185995 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:04:53.219351 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:53.220795 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923093.2206194, ad096c70-bfa7-4c5c-88bc-aacf02a9a386 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:53.220922 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] VM Paused (Lifecycle Event)
May 27 23:04:53.382486 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:53.722936 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:53.724377 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:54.153473 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:54.203923 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found WWN 3300000004f18c080 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:04:54.206110 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.039s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:04:54.206110 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== connect_volume: return (2040ms) {'type': 'block', 'scsi_wwn': '3300000004f18c080', 'path': '/dev/dm-0', 'multipath_id': '3300000004f18c080'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:04:54.206110 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004f18c080', 'path': '/dev/dm-0', 'multipath_id': '3300000004f18c080'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:04:54.208417 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid a6723b2d-e0b1-495c-910d-3ef37d877c05 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:04:54.228554 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:04:54.711444 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Attempting to attach volume dad32169-263d-43eb-a14f-f0ffa8abca81 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:04:54.712782 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:04:54.712782 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:04:54.712782 np0000001565 nova-compute[98289]:   <alias name="ua-dad32169-263d-43eb-a14f-f0ffa8abca81"/>
May 27 23:04:54.712782 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:04:54.712782 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:04:54.712782 np0000001565 nova-compute[98289]:   <serial>dad32169-263d-43eb-a14f-f0ffa8abca81</serial>
May 27 23:04:54.712782 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:04:54.712782 np0000001565 nova-compute[98289]: </disk>
May 27 23:04:54.712782 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:04:56.244535 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-814b211a-2295-4fd0-aa2b-22d3c07293f0 req-8671bbfa-b575-46e5-b9fa-8d61772d53c5 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:56.245646 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-814b211a-2295-4fd0-aa2b-22d3c07293f0 req-8671bbfa-b575-46e5-b9fa-8d61772d53c5 service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:56.245646 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-814b211a-2295-4fd0-aa2b-22d3c07293f0 req-8671bbfa-b575-46e5-b9fa-8d61772d53c5 service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:56.245646 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-814b211a-2295-4fd0-aa2b-22d3c07293f0 req-8671bbfa-b575-46e5-b9fa-8d61772d53c5 service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:56.245646 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-814b211a-2295-4fd0-aa2b-22d3c07293f0 req-8671bbfa-b575-46e5-b9fa-8d61772d53c5 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Processing event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:04:56.246480 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:04:56.250801 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923096.2494667, ad096c70-bfa7-4c5c-88bc-aacf02a9a386 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:04:56.250801 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] VM Resumed (Lifecycle Event)
May 27 23:04:56.252765 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:04:56.256678 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Instance spawned successfully.
May 27 23:04:56.257397 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:04:56.348320 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:56.386506 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:56.386676 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:56.387698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:04:56.387698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:df:36:53, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:04:56.755348 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:56.756879 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:04:56.767722 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:56.767868 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:56.768211 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:56.768486 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:56.768768 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:56.768998 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:04:57.262133 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:04:57.276237 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Took 11.46 seconds to spawn the instance on the hypervisor.
May 27 23:04:57.276237 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:04:57.784880 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Took 17.08 seconds to build instance.
May 27 23:04:57.951593 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e72e37a9-0f48-4e4e-b0e7-326175813cc4 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.519s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:58.287729 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.587s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:58.324176 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-99699d6e-46b8-44d6-bd8e-91902425e317 req-dfff1fff-f9e3-4524-a409-42031fee800d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:04:58.324413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-99699d6e-46b8-44d6-bd8e-91902425e317 req-dfff1fff-f9e3-4524-a409-42031fee800d service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:04:58.325024 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-99699d6e-46b8-44d6-bd8e-91902425e317 req-dfff1fff-f9e3-4524-a409-42031fee800d service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:04:58.325555 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-99699d6e-46b8-44d6-bd8e-91902425e317 req-dfff1fff-f9e3-4524-a409-42031fee800d service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:04:58.325681 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-99699d6e-46b8-44d6-bd8e-91902425e317 req-dfff1fff-f9e3-4524-a409-42031fee800d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] No waiting events found dispatching network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:04:58.325834 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-99699d6e-46b8-44d6-bd8e-91902425e317 req-dfff1fff-f9e3-4524-a409-42031fee800d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received unexpected event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f for instance with vm_state active and task_state None.
May 27 23:04:58.400517 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:59.155984 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:04:59.868202 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Stashing vm_state: active {{(pid=98289) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 27 23:05:00.400289 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c134a5c3-9e7b-41ac-a5fa-7117d67df371 req-fa7b400e-a2ae-4521-9525-55af4f0d70c0 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-changed-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:00.400749 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c134a5c3-9e7b-41ac-a5fa-7117d67df371 req-fa7b400e-a2ae-4521-9525-55af4f0d70c0 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Refreshing instance network info cache due to event network-changed-a298890f-00ec-4f5b-9f68-df34a845fd8f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:00.400749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c134a5c3-9e7b-41ac-a5fa-7117d67df371 req-fa7b400e-a2ae-4521-9525-55af4f0d70c0 service nova] Acquiring lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:00.400749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c134a5c3-9e7b-41ac-a5fa-7117d67df371 req-fa7b400e-a2ae-4521-9525-55af4f0d70c0 service nova] Acquired lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:00.400749 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c134a5c3-9e7b-41ac-a5fa-7117d67df371 req-fa7b400e-a2ae-4521-9525-55af4f0d70c0 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Refreshing network info cache for port a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:00.430355 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:00.430580 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:00.905962 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-c134a5c3-9e7b-41ac-a5fa-7117d67df371 req-fa7b400e-a2ae-4521-9525-55af4f0d70c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:00.937872 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:05:00.938085 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Claim successful on node np0000001565
May 27 23:05:01.198784 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-c134a5c3-9e7b-41ac-a5fa-7117d67df371 req-fa7b400e-a2ae-4521-9525-55af4f0d70c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:01.315886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:01.316099 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:01.330897 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c134a5c3-9e7b-41ac-a5fa-7117d67df371 req-fa7b400e-a2ae-4521-9525-55af4f0d70c0 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updated VIF entry in instance network info cache for port a298890f-00ec-4f5b-9f68-df34a845fd8f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:05:01.331180 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c134a5c3-9e7b-41ac-a5fa-7117d67df371 req-fa7b400e-a2ae-4521-9525-55af4f0d70c0 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updating instance_info_cache with network_info: [{"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:01.443515 np0000001565 nova-compute[98289]: INFO nova.compute.resource_tracker [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating resource usage from migration 1602a0c8-ec17-437e-a88c-dc3aa02990b1
May 27 23:05:01.819712 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:05:01.833665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c134a5c3-9e7b-41ac-a5fa-7117d67df371 req-fa7b400e-a2ae-4521-9525-55af4f0d70c0 service nova] Releasing lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:02.024566 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:02.024988 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:02.363492 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:02.527418 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:03.033608 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.603s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:03.034076 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.671s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:03.034206 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Migrating
May 27 23:05:03.034444 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:05:03.042874 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:05:03.043067 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Claim successful on node np0000001565
May 27 23:05:03.402753 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:03.551742 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:03.552908 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:03.552908 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:05:04.055834 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:04.157375 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:04.443994 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:04.616835 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating instance_info_cache with network_info: [{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:04.689478 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:04.689697 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:05.121235 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:05.192835 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:05.700779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.667s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:05.701121 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:05:06.206439 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:05:06.206836 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:05:06.206914 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:06.207131 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:06.399550 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b3b7912ee004099b8839d39df504d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b9a9477ae4742b8584b00bec574cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:05:06.638310 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Starting migrate_disk_and_power_off {{(pid=98289) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 27 23:05:06.661907 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:06.663725 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:06.688847 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:06.709832 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:05:06.813548 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:06.818047 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:06.898316 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-52a12c46-1b16-4748-9109-88c3ed08bbaf req-7f7983a4-bc1f-4ce1-8cba-6333881909dc service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:06.898898 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-52a12c46-1b16-4748-9109-88c3ed08bbaf req-7f7983a4-bc1f-4ce1-8cba-6333881909dc service nova] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:06.899044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-52a12c46-1b16-4748-9109-88c3ed08bbaf req-7f7983a4-bc1f-4ce1-8cba-6333881909dc service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:06.899321 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-52a12c46-1b16-4748-9109-88c3ed08bbaf req-7f7983a4-bc1f-4ce1-8cba-6333881909dc service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:06.899459 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-52a12c46-1b16-4748-9109-88c3ed08bbaf req-7f7983a4-bc1f-4ce1-8cba-6333881909dc service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] No waiting events found dispatching network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:06.899583 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-52a12c46-1b16-4748-9109-88c3ed08bbaf req-7f7983a4-bc1f-4ce1-8cba-6333881909dc service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received unexpected event network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 for instance with vm_state active and task_state resize_migrating.
May 27 23:05:06.970545 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999602499000048 future=<Future at 0x726e385ffa10 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:06.971746 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998778640999944 future=<Future at 0x726e385ffa10 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:06.971746 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998571233999883 future=<Future at 0x726e385ffa10 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:06.974353 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Instance destroyed successfully.
May 27 23:05:06.975247 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-0',id=25,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:10Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-wa242kn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a7839c43-8fd9-4deb-81c9-f128963f09ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:4e:05:0c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:05:06.975440 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:4e:05:0c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:06.975960 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:06.976216 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:05:06.977497 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:06.977781 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape837edcc-48, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:06.978995 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:06.979880 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:06.980318 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:06.981376 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:06.981569 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60fddb14-013e-47c6-92f3-c3c6095a5a5d) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:06.982073 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:06.982612 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:06.982995 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:06.984906 np0000001565 nova-compute[98289]: INFO os_vif [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48')
May 27 23:05:07.017774 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully created port: ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:05:07.463513 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully created port: b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:05:07.524127 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Detected multiple connections on this host for volume: dad32169-263d-43eb-a14f-f0ffa8abca81, skipping target disconnect.
May 27 23:05:07.528545 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:07.628036 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:07.628605 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:07.732892 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:07.733791 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:05:07.734895 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec_resize/disk /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:07.828382 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "cp -r /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec_resize/disk /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:07.831913 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec_resize/disk.config /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.config {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:07.869359 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "cp -r /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec_resize/disk.config /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.config" returned: 0 in 0.040s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:07.869886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec_resize/disk.info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.info {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:07.902146 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully created port: 1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:05:07.908762 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "cp -r /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec_resize/disk.info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.info" returned: 0 in 0.039s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:08.222552 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:05:08.389113 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully created port: 823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:05:08.404924 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:08.727925 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Booting with volume 15be4e68-7a48-451f-8f22-d208bcdd4a79 at /dev/vda
May 27 23:05:08.777697 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:08.789630 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:05:08.798918 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully created port: 3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:05:08.815177 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:08.849826 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:05:08.850118 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:05:08.858215 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:05:08.863483 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fead:f302', 'fe80::f886:b6ff:fe99:9ebe', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fe33:9245', 'fe80::fc16:3eff:fea3:4583', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4'] 
May 27 23:05:08.863645 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:05:08.863760 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:05:08.864211 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:08.865993 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating existing volume attachment record: 8e061506-1d51-4975-b265-401db852bb92 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:05:08.994555 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7adad37a-62f5-4405-9c63-dd689bceb03a req-7351b360-6a61-4b9c-bddb-a9339554d1cf service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:08.994858 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7adad37a-62f5-4405-9c63-dd689bceb03a req-7351b360-6a61-4b9c-bddb-a9339554d1cf service nova] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:08.995101 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7adad37a-62f5-4405-9c63-dd689bceb03a req-7351b360-6a61-4b9c-bddb-a9339554d1cf service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:08.995283 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7adad37a-62f5-4405-9c63-dd689bceb03a req-7351b360-6a61-4b9c-bddb-a9339554d1cf service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:08.995529 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7adad37a-62f5-4405-9c63-dd689bceb03a req-7351b360-6a61-4b9c-bddb-a9339554d1cf service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] No waiting events found dispatching network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:08.995741 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-7adad37a-62f5-4405-9c63-dd689bceb03a req-7351b360-6a61-4b9c-bddb-a9339554d1cf service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received unexpected event network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 for instance with vm_state active and task_state resize_migrating.
May 27 23:05:09.045341 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:09.045649 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:09.120708 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Port e837edcc-48f7-475e-ab37-e584deffe1c5 binding to destination host np0000001565 is already ACTIVE {{(pid=98289) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 23:05:09.129015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:09.129215 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:09.129867 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Shelving
May 27 23:05:09.340942 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully updated port: ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:05:09.392008 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cc9259c6-28dd-4d04-8822-6780a620a132 req-e7831795-0d8c-4219-ac83-ce562f311c85 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-changed-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:09.392287 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cc9259c6-28dd-4d04-8822-6780a620a132 req-e7831795-0d8c-4219-ac83-ce562f311c85 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing instance network info cache due to event network-changed-ba433465-ba01-4869-9685-b6c13a640b01. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:09.392458 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cc9259c6-28dd-4d04-8822-6780a620a132 req-e7831795-0d8c-4219-ac83-ce562f311c85 service nova] Acquiring lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:09.392541 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cc9259c6-28dd-4d04-8822-6780a620a132 req-e7831795-0d8c-4219-ac83-ce562f311c85 service nova] Acquired lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:09.392666 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-cc9259c6-28dd-4d04-8822-6780a620a132 req-e7831795-0d8c-4219-ac83-ce562f311c85 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing network info cache for port ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:09.894295 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-cc9259c6-28dd-4d04-8822-6780a620a132 req-e7831795-0d8c-4219-ac83-ce562f311c85 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:09.994367 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-cc9259c6-28dd-4d04-8822-6780a620a132 req-e7831795-0d8c-4219-ac83-ce562f311c85 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:05:10.129197 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:05:10.142422 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:10.149983 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.007s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:10.150254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:10.174834 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-cc9259c6-28dd-4d04-8822-6780a620a132 req-e7831795-0d8c-4219-ac83-ce562f311c85 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:10.177428 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:10.182630 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:10.186876 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:10.186876 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:10.207162 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:10.211610 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:10.234604 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:10.242010 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:10.484109 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Booting with volume 4ce7cd08-1e78-4594-8471-016861339cfc at /dev/vdb
May 27 23:05:10.503910 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999646844999916 future=<Future at 0x726e58603560 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:10.504803 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Instance destroyed successfully.
May 27 23:05:10.505212 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'numa_topology' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:10.519757 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully updated port: 85626fc3-ef41-492d-b3a0-2bb370305172 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:05:10.534034 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:10.548185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:05:10.574391 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:10.616985 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:05:10.618423 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:05:10.631414 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:05:10.631414 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fe33:9245', 'fe80::fc16:3eff:fea3:4583', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4'] 
May 27 23:05:10.631414 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:05:10.631414 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:05:10.631414 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:10.631414 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating existing volume attachment record: 5a7d8eac-1cc8-44f7-8a74-1797dc2e62ea {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:05:10.680128 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cc9259c6-28dd-4d04-8822-6780a620a132 req-e7831795-0d8c-4219-ac83-ce562f311c85 service nova] Releasing lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:10.692783 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Detaching volume 74b600c6-b367-47cd-9bd1-b58615626e8c
May 27 23:05:10.735932 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Attempting to driver detach volume 74b600c6-b367-47cd-9bd1-b58615626e8c from mountpoint /dev/vdb
May 27 23:05:10.743028 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Found disk vdb by alias ua-74b600c6-b367-47cd-9bd1-b58615626e8c {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:05:10.745432 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Found disk vdb by alias ua-74b600c6-b367-47cd-9bd1-b58615626e8c {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:05:10.745572 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Attempting to detach device vdb from instance 09a47014-23a8-4dad-ab17-6df274ed8cf7 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:05:10.745821 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:05:10.745821 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:10.745821 np0000001565 nova-compute[98289]:   <alias name="ua-74b600c6-b367-47cd-9bd1-b58615626e8c"/>
May 27 23:05:10.745821 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-4"/>
May 27 23:05:10.745821 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:05:10.745821 np0000001565 nova-compute[98289]:   <serial>74b600c6-b367-47cd-9bd1-b58615626e8c</serial>
May 27 23:05:10.745821 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:05:10.745821 np0000001565 nova-compute[98289]: </disk>
May 27 23:05:10.745821 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:05:10.751024 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully detached device vdb from instance 09a47014-23a8-4dad-ab17-6df274ed8cf7 from the persistent domain config.
May 27 23:05:10.751113 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] (1/8): Attempting to detach device vdb with device alias ua-74b600c6-b367-47cd-9bd1-b58615626e8c from instance 09a47014-23a8-4dad-ab17-6df274ed8cf7 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:05:10.751373 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:05:10.751373 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:10.751373 np0000001565 nova-compute[98289]:   <alias name="ua-74b600c6-b367-47cd-9bd1-b58615626e8c"/>
May 27 23:05:10.751373 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-4"/>
May 27 23:05:10.751373 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:05:10.751373 np0000001565 nova-compute[98289]:   <serial>74b600c6-b367-47cd-9bd1-b58615626e8c</serial>
May 27 23:05:10.751373 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:05:10.751373 np0000001565 nova-compute[98289]: </disk>
May 27 23:05:10.751373 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:05:11.069681 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:11.069996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:11.070079 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:11.070197 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:11.070328 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] No waiting events found dispatching network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:11.070468 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received unexpected event network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 for instance with vm_state active and task_state shelving.
May 27 23:05:11.071556 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:11.071652 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:11.071817 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:11.071977 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:11.072109 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] No waiting events found dispatching network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:11.072312 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-030adc74-15b0-48f0-917e-add8e978ec7b req-651ff8fc-6da1-4fa7-b78c-f705b5b87bf0 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received unexpected event network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 for instance with vm_state active and task_state shelving.
May 27 23:05:11.136279 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Beginning cold snapshot process
May 27 23:05:11.161818 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:11.260880 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:11.261014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:11.261160 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:05:11.344851 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923111.344512, 09a47014-23a8-4dad-ab17-6df274ed8cf7 => ua-74b600c6-b367-47cd-9bd1-b58615626e8c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:05:11.348531 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-74b600c6-b367-47cd-9bd1-b58615626e8c for instance 09a47014-23a8-4dad-ab17-6df274ed8cf7 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:05:11.351119 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully detached device vdb from instance 09a47014-23a8-4dad-ab17-6df274ed8cf7 from the live domain config.
May 27 23:05:11.352249 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:05:11.352580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:11.352700 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:11.353048 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:11.353345 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74b600c6-b367-47cd-9bd1-b58615626e8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:05:11.353491 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:05:11.380535 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:11.380535 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:11.380535 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:05:11.380535 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:05:11.380535 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:11.380535 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:11.380535 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:11.380730 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:11.380730 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:11.380730 np0000001565 nova-compute[98289]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:05:11.380730 np0000001565 nova-compute[98289]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c (non-flash)
May 27 23:05:11.380730 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:11.380730 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:11.380730 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:11.380881 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '45')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:05:11.380947 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '42')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:05:11.381800 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c', '43')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:05:11.382461 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e587b4360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:05:11.382659 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:05:11.382838 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flush multipath device 33000000043123953 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:05:11.420457 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:05:11.458436 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2d67affe-a6bc-40f6-9b26-1d3ca2366c00 req-4e2a4836-417e-4741-8f88-9bf48fbedbe7 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-changed-85626fc3-ef41-492d-b3a0-2bb370305172 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:11.458593 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2d67affe-a6bc-40f6-9b26-1d3ca2366c00 req-4e2a4836-417e-4741-8f88-9bf48fbedbe7 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing instance network info cache due to event network-changed-85626fc3-ef41-492d-b3a0-2bb370305172. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:11.458731 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2d67affe-a6bc-40f6-9b26-1d3ca2366c00 req-4e2a4836-417e-4741-8f88-9bf48fbedbe7 service nova] Acquiring lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:11.458828 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2d67affe-a6bc-40f6-9b26-1d3ca2366c00 req-4e2a4836-417e-4741-8f88-9bf48fbedbe7 service nova] Acquired lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:11.458904 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2d67affe-a6bc-40f6-9b26-1d3ca2366c00 req-4e2a4836-417e-4741-8f88-9bf48fbedbe7 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing network info cache for port 85626fc3-ef41-492d-b3a0-2bb370305172 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:11.470011 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:05:11.505690 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:05:11.505854 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:05:11.506853 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:05:11.519752 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:05:11.520240 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:05:11.531976 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:11.565242 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.40.100,3260]
May 27 23:05:11.565242 np0000001565 nova-compute[98289]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.40.100,3260] successful.
May 27 23:05:11.565242 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:11.579804 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:11.590857 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:11.611288 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully updated port: 7679fe69-489d-4734-889b-15238db0b2de {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:05:11.619803 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.50.100,3260]
May 27 23:05:11.619803 np0000001565 nova-compute[98289]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-74b600c6-b367-47cd-9bd1-b58615626e8c, portal: 192.168.50.100,3260] successful.
May 27 23:05:11.619803 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:11.633353 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:11.633630 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:11.633801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== disconnect_volume: return (281ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:11.633972 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:05:11.763664 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:11.963392 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2d67affe-a6bc-40f6-9b26-1d3ca2366c00 req-4e2a4836-417e-4741-8f88-9bf48fbedbe7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:11.993517 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:12.087097 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2d67affe-a6bc-40f6-9b26-1d3ca2366c00 req-4e2a4836-417e-4741-8f88-9bf48fbedbe7 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:05:12.093580 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:12.192301 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'flavor' on Instance uuid 09a47014-23a8-4dad-ab17-6df274ed8cf7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:12.250148 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Booting with volume fdccea8d-bfcf-463c-8850-32f83d9f50d6 at /dev/vdc
May 27 23:05:12.259183 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2d67affe-a6bc-40f6-9b26-1d3ca2366c00 req-4e2a4836-417e-4741-8f88-9bf48fbedbe7 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:12.294072 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating instance_info_cache with network_info: [{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:12.298206 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:12.310861 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:05:12.334880 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:12.380926 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:05:12.382628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:05:12.392287 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:05:12.394234 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fe33:9245', 'fe80::fc16:3eff:fea3:4583', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4'] 
May 27 23:05:12.394477 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:05:12.394651 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:05:12.395011 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:12.395322 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating existing volume attachment record: 117a2a31-745f-4346-a40a-35041aa8d8f6 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:05:12.655953 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:05:12.656276 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk /opt/stack/data/nova/instances/snapshots/tmpz_hnnuzd/bb67fae5b5de4c9f82750c7b59061c63 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:12.675885 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully updated port: b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:05:12.717302 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-16c3e4ac-6dd7-46b9-a4da-cca8f6b78d29 req-1b41cc94-eba5-4103-a964-3518cc5ae75c service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-changed-b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:12.717302 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-16c3e4ac-6dd7-46b9-a4da-cca8f6b78d29 req-1b41cc94-eba5-4103-a964-3518cc5ae75c service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing instance network info cache due to event network-changed-b63228fe-f10e-44de-90aa-ff5a303961f1. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:12.717433 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-16c3e4ac-6dd7-46b9-a4da-cca8f6b78d29 req-1b41cc94-eba5-4103-a964-3518cc5ae75c service nova] Acquiring lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:12.761684 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2d67affe-a6bc-40f6-9b26-1d3ca2366c00 req-4e2a4836-417e-4741-8f88-9bf48fbedbe7 service nova] Releasing lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:12.762196 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-16c3e4ac-6dd7-46b9-a4da-cca8f6b78d29 req-1b41cc94-eba5-4103-a964-3518cc5ae75c service nova] Acquired lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:12.762344 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-16c3e4ac-6dd7-46b9-a4da-cca8f6b78d29 req-1b41cc94-eba5-4103-a964-3518cc5ae75c service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing network info cache for port b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:12.795969 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:12.908525 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk /opt/stack/data/nova/instances/snapshots/tmpz_hnnuzd/bb67fae5b5de4c9f82750c7b59061c63" returned: 0 in 0.252s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:12.909606 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Snapshot extracted, beginning image upload
May 27 23:05:13.200595 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-697a2b95-54d1-4cc2-8075-42cbd6ecd70a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.014s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:13.264580 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-16c3e4ac-6dd7-46b9-a4da-cca8f6b78d29 req-1b41cc94-eba5-4103-a964-3518cc5ae75c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:13.311458 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:13.322774 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:05:13.345014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:13.365112 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-16c3e4ac-6dd7-46b9-a4da-cca8f6b78d29 req-1b41cc94-eba5-4103-a964-3518cc5ae75c service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:05:13.389295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:05:13.389295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:05:13.402395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:05:13.404426 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fe33:9245', 'fe80::fc16:3eff:fea3:4583', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4'] 
May 27 23:05:13.404426 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:05:13.404426 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:05:13.404426 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:13.409192 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:13.509133 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:13.509373 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:13.509599 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:13.509690 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:13.510344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:13.515787 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Terminating instance
May 27 23:05:13.546608 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3ec44c0-3feb-4ce5-8438-215b9be53bc1 req-7b569c96-de95-424e-a9ee-1c7da1d2c845 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-changed-7679fe69-489d-4734-889b-15238db0b2de {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:13.547345 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3ec44c0-3feb-4ce5-8438-215b9be53bc1 req-7b569c96-de95-424e-a9ee-1c7da1d2c845 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing instance network info cache due to event network-changed-7679fe69-489d-4734-889b-15238db0b2de. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:13.547631 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3ec44c0-3feb-4ce5-8438-215b9be53bc1 req-7b569c96-de95-424e-a9ee-1c7da1d2c845 service nova] Acquiring lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:13.576607 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-16c3e4ac-6dd7-46b9-a4da-cca8f6b78d29 req-1b41cc94-eba5-4103-a964-3518cc5ae75c service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:13.725733 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully updated port: 1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:05:13.781403 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-51144021-cd98-4388-bdc1-82bcff58db86 req-f79cfc15-f221-4b09-9714-e22baa4f6275 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-changed-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:13.781592 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-51144021-cd98-4388-bdc1-82bcff58db86 req-f79cfc15-f221-4b09-9714-e22baa4f6275 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing instance network info cache due to event network-changed-1964f27a-2f2b-4e91-a8f4-95b400a98ed4. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:13.781761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-51144021-cd98-4388-bdc1-82bcff58db86 req-f79cfc15-f221-4b09-9714-e22baa4f6275 service nova] Acquiring lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:14.022796 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:05:14.054414 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:14.080032 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:14.081132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-16c3e4ac-6dd7-46b9-a4da-cca8f6b78d29 req-1b41cc94-eba5-4103-a964-3518cc5ae75c service nova] Releasing lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:14.081642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3ec44c0-3feb-4ce5-8438-215b9be53bc1 req-7b569c96-de95-424e-a9ee-1c7da1d2c845 service nova] Acquired lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:14.081832 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e3ec44c0-3feb-4ce5-8438-215b9be53bc1 req-7b569c96-de95-424e-a9ee-1c7da1d2c845 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing network info cache for port 7679fe69-489d-4734-889b-15238db0b2de {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:14.241722 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:14.252856 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:14.381807 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999667914999918 future=<Future at 0x726e58602180 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:14.383816 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Instance destroyed successfully.
May 27 23:05:14.384183 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'resources' on Instance uuid 09a47014-23a8-4dad-ab17-6df274ed8cf7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:14.561829 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:05:14.563304 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:05:14.563579 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Creating image(s)
May 27 23:05:14.563970 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:05:14.564157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Ensure instance console log exists: /opt/stack/data/nova/instances/b6529a44-e324-41a7-8db4-fed678008b49/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:05:14.564466 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:14.564654 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:14.564774 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:14.569825 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Starting finish_migration {{(pid=98289) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 27 23:05:14.570685 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Instance directory exists: not creating {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 23:05:14.570778 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Creating image(s)
May 27 23:05:14.571350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:14.594679 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-e3ec44c0-3feb-4ce5-8438-215b9be53bc1 req-7b569c96-de95-424e-a9ee-1c7da1d2c845 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:14.657348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:14.658063 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:05:14.658279 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:14.686517 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e3ec44c0-3feb-4ce5-8438-215b9be53bc1 req-7b569c96-de95-424e-a9ee-1c7da1d2c845 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:05:14.762899 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:14.763258 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Cannot resize image /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:05:14.773536 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:14.774846 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:14.775119 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:14.775259 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:14.775422 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] No waiting events found dispatching network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:14.775565 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:05:14.775661 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:14.775832 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] Acquiring lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:14.775900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:14.776007 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:14.776109 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] No waiting events found dispatching network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:14.776212 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2e8572b9-8cd8-4334-bd7d-0892de978e2c req-e3bced61-d95b-4337-8877-1699a4cbd1df service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-vif-unplugged-5497c3f3-3f6d-4932-b646-487b60e99781 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:05:14.809701 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully updated port: 823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:05:14.865629 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e3ec44c0-3feb-4ce5-8438-215b9be53bc1 req-7b569c96-de95-424e-a9ee-1c7da1d2c845 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:14.889361 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-739387005',display_name='tempest-ServerActionsTestOtherA-server-25719381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-tempest-common-compute-instance-739387005',id=23,image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnodhAb2AYguwUd5MV+nvPGMbjwA3r/emEznS8hSo46pEnn++o3pinPXblU18rNwX+gwoeQytYg7sLDlLIvv2OF+DTWF+VTfmRotWRCucjo1E6Z1kEn1QxneivXH8UZIg==',key_name='tempest-keypair-480643972',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:32Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-l3upe9iv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=09a47014-23a8-4dad-ab17-6df274ed8cf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:05:14.889361 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "5497c3f3-3f6d-4932-b646-487b60e99781", "address": "fa:16:3e:33:92:45", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5497c3f3-3f", "ovs_interfaceid": "5497c3f3-3f6d-4932-b646-487b60e99781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:14.889361 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:14.889361 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:05:14.890074 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:14.890406 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5497c3f3-3f, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:14.893595 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:14.897577 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:14.898150 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:14.898371 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e984adf7-9df6-4d4e-911d-83e7dd296aa7) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:14.900803 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:14.900803 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:14.903504 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:14.905521 np0000001565 nova-compute[98289]: INFO os_vif [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:92:45,bridge_name='br-int',has_traffic_filtering=True,id=5497c3f3-3f6d-4932-b646-487b60e99781,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5497c3f3-3f')
May 27 23:05:14.905880 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Deleting instance files /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7_del
May 27 23:05:14.906937 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Deletion of /opt/stack/data/nova/instances/09a47014-23a8-4dad-ab17-6df274ed8cf7_del complete
May 27 23:05:15.265908 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:05:15.266396 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Ensure instance console log exists: /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:05:15.266491 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:15.266656 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:15.266785 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:15.270117 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Start _get_guest_xml network_info=[{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:4e:05:0c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3b015413-086a-45be-b7f0-47f2d09197a6', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'a7839c43-8fd9-4deb-81c9-f128963f09ec', 'attached_at': '2026-05-27T23:05:13.000000', 'detached_at': '', 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'multiattach': True, 'serial': 'dad32169-263d-43eb-a14f-f0ffa8abca81'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:05:15.274157 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:05:15.275970 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='a7839c43-8fd9-4deb-81c9-f128963f09ec'), owner=OwnerMeta(userid='2c6d94c1e6da4237aa5dd517c31e03d7', username='tempest-AttachVolumeMultiAttachTest-781715127-project-member', projectid='0ec877dc7b2240969ac89c13673f8799', projectname='tempest-AttachVolumeMultiAttachTest-781715127'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:4e:05:0c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923115.2754219) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:05:15.278490 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:05:15.278899 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:05:15.279970 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:05:15.280173 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:05:15.281197 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:05:15.281574 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:05:15.281790 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:05:15.281935 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:05:15.282190 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:05:15.282324 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:05:15.282537 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:05:15.282722 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:05:15.282866 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:05:15.283018 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:05:15.283160 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:05:15.283313 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:05:15.299506 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:15.368051 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3ec44c0-3feb-4ce5-8438-215b9be53bc1 req-7b569c96-de95-424e-a9ee-1c7da1d2c845 service nova] Releasing lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:15.369179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-51144021-cd98-4388-bdc1-82bcff58db86 req-f79cfc15-f221-4b09-9714-e22baa4f6275 service nova] Acquired lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:15.370353 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-51144021-cd98-4388-bdc1-82bcff58db86 req-f79cfc15-f221-4b09-9714-e22baa4f6275 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing network info cache for port 1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:15.390323 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.config --force-share --output=json" returned: 0 in 0.091s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:15.390743 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:15.391110 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:15.391603 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:15.392015 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:05:15.392598 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:15.392697 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:15.393078 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:15.393283 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:05:15.404202 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:15.404586 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:15.405696 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:15.406624 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:15.407178 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:15.407381 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:15.413165 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 23:05:15.414592 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:05:15.417934 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:05:15.417934 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:05:15.417934 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:15.421573 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:15.421573 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:15.427229 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:15.427229 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:15.438529 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:15.440996 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:15.457135 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:15.457135 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.051s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('8', '0', '0', 0) found on session 45 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:15.457135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:15.464564 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:15.464564 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:15.464564 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:15.464564 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:15.464564 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:15.464768 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:15.464768 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:15.464768 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:15.464768 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:15.464768 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:15.465132 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:15.465215 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:15.466230 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 45 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:15.466314 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:15.467004 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('7', '0', '0', 0) found on session 44 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:15.467167 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:15.481843 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 44 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:15.482187 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:15.546697 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:15.663925 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Snapshot image upload complete
May 27 23:05:15.664211 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:15.811825 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Successfully updated port: 3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:05:15.881966 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-51144021-cd98-4388-bdc1-82bcff58db86 req-f79cfc15-f221-4b09-9714-e22baa4f6275 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:15.937592 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2de87d49-e717-4ea7-8695-9a670dc3bd58 req-52bea82b-e4d9-4636-9ac6-d245c7722c56 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Received event network-vif-deleted-5497c3f3-3f6d-4932-b646-487b60e99781 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:15.937724 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-2de87d49-e717-4ea7-8695-9a670dc3bd58 req-52bea82b-e4d9-4636-9ac6-d245c7722c56 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Neutron deleted interface 5497c3f3-3f6d-4932-b646-487b60e99781; detaching it from the instance and deleting it from the info cache
May 27 23:05:15.939071 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2de87d49-e717-4ea7-8695-9a670dc3bd58 req-52bea82b-e4d9-4636-9ac6-d245c7722c56 service nova] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Detach interface failed, port_id=5497c3f3-3f6d-4932-b646-487b60e99781, reason: Instance 09a47014-23a8-4dad-ab17-6df274ed8cf7 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:05:15.974759 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-51144021-cd98-4388-bdc1-82bcff58db86 req-f79cfc15-f221-4b09-9714-e22baa4f6275 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:05:16.145480 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-51144021-cd98-4388-bdc1-82bcff58db86 req-f79cfc15-f221-4b09-9714-e22baa4f6275 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:16.171202 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Shelve offloading
May 27 23:05:16.314930 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:16.399186 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:16.408813 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:05:16.647189 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-51144021-cd98-4388-bdc1-82bcff58db86 req-f79cfc15-f221-4b09-9714-e22baa4f6275 service nova] Releasing lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:16.647633 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquired lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:16.647770 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:05:16.679982 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Instance destroyed successfully.
May 27 23:05:16.680474 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:16.683389 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:16.683511 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquired lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:16.683758 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:05:16.833665 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-changed-823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:16.833665 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing instance network info cache due to event network-changed-823809f8-1026-49bb-bea9-35e7f2b0a606. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:16.833665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] Acquiring lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:16.900257 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Took 1.48 seconds to deallocate network for instance.
May 27 23:05:17.185585 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:17.233303 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:05:17.402459 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:17.405457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:17.405778 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:17.427527 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found WWN 3300000004f18c080 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:05:17.427815 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:17.428002 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== connect_volume: return (2035ms) {'type': 'block', 'scsi_wwn': '3300000004f18c080', 'path': '/dev/dm-0', 'multipath_id': '3300000004f18c080'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:17.428169 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004f18c080', 'path': '/dev/dm-0', 'multipath_id': '3300000004f18c080'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:05:17.499103 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:17.691440 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updating instance_info_cache with network_info: [{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:17.809874 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:17.934218 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='multiattach-server-0',id=25,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:10Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-wa242kn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a7839c43-8fd9-4deb-81c9-f128963f09ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:4e:05:0c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:05:17.934588 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:4e:05:0c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:17.935357 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:17.937543 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] End _get_guest_xml xml=<domain type="qemu">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <uuid>a7839c43-8fd9-4deb-81c9-f128963f09ec</uuid>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <name>instance-00000019</name>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <memory>262144</memory>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <nova:name>multiattach-server-0</nova:name>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:05:15</nova:creationTime>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.micro" id="84">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:memory>256</nova:memory>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:user uuid="2c6d94c1e6da4237aa5dd517c31e03d7">tempest-AttachVolumeMultiAttachTest-781715127-project-member</nova:user>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:project uuid="0ec877dc7b2240969ac89c13673f8799">tempest-AttachVolumeMultiAttachTest-781715127</nova:project>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         <nova:port uuid="e837edcc-48f7-475e-ab37-e584deffe1c5">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <system>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <entry name="serial">a7839c43-8fd9-4deb-81c9-f128963f09ec</entry>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <entry name="uuid">a7839c43-8fd9-4deb-81c9-f128963f09ec</entry>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     </system>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <os>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   </os>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <features>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   </features>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   <devices>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk.config"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <alias name="ua-dad32169-263d-43eb-a14f-f0ffa8abca81"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <serial>dad32169-263d-43eb-a14f-f0ffa8abca81</serial>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <shareable/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:4e:05:0c"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <target dev="tape837edcc-48"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     </interface>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/console.log" append="off"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     </serial>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <video>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     </video>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     </rng>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:   </devices>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]: </domain>
May 27 23:05:17.937543 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:05:17.943737 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='multiattach-server-0',id=25,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:10Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-wa242kn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a7839c43-8fd9-4deb-81c9-f128963f09ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:4e:05:0c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:05:17.943737 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:4e:05:0c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:17.943737 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:17.943737 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:05:17.943737 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:17.943737 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:17.943737 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:05:17.943737 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:17.943737 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f774876-5b3f-554b-9281-4166f66ec1f9', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:17.943737 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:17.944268 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:17.944519 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:17.950385 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:17.955766 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:17.955916 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape837edcc-48, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:17.956217 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape837edcc-48, col_values=(('qos', UUID('04db655f-4701-4065-90e3-a78c5fc5b782')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:17.956373 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape837edcc-48, col_values=(('external_ids', {'iface-id': 'e837edcc-48f7-475e-ab37-e584deffe1c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:05:0c', 'vm-uuid': 'a7839c43-8fd9-4deb-81c9-f128963f09ec'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:17.957311 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:17.958258 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:17.969297 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:17.971031 np0000001565 nova-compute[98289]: INFO os_vif [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48')
May 27 23:05:18.131740 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:18.131998 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:18.183470 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:18.195687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Releasing lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:18.196089 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:18.196347 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:18.420248 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:18.527633 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:18.634923 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:18.715751 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Instance destroyed successfully.
May 27 23:05:18.716490 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'resources' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:18.767201 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-85ce865d-ca74-43a0-84bd-6f44b92ee398 req-8a2a039a-c8e2-4251-bc1e-d163885548d0 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-changed-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:18.767201 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-85ce865d-ca74-43a0-84bd-6f44b92ee398 req-8a2a039a-c8e2-4251-bc1e-d163885548d0 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Refreshing instance network info cache due to event network-changed-ceb9d24a-c097-4869-8358-4b045b4e9d08. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:18.767201 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-85ce865d-ca74-43a0-84bd-6f44b92ee398 req-8a2a039a-c8e2-4251-bc1e-d163885548d0 service nova] Acquiring lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:18.767351 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-85ce865d-ca74-43a0-84bd-6f44b92ee398 req-8a2a039a-c8e2-4251-bc1e-d163885548d0 service nova] Acquired lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:18.767351 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-85ce865d-ca74-43a0-84bd-6f44b92ee398 req-8a2a039a-c8e2-4251-bc1e-d163885548d0 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Refreshing network info cache for port ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:18.837811 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:19.090756 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:19.141770 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.736s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:19.218663 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<2b2f5344-3fbe-469b-bd1f-07b603ac1d33> lazy-loaded attributes: numa_topology,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:05:19.219387 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-142893825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-142893825',id=26,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM62J859+2pEbRLjdd0fhBLRZfGayfP3B5a1x5kH0UqnsmLNgl1KQR/DwJ2a1t/AckJdkTll1d8uU014SH0svwq0a9RyZ286r4Ur1QP2gPVWcPtA6gTS/kM+gxaRXalFIA==',key_name='tempest-keypair-140352231',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:28Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-p40b4hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member',shelved_at='2026-05-27T23:05:15.663973',shelved_host='np0000001565',shelved_image_id='bbac9f2e-6d3e-4928-a8b7-178798b2db6c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:05:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=2b2f5344-3fbe-469b-bd1f-07b603ac1d33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:05:19.220155 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:19.223753 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:19.224102 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:05:19.226644 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Deleted allocations for instance 09a47014-23a8-4dad-ab17-6df274ed8cf7
May 27 23:05:19.228805 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:19.229660 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapceb9d24a-c0, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:19.232367 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:19.237036 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:19.237887 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:19.238011 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42cfb097-baa4-461a-b0b5-daa0954e729a) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:19.238487 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:19.238825 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:19.243857 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:19.245246 np0000001565 nova-compute[98289]: INFO os_vif [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0')
May 27 23:05:19.245517 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Deleting instance files /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33_del
May 27 23:05:19.250476 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Deletion of /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33_del complete
May 27 23:05:19.269912 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-85ce865d-ca74-43a0-84bd-6f44b92ee398 req-8a2a039a-c8e2-4251-bc1e-d163885548d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:19.377427 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:19.490246 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:19.490699 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:19.490699 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:19.490834 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:4e:05:0c, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:05:19.491444 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Using config drive
May 27 23:05:19.615554 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating instance_info_cache with network_info: [{"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:19.696492 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-85ce865d-ca74-43a0-84bd-6f44b92ee398 req-8a2a039a-c8e2-4251-bc1e-d163885548d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:19.830303 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Deleted allocations for instance 2b2f5344-3fbe-469b-bd1f-07b603ac1d33
May 27 23:05:19.872126 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-85ce865d-ca74-43a0-84bd-6f44b92ee398 req-8a2a039a-c8e2-4251-bc1e-d163885548d0 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updated VIF entry in instance network info cache for port ceb9d24a-c097-4869-8358-4b045b4e9d08. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:05:19.872567 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-85ce865d-ca74-43a0-84bd-6f44b92ee398 req-8a2a039a-c8e2-4251-bc1e-d163885548d0 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updating instance_info_cache with network_info: [{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:19.901811 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:19.936290 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:20.029154 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:20.093831 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:20.094868 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:20.120154 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Releasing lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:20.121545 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Instance network_info: |[{"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:05:20.121545 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] Acquired lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:20.121545 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing network info cache for port 823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:20.128414 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Start _get_guest_xml network_info=[{"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8e061506-1d51-4975-b265-401db852bb92', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15be4e68-7a48-451f-8f22-d208bcdd4a79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b6529a44-e324-41a7-8db4-fed678008b49', 'attached_at': '', 'detached_at': '', 'volume_id': '15be4e68-7a48-451f-8f22-d208bcdd4a79', 'serial': '15be4e68-7a48-451f-8f22-d208bcdd4a79'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'attachment_id': '5a7d8eac-1cc8-44f7-8a74-1797dc2e62ea', 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ce7cd08-1e78-4594-8471-016861339cfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b6529a44-e324-41a7-8db4-fed678008b49', 'attached_at': '', 'detached_at': '', 'volume_id': '4ce7cd08-1e78-4594-8471-016861339cfc', 'serial': '4ce7cd08-1e78-4594-8471-016861339cfc'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'attachment_id': '117a2a31-745f-4346-a40a-35041aa8d8f6', 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b6529a44-e324-41a7-8db4-fed678008b49', 'attached_at': '', 'detached_at': '', 'volume_id': 'fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'serial': 'fdccea8d-bfcf-463c-8850-32f83d9f50d6'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:05:20.136032 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:05:20.137964 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-177896744', uuid='b6529a44-e324-41a7-8db4-fed678008b49'), owner=OwnerMeta(userid='0b3b7912ee004099b8839d39df504d9b', username='tempest-TaggedBootDevicesTest_v242-425781554-project-member', projectid='3c3b9a9477ae4742b8584b00bec574cc', projectname='tempest-TaggedBootDevicesTest_v242-425781554'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923120.1364563) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:05:20.141322 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:05:20.142153 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:05:20.148791 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:05:20.149100 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:05:20.151201 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:05:20.152112 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:05:20.152300 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:05:20.152461 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:05:20.152674 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:05:20.152917 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:05:20.153050 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:05:20.153923 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:05:20.154078 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:05:20.154248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:05:20.154632 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:05:20.155696 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:05:20.172354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:05:20.172731 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15be4e68-7a48-451f-8f22-d208bcdd4a79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:20.172858 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:20.173188 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:20.173446 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15be4e68-7a48-451f-8f22-d208bcdd4a79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:05:20.187824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:20.188404 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:20.188623 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:20.191172 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:20.193311 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:20.193606 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:20.203190 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:20.203190 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:20.210016 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:20.210016 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:20.216463 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79] added
May 27 23:05:20.216463 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:20.216463 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:20.216463 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:20.216463 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:20.216463 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:20.216463 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:20.216756 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:20.216829 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:20.216995 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:20.222721 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79] added
May 27 23:05:20.222721 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:20.222721 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:20.222721 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:20.222721 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:20.222721 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:20.222721 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:20.223088 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:20.223088 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:20.223303 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:20.237529 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-361d7bc9-0e77-4a97-b02f-08e86e370385 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "09a47014-23a8-4dad-ab17-6df274ed8cf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.728s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:20.335846 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:20.336018 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:20.374806 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-85ce865d-ca74-43a0-84bd-6f44b92ee398 req-8a2a039a-c8e2-4251-bc1e-d163885548d0 service nova] Releasing lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:20.624038 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:20.830388 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Instance event wait completed in 0 seconds for  {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:05:20.832674 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for a7839c43-8fd9-4deb-81c9-f128963f09ec due to new event <LifecycleEvent: 1779923120.8323598, a7839c43-8fd9-4deb-81c9-f128963f09ec => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:05:20.833117 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923120.8323598, a7839c43-8fd9-4deb-81c9-f128963f09ec => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:20.833201 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] VM Resumed (Lifecycle Event)
May 27 23:05:20.836697 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Instance running successfully.
May 27 23:05:20.845615 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Failed to set time: agent not configured {{(pid=98289) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 27 23:05:20.845615 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4cdcaeda-d65a-4801-a332-e725062cdaf7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] finish_migration finished successfully. {{(pid=98289) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 27 23:05:20.854063 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:20.854998 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:20.855156 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:20.855353 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:20.855429 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] No waiting events found dispatching network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:20.855567 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received unexpected event network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 for instance with vm_state active and task_state resize_finish.
May 27 23:05:20.855646 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:20.855801 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:20.856020 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:20.856133 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:20.856214 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] No waiting events found dispatching network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:20.856323 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-fc424f25-9277-4459-bc14-e6d9b00328dd req-13e22f9d-cf4d-4f9e-a10a-ae0c0c060faf service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received unexpected event network-vif-plugged-e837edcc-48f7-475e-ab37-e584deffe1c5 for instance with vm_state active and task_state resize_finish.
May 27 23:05:20.974142 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:20.974318 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:21.074467 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:21.217537 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:21.224655 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:21.234897 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:21.234897 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:21.242063 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:21.242063 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:21.252015 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:21.256962 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updated VIF entry in instance network info cache for port 823809f8-1026-49bb-bea9-35e7f2b0a606. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:05:21.257723 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating instance_info_cache with network_info: [{"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:21.259114 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:21.270391 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.270391 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.270391 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.270391 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.270391 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:21.270611 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.270611 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.270611 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.270611 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.270611 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:21.276239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.276239 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.276239 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.276239 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.276239 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:21.276239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.276239 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.276239 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.276239 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.276239 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:21.302742 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79, portal: 192.168.40.100,3260]
May 27 23:05:21.302742 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79, portal: 192.168.40.100,3260] successful.
May 27 23:05:21.302742 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:21.321653 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:21.322358 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79, portal: 192.168.50.100,3260]
May 27 23:05:21.322358 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79, portal: 192.168.50.100,3260] successful.
May 27 23:05:21.322358 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:21.338440 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:21.339778 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:21.341076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.341076 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.341076 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.341076 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.341076 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:21.341076 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:21.341076 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:21.341380 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.341380 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.341380 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.341380 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.341380 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:21.341380 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:21.341380 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:21.341686 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:21.341834 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:21.342581 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] HCTL ('11', '-', '-', 0) found on session 46 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:21.342751 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:21.343342 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:21.362674 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:21.362674 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:21.364657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Searching for a device in session 46 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:21.364835 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15be4e68-7a48-451f-8f22-d208bcdd4a79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:21.367217 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] HCTL ('12', '-', '-', 0) found on session 47 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:21.367217 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:21.389844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Searching for a device in session 47 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:21.389844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '15be4e68-7a48-451f-8f22-d208bcdd4a79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:21.490543 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:21.760037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] Releasing lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:21.761043 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-changed-3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:21.761043 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing instance network info cache due to event network-changed-3a02a883-ae80-41b7-873d-d30284a3b8aa. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:21.761043 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] Acquiring lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:21.761260 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] Acquired lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:21.761374 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing network info cache for port 3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:21.845565 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 27 23:05:21.845912 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923121.8456588, a7839c43-8fd9-4deb-81c9-f128963f09ec => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:21.846088 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] VM Started (Lifecycle Event)
May 27 23:05:21.970544 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00038645299991912907 future=<Future at 0x726e385ffa10 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:21.970882 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:21.971424 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.5327109170000313 future=<Future at 0x726e58603560 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:21.972455 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.531828090999852 future=<Future at 0x726e58603560 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:21.997515 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.661s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:22.190779 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:05:22.263697 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:22.324447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:22.324447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:22.324447 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Going to confirm migration 2 {{(pid=98289) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 27 23:05:22.348871 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:22.350532 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:05:22.508601 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ae85766f-10d2-4fc5-95df-58178f9d58be tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.379s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:22.624246 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:22.779605 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updated VIF entry in instance network info cache for port 3a02a883-ae80-41b7-873d-d30284a3b8aa. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:05:22.780148 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating instance_info_cache with network_info: [{"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:22.830003 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:22.932471 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:22.941681 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:22.941786 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:22.941914 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:05:22.942064 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'info_cache' on Instance uuid a7839c43-8fd9-4deb-81c9-f128963f09ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:23.088763 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "848a1295-d91a-4522-bf36-7d6843c01a28" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:23.088957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:23.213085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Found WWN 330000000db980d49 for multipath device dm-4 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:05:23.213380 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:23.213529 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000db980d49', 'path': '/dev/dm-4', 'multipath_id': '330000000db980d49'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:23.213638 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000db980d49', 'path': '/dev/dm-4', 'multipath_id': '330000000db980d49'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:05:23.282238 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e8e0084f-dd9c-42a3-af02-5fd5a625536f req-3f47a952-ab3d-4266-9a05-500702af808e service nova] Releasing lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:23.421960 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:23.502931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:23.503130 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:23.594180 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid 848a1295-d91a-4522-bf36-7d6843c01a28 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:23.639657 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:23.639858 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:23.640039 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Unshelving
May 27 23:05:23.720142 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:05:23.720470 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ce7cd08-1e78-4594-8471-016861339cfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:23.720641 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:23.720975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:23.721188 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ce7cd08-1e78-4594-8471-016861339cfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:05:23.730597 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:23.731433 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:23.731837 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:23.732029 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:23.732417 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:23.732560 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:23.742136 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:23.742136 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:23.745892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:23.745892 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:23.752701 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc] added
May 27 23:05:23.752701 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:23.752701 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:23.752701 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:23.752701 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:23.752701 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:23.752701 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:23.752866 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:23.753352 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.021(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:23.753352 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:23.755854 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc] added
May 27 23:05:23.755854 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:23.755854 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:23.755854 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:23.755854 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:23.755854 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:23.755854 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:23.756058 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:23.756219 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0236(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:23.756363 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:23.946371 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:24.004660 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:05:24.238988 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:24.377761 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:24.533467 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating instance_info_cache with network_info: [{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:24.553266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:24.553474 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:24.556183 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:05:24.556316 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Claim successful on node np0000001565
May 27 23:05:24.598340 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:24.756829 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:24.766773 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:24.766773 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:24.768686 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:24.780258 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:24.786225 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:24.786225 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:24.796608 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.796608 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.796608 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.796608 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.796608 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.796608 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.796608 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:24.796859 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.796859 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.796859 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.796859 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.796859 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.796859 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.796859 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:24.798304 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:24.824716 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.824716 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.824716 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.824716 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.824716 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.824716 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.824716 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:24.825020 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.825020 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.825020 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.825020 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.825020 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.825020 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.825020 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:24.833267 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc, portal: 192.168.40.100,3260]
May 27 23:05:24.833267 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc, portal: 192.168.40.100,3260] successful.
May 27 23:05:24.833267 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:24.842712 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:24.868041 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.868041 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.868041 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.868041 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.868041 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.868041 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.868041 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:24.868041 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:24.868041 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:24.868359 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.868359 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.868359 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.868359 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.868359 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.868359 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.868359 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:24.868359 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:24.868359 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:24.868540 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:24.868615 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:24.869115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc, portal: 192.168.50.100,3260]
May 27 23:05:24.869115 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc, portal: 192.168.50.100,3260] successful.
May 27 23:05:24.869115 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:24.870308 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] HCTL ('13', '-', '-', 0) found on session 48 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:24.870441 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:24.879919 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:24.885899 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Searching for a device in session 48 and hctl ['13', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:24.894226 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.894226 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.894226 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.894226 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.894226 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.894226 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.894226 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:24.894226 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:24.894226 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:24.894523 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.894523 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:24.894523 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.894523 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:24.894523 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.894523 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:24.894523 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:24.894523 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:24.894523 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:24.894761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:24.894860 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:24.896235 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] HCTL ('14', '-', '-', 0) found on session 49 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:24.896394 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:24.908979 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Searching for a device in session 49 and hctl ['14', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:25.035614 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:25.036915 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'migration_context' on Instance uuid a7839c43-8fd9-4deb-81c9-f128963f09ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:25.157019 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Booting with volume e7244f7e-f2ef-4495-889e-d4e4acc86535 at /dev/vdc
May 27 23:05:25.193415 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:25.203293 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:05:25.221162 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:25.264973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:05:25.265300 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:05:25.272962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:05:25.274303 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fea3:4583', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4', 'fe80::fc16:3eff:fe4e:50c'] 
May 27 23:05:25.274410 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:05:25.274538 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:05:25.274754 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:25.275125 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updating existing volume attachment record: 3794921a-9377-46fd-b02e-fc402dcfa597 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:05:25.504951 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0013932650001606817 future=<Future at 0x726e58603560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:25.505090 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:25.505154 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.8762788259998615 future=<Future at 0x726e58602180 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:25.505238 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.87619737 future=<Future at 0x726e58602180 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:25.505602 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Emitting event <LifecycleEvent: 1779923110.5034382, 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:25.505740 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] VM Stopped (Lifecycle Event)
May 27 23:05:25.538153 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Object Instance<a7839c43-8fd9-4deb-81c9-f128963f09ec> lazy-loaded attributes: info_cache,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:05:25.543492 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:25.655835 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "848a1295-d91a-4522-bf36-7d6843c01a28" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:25.656033 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:25.656222 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Attaching volume e67d2f5e-8603-45c4-bb6c-60c287f67e27 to /dev/vdb
May 27 23:05:25.696400 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:25.706946 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:05:25.726815 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:25.769094 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:05:25.769311 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:05:25.778062 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:05:25.779260 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fea3:4583', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4', 'fe80::fc16:3eff:fe4e:50c'] 
May 27 23:05:25.779408 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:05:25.779525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:05:25.779729 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:25.779953 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Updating existing volume attachment record: 90952f84-c178-4b3d-93c0-258d34081744 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:05:25.887998 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Searching for a device in session 48 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:25.888154 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ce7cd08-1e78-4594-8471-016861339cfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:25.911518 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Searching for a device in session 49 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:25.911518 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4ce7cd08-1e78-4594-8471-016861339cfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:26.011162 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-edd50daf-d819-4416-91a0-930db9d35858 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:26.133433 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:26.133860 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:26.358828 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '848a1295-d91a-4522-bf36-7d6843c01a28', 'attached_at': '', 'detached_at': '', 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'serial': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:05:26.360155 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:05:26.360501 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:26.360680 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:26.636229 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:26.740176 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:05:26.912778 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:27.142576 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.589s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:27.143796 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:05:27.146501 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 1.599s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:27.650781 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:05:27.654827 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:05:27.655137 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:27.655386 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:27.756470 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Found WWN 33000000094a7dc4b for multipath device dm-7 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:05:27.756934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.036s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:27.759620 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.397s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:27.763764 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] <== connect_volume: return (4038ms) {'type': 'block', 'scsi_wwn': '33000000094a7dc4b', 'path': '/dev/dm-7', 'multipath_id': '33000000094a7dc4b'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:27.763967 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000094a7dc4b', 'path': '/dev/dm-7', 'multipath_id': '33000000094a7dc4b'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:05:27.764357 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f0d298d70064eac8ffd4fe25b1e203b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f15f51479c4e37ab880af2031170be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:05:27.768280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:05:27.779508 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:27.780085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:27.780580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:27.780765 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:27.781186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:27.782023 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:27.798914 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:27.798914 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:27.805621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:27.805621 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:27.811385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27] added
May 27 23:05:27.811385 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:27.811385 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:27.811385 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:27.811385 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:27.811385 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:27.811385 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:27.811591 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:27.811709 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:27.811831 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:27.822444 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27] added
May 27 23:05:27.822444 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:27.822444 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:27.822444 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:27.822444 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:27.822444 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:27.822444 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:27.822640 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:27.824583 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.042(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:27.824583 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:28.156184 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:05:28.264838 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Successfully created port: 3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:05:28.278497 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:05:28.278752 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:28.278870 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:28.301711 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:28.301984 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:28.423393 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:28.660342 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:05:28.757105 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Successfully updated port: 3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:05:28.798088 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4272f732-2f54-4c9c-acc6-61b018412dcb req-625848d9-c8f0-4313-8db3-2a8b303fe5ad service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-changed-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:28.798524 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4272f732-2f54-4c9c-acc6-61b018412dcb req-625848d9-c8f0-4313-8db3-2a8b303fe5ad service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Refreshing instance network info cache due to event network-changed-3d5f116b-acb3-45c5-852a-ba903302ea2e. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:28.798947 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4272f732-2f54-4c9c-acc6-61b018412dcb req-625848d9-c8f0-4313-8db3-2a8b303fe5ad service nova] Acquiring lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:28.799089 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4272f732-2f54-4c9c-acc6-61b018412dcb req-625848d9-c8f0-4313-8db3-2a8b303fe5ad service nova] Acquired lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:28.799278 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4272f732-2f54-4c9c-acc6-61b018412dcb req-625848d9-c8f0-4313-8db3-2a8b303fe5ad service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Refreshing network info cache for port 3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:28.804739 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:28.812107 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:28.823311 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:28.823311 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:28.825307 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:28.834618 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:28.834618 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:28.840207 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:28.847477 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:28.854937 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.854937 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.854937 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.854937 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.854937 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.854937 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.854937 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.854937 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.854937 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:28.855262 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.855262 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.855262 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.855262 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.855262 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.855262 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.855262 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.855262 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.855262 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:28.862920 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.862920 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.862920 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.862920 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.862920 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.862920 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.862920 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.862920 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.862920 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:28.863198 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.863198 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.863198 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.863198 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.863198 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.863198 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.863198 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.863198 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.863198 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:28.896655 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27, portal: 192.168.50.100,3260]
May 27 23:05:28.896655 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27, portal: 192.168.50.100,3260] successful.
May 27 23:05:28.896655 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:28.909079 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:28.923024 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27, portal: 192.168.40.100,3260]
May 27 23:05:28.923024 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27, portal: 192.168.40.100,3260] successful.
May 27 23:05:28.923024 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:28.924535 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.924535 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.924535 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.924535 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.924535 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.924535 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.924535 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.924535 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.924535 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:28.924535 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:28.924535 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:28.924747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.924747 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.924747 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.924747 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.924747 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.924747 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.924747 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.924747 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.924747 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:28.924747 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:28.924747 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:28.924912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:28.924971 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:28.925834 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('15', '-', '-', 0) found on session 50 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:28.925927 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:28.936682 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:28.946718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 50 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:28.946866 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:28.953954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.953954 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.953954 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.953954 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.953954 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.953954 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.953954 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.953954 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.953954 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:28.953954 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:28.953954 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:28.954210 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.954210 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:28.954210 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.954210 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:28.954210 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.954210 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:28.954210 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.954210 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:28.954210 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:28.954210 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:28.954210 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:28.954431 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:28.954431 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:28.955264 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('16', '-', '-', 0) found on session 51 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:28.955365 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:28.971907 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 51 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:28.971907 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:29.164626 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Booting with volume dbaed51e-0782-4850-9c80-429a77200302 at /dev/vda
May 27 23:05:29.202186 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:29.211547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:05:29.231767 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:29.242602 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:29.262194 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:29.268360 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:05:29.268672 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:05:29.276501 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:05:29.277853 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fea3:4583', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4', 'fe80::fc16:3eff:fe4e:50c'] 
May 27 23:05:29.277963 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:05:29.278065 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:05:29.278303 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== get_connector_properties: return (75ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:29.278501 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Updating existing volume attachment record: 03a2e48f-b4b8-43a9-9779-5abb4371940b {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:05:29.301459 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4272f732-2f54-4c9c-acc6-61b018412dcb req-625848d9-c8f0-4313-8db3-2a8b303fe5ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:29.370408 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4272f732-2f54-4c9c-acc6-61b018412dcb req-625848d9-c8f0-4313-8db3-2a8b303fe5ad service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:05:29.382153 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0005220560001362173 future=<Future at 0x726e58602180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:29.382346 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:29.383840 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] Emitting event <LifecycleEvent: 1779923114.3813071, 09a47014-23a8-4dad-ab17-6df274ed8cf7 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:29.383840 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] VM Stopped (Lifecycle Event)
May 27 23:05:29.517993 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4272f732-2f54-4c9c-acc6-61b018412dcb req-625848d9-c8f0-4313-8db3-2a8b303fe5ad service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:29.787612 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:05:29.818276 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.675s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:29.822161 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.906s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:29.824866 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'pci_requests' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:29.886403 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a33db459-e88f-49e7-96bf-3718645dd7fe tempest-VolumesNegativeTest-578680527 tempest-VolumesNegativeTest-578680527-project-member] [instance: 09a47014-23a8-4dad-ab17-6df274ed8cf7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:30.019785 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4272f732-2f54-4c9c-acc6-61b018412dcb req-625848d9-c8f0-4313-8db3-2a8b303fe5ad service nova] Releasing lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:30.020135 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquired lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:30.020455 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:05:30.328618 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'numa_topology' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:30.445599 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Deleted allocation for migration 1602a0c8-ec17-437e-a88c-dc3aa02990b1
May 27 23:05:30.577893 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:05:30.720672 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:30.803020 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found WWN 3300000000f173ba6 for multipath device dm-8 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:05:30.803594 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:30.804066 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.525s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:30.804302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:05:30.807055 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== connect_volume: return (4446ms) {'type': 'block', 'scsi_wwn': '3300000000f173ba6', 'path': '/dev/disk/by-id/os-brick+dev+dm-8', 'multipath_id': '3300000000f173ba6'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:30.807419 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000f173ba6', 'path': '/dev/disk/by-id/os-brick+dev+dm-8', 'multipath_id': '3300000000f173ba6'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:05:30.814403 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:05:30.814403 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:05:30.815018 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:05:30.816178 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x726e60104560>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, 'status': 'reserved', 'instance': '848a1295-d91a-4522-bf36-7d6843c01a28', 'attached_at': '', 'detached_at': '', 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'serial': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27'} {{(pid=98289) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 23:05:30.816489 np0000001565 nova-compute[98289]: WARNING os_brick.encryptors.cryptsetup [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 27 23:05:30.816730 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98289) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 27 23:05:30.817940 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.cryptsetup [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] opening encrypted volume /dev/dm-8 {{(pid=98289) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 27 23:05:30.819091 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:30.819788 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:30.820299 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:30.820520 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:30.821006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:30.821224 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:30.830844 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:05:30.831125 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Claim successful on node np0000001565
May 27 23:05:30.840385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:30.840385 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:30.841412 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:30.841412 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:30.853928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6] added
May 27 23:05:30.853928 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:30.853928 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:30.853928 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:30.853928 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:30.853928 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:30.853928 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:30.853928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:30.853928 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:30.853928 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:30.858024 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6] added
May 27 23:05:30.858024 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:30.858024 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:30.858024 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:30.858024 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:30.858024 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:30.858024 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:30.858855 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:30.858855 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:30.858855 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:30.867430 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Updating instance_info_cache with network_info: [{"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:30.910262 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid 848a1295-d91a-4522-bf36-7d6843c01a28 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:30.951489 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0520766b-42a8-471f-b6a4-af38faca83a3 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 8.629s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:31.368036 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Releasing lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:31.368417 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Instance network_info: |[{"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:05:31.389244 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:05:31.390579 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:05:31.390820 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Creating image(s)
May 27 23:05:31.391126 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:05:31.391244 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Ensure instance console log exists: /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:05:31.391925 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:31.392135 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:31.392314 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:31.393218 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Start _get_guest_xml network_info=[{"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '03a2e48f-b4b8-43a9-9779-5abb4371940b', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c6934452-ac0c-4d70-8ab4-c09b80c8829f', 'attached_at': '', 'detached_at': '', 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'serial': 'dbaed51e-0782-4850-9c80-429a77200302'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:05:31.395473 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:05:31.396580 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-755854208', uuid='c6934452-ac0c-4d70-8ab4-c09b80c8829f'), owner=OwnerMeta(userid='8f0d298d70064eac8ffd4fe25b1e203b', username='tempest-ServerActionsTestOtherA-1786604563-project-member', projectid='d6f15f51479c4e37ab880af2031170be', projectname='tempest-ServerActionsTestOtherA-1786604563'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923131.396264) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:05:31.397474 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:05:31.397766 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:05:31.398541 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:05:31.398762 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:05:31.399739 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:05:31.400035 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:05:31.400204 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:05:31.400382 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:05:31.400600 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:05:31.400736 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:05:31.400874 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:05:31.401053 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:05:31.401189 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:05:31.401368 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:05:31.401511 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:05:31.401666 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:05:31.412857 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:05:31.413464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:31.413655 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:31.414652 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Attempting to attach volume e67d2f5e-8603-45c4-bb6c-60c287f67e27 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:05:31.415575 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:05:31.415575 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:31.415575 np0000001565 nova-compute[98289]:   <alias name="ua-e67d2f5e-8603-45c4-bb6c-60c287f67e27"/>
May 27 23:05:31.415575 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-8"/>
May 27 23:05:31.415575 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:05:31.415575 np0000001565 nova-compute[98289]:   <serial>e67d2f5e-8603-45c4-bb6c-60c287f67e27</serial>
May 27 23:05:31.415575 np0000001565 nova-compute[98289]: </disk>
May 27 23:05:31.415575 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:05:31.727513 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f806114a-2ae1-4cfc-b695-8e4c67929b0d req-e53f8756-a06a-40ff-8137-4069684f7873 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received event network-changed-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:31.729771 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f806114a-2ae1-4cfc-b695-8e4c67929b0d req-e53f8756-a06a-40ff-8137-4069684f7873 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Refreshing instance network info cache due to event network-changed-112f36c6-7fa0-4a72-9edf-c9421eccd857. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:31.729771 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f806114a-2ae1-4cfc-b695-8e4c67929b0d req-e53f8756-a06a-40ff-8137-4069684f7873 service nova] Acquiring lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:31.729771 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f806114a-2ae1-4cfc-b695-8e4c67929b0d req-e53f8756-a06a-40ff-8137-4069684f7873 service nova] Acquired lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:31.729771 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f806114a-2ae1-4cfc-b695-8e4c67929b0d req-e53f8756-a06a-40ff-8137-4069684f7873 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Refreshing network info cache for port 112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:31.853838 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:31.859128 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:31.867504 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:31.867504 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:31.879789 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:31.879789 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:31.882808 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:31.891440 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:31.900053 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.900053 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.900053 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.900053 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.900053 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.900053 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.900053 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.900053 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.900053 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.900053 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.900053 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:31.903444 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.903444 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.903444 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.903444 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.903444 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.903444 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.903444 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.903444 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.903444 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.903444 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.903444 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:31.907200 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.907200 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.907200 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.907200 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.907200 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.907200 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.907200 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.907200 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.907200 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.907200 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.907200 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:31.907953 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.907953 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.907953 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.907953 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.907953 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.907953 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.907953 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.907953 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.907953 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.907953 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.907953 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:31.946068 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6, portal: 192.168.50.100,3260]
May 27 23:05:31.946068 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6, portal: 192.168.50.100,3260] successful.
May 27 23:05:31.946068 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:31.956788 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:31.982777 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6, portal: 192.168.40.100,3260]
May 27 23:05:31.982777 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6, portal: 192.168.40.100,3260] successful.
May 27 23:05:31.982777 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:31.987855 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:31.988134 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:31.988423 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:31.988423 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:31.989571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] HCTL ('17', '-', '-', 0) found on session 52 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:31.989705 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:31.994885 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:32.003701 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Searching for a device in session 52 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:32.003701 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:32.013014 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:32.015724 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] HCTL ('18', '-', '-', 0) found on session 53 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:32.015724 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:32.034122 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Searching for a device in session 53 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:32.034122 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:32.231155 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f806114a-2ae1-4cfc-b695-8e4c67929b0d req-e53f8756-a06a-40ff-8137-4069684f7873 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:32.399139 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:32.399508 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:32.512083 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f806114a-2ae1-4cfc-b695-8e4c67929b0d req-e53f8756-a06a-40ff-8137-4069684f7873 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:32.649848 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f806114a-2ae1-4cfc-b695-8e4c67929b0d req-e53f8756-a06a-40ff-8137-4069684f7873 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updated VIF entry in instance network info cache for port 112f36c6-7fa0-4a72-9edf-c9421eccd857. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:05:32.650093 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f806114a-2ae1-4cfc-b695-8e4c67929b0d req-e53f8756-a06a-40ff-8137-4069684f7873 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating instance_info_cache with network_info: [{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:32.820889 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:05:32.902841 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:33.079756 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:33.079909 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:33.080057 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:33.080194 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No VIF found with MAC fa:16:3e:a3:45:83, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:05:33.151698 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f806114a-2ae1-4cfc-b695-8e4c67929b0d req-e53f8756-a06a-40ff-8137-4069684f7873 service nova] Releasing lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:33.408865 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.590s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:33.409320 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:33.428427 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:33.473067 np0000001565 nova-compute[98289]: INFO nova.network.neutron [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updating port ceb9d24a-c097-4869-8358-4b045b4e9d08 with attributes {'binding:host_id': 'np0000001565', 'device_owner': 'compute:nova'}
May 27 23:05:33.837974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Found WWN 33000000089e8e1e1 for multipath device dm-10 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:05:33.837974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:33.837974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] <== connect_volume: return (5558ms) {'type': 'block', 'scsi_wwn': '33000000089e8e1e1', 'path': '/dev/dm-10', 'multipath_id': '33000000089e8e1e1'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:33.837974 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000089e8e1e1', 'path': '/dev/dm-10', 'multipath_id': '33000000089e8e1e1'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:05:33.838315 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.424s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:33.838684 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:05:33.855706 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:33.855927 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:33.856351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:33.856532 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:33.857024 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:33.858104 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:33.871191 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:33.871191 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:33.876774 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:33.876774 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:33.884120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302] added
May 27 23:05:33.884120 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:33.884120 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:33.884120 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:33.884120 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:33.884120 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:33.884120 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:33.884873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:33.884873 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:33.884873 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:33.888451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302] added
May 27 23:05:33.888451 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:33.888451 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:33.888451 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:33.888451 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:33.888451 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:33.888451 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:33.888652 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:33.888969 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:33.890422 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:33.899014 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d9eb4094-e8d2-4c2d-9201-0cf243f0e358 req-bf4b1927-eb3c-4a82-a33a-1f0b5eae9f96 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-changed-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:33.899175 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d9eb4094-e8d2-4c2d-9201-0cf243f0e358 req-bf4b1927-eb3c-4a82-a33a-1f0b5eae9f96 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Refreshing instance network info cache due to event network-changed-e837edcc-48f7-475e-ab37-e584deffe1c5. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:33.899412 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d9eb4094-e8d2-4c2d-9201-0cf243f0e358 req-bf4b1927-eb3c-4a82-a33a-1f0b5eae9f96 service nova] Acquiring lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:33.899541 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d9eb4094-e8d2-4c2d-9201-0cf243f0e358 req-bf4b1927-eb3c-4a82-a33a-1f0b5eae9f96 service nova] Acquired lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:33.899986 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d9eb4094-e8d2-4c2d-9201-0cf243f0e358 req-bf4b1927-eb3c-4a82-a33a-1f0b5eae9f96 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Refreshing network info cache for port e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:33.927678 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:33.928083 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquired lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:33.928083 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:05:34.029518 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-38cdec44-b4c2-40ab-a4ea-d255052babf6 req-f1b85374-e918-4f5b-b09b-c1ad853e06e6 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-changed-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:34.029659 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-38cdec44-b4c2-40ab-a4ea-d255052babf6 req-f1b85374-e918-4f5b-b09b-c1ad853e06e6 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Refreshing instance network info cache due to event network-changed-ceb9d24a-c097-4869-8358-4b045b4e9d08. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:34.029793 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-38cdec44-b4c2-40ab-a4ea-d255052babf6 req-f1b85374-e918-4f5b-b09b-c1ad853e06e6 service nova] Acquiring lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:34.245889 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.346029 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:05:34.346245 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:34.346764 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:52:68,bridge_name='br-int',has_traffic_filtering=True,id=ba433465-ba01-4869-9685-b6c13a640b01,network=Network(b4e502e1-c0f5-4c3f-af29-947c5bf15452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba433465-ba') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:34.347442 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:05:34.347593 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:34.348361 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ef:10,bridge_name='br-int',has_traffic_filtering=True,id=85626fc3-ef41-492d-b3a0-2bb370305172,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85626fc3-ef') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:34.348961 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:05:34.349136 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:34.349600 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=7679fe69-489d-4734-889b-15238db0b2de,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7679fe69-48') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:34.350153 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:05:34.350434 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:34.350858 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=b63228fe-f10e-44de-90aa-ff5a303961f1,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63228fe-f1') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:34.351404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:05:34.351584 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:34.351956 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=1964f27a-2f2b-4e91-a8f4-95b400a98ed4,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964f27a-2f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:34.352634 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:05:34.352817 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:34.353172 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3b:74,bridge_name='br-int',has_traffic_filtering=True,id=823809f8-1026-49bb-bea9-35e7f2b0a606,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823809f8-10') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:34.353793 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:05:34.353974 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:34.354341 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4d:67,bridge_name='br-int',has_traffic_filtering=True,id=3a02a883-ae80-41b7-873d-d30284a3b8aa,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a02a883-ae') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:34.355135 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lazy-loading 'pci_devices' on Instance uuid b6529a44-e324-41a7-8db4-fed678008b49 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:34.401812 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d9eb4094-e8d2-4c2d-9201-0cf243f0e358 req-bf4b1927-eb3c-4a82-a33a-1f0b5eae9f96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:34.429799 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:34.626985 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2277dd06-5656-4b2d-b1ed-c6c878ac21bd tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.971s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:34.788771 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:34.792812 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d9eb4094-e8d2-4c2d-9201-0cf243f0e358 req-bf4b1927-eb3c-4a82-a33a-1f0b5eae9f96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:34.858540 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] End _get_guest_xml xml=<domain type="qemu">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <uuid>b6529a44-e324-41a7-8db4-fed678008b49</uuid>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <name>instance-0000001e</name>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <nova:name>tempest-device-tagging-server-177896744</nova:name>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:05:20</nova:creationTime>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:user uuid="0b3b7912ee004099b8839d39df504d9b">tempest-TaggedBootDevicesTest_v242-425781554-project-member</nova:user>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:project uuid="3c3b9a9477ae4742b8584b00bec574cc">tempest-TaggedBootDevicesTest_v242-425781554</nova:project>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:port uuid="ba433465-ba01-4869-9685-b6c13a640b01">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:port uuid="85626fc3-ef41-492d-b3a0-2bb370305172">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.1.29" ipVersion="4"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:port uuid="7679fe69-489d-4734-889b-15238db0b2de">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.1.225" ipVersion="4"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:port uuid="b63228fe-f10e-44de-90aa-ff5a303961f1">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:port uuid="1964f27a-2f2b-4e91-a8f4-95b400a98ed4">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:port uuid="823809f8-1026-49bb-bea9-35e7f2b0a606">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         <nova:port uuid="3a02a883-ae80-41b7-873d-d30284a3b8aa">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <system>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <entry name="serial">b6529a44-e324-41a7-8db4-fed678008b49</entry>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <entry name="uuid">b6529a44-e324-41a7-8db4-fed678008b49</entry>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </system>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <os>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   </os>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <features>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   </features>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   <devices>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/b6529a44-e324-41a7-8db4-fed678008b49/disk.config"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <alias name="ua-15be4e68-7a48-451f-8f22-d208bcdd4a79"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-4"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <serial>15be4e68-7a48-451f-8f22-d208bcdd4a79</serial>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <alias name="ua-4ce7cd08-1e78-4594-8471-016861339cfc"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-7"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <serial>4ce7cd08-1e78-4594-8471-016861339cfc</serial>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <alias name="ua-fdccea8d-bfcf-463c-8850-32f83d9f50d6"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-10"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <target dev="vdc" bus="virtio"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <serial>fdccea8d-bfcf-463c-8850-32f83d9f50d6</serial>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:4e:52:68"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <target dev="tapba433465-ba"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </interface>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ec:ef:10"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <target dev="tap85626fc3-ef"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </interface>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:37:67:cf"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <target dev="tap7679fe69-48"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </interface>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:5e:b1:85"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <target dev="tapb63228fe-f1"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </interface>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:d3:b7:0f"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <target dev="tap1964f27a-2f"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </interface>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:d3:3b:74"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <target dev="tap823809f8-10"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </interface>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:4e:4d:67"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <target dev="tap3a02a883-ae"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </interface>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/b6529a44-e324-41a7-8db4-fed678008b49/console.log" append="off"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </serial>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <video>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </video>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </rng>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:   </devices>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]: </domain>
May 27 23:05:34.858540 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:05:34.861490 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Preparing to wait for external event network-vif-plugged-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:05:34.861490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:34.861490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:34.861490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:34.861490 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Preparing to wait for external event network-vif-plugged-85626fc3-ef41-492d-b3a0-2bb370305172 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:05:34.861490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:34.861490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:34.861490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:34.862125 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Preparing to wait for external event network-vif-plugged-7679fe69-489d-4734-889b-15238db0b2de {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:05:34.862273 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:34.862454 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:34.862600 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:34.862763 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Preparing to wait for external event network-vif-plugged-b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:05:34.862875 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:34.863016 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:34.863151 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:34.863283 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Preparing to wait for external event network-vif-plugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:05:34.863411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:34.863543 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:34.863673 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:34.863832 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Preparing to wait for external event network-vif-plugged-823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:05:34.864206 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:34.864427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:34.864623 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:34.864803 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Preparing to wait for external event network-vif-plugged-3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:05:34.864946 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:34.865149 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:34.865373 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:34.866676 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:05:34.868374 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:34.869857 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:52:68,bridge_name='br-int',has_traffic_filtering=True,id=ba433465-ba01-4869-9685-b6c13a640b01,network=Network(b4e502e1-c0f5-4c3f-af29-947c5bf15452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba433465-ba') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:34.870100 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:52:68,bridge_name='br-int',has_traffic_filtering=True,id=ba433465-ba01-4869-9685-b6c13a640b01,network=Network(b4e502e1-c0f5-4c3f-af29-947c5bf15452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba433465-ba') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:05:34.870608 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.870895 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.871112 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:05:34.872029 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.872156 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f6e078b-f066-5190-a034-4226feafcd8d', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.872834 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.873517 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:34.874865 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.877651 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.877651 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba433465-ba, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.877826 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba433465-ba, col_values=(('qos', UUID('4328d892-dfaf-4841-9e75-19bbe43ea6a7')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.877979 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba433465-ba, col_values=(('external_ids', {'iface-id': 'ba433465-ba01-4869-9685-b6c13a640b01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:52:68', 'vm-uuid': 'b6529a44-e324-41a7-8db4-fed678008b49'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.881480 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.882577 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:34.885028 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.886398 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:34.886921 np0000001565 nova-compute[98289]: INFO os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:52:68,bridge_name='br-int',has_traffic_filtering=True,id=ba433465-ba01-4869-9685-b6c13a640b01,network=Network(b4e502e1-c0f5-4c3f-af29-947c5bf15452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba433465-ba')
May 27 23:05:34.887698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:05:34.888547 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:34.889782 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ef:10,bridge_name='br-int',has_traffic_filtering=True,id=85626fc3-ef41-492d-b3a0-2bb370305172,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85626fc3-ef') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:34.889782 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ef:10,bridge_name='br-int',has_traffic_filtering=True,id=85626fc3-ef41-492d-b3a0-2bb370305172,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85626fc3-ef') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:05:34.889910 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.890223 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.890223 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:05:34.891286 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:34.891796 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.893801 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be493832-3b1a-530f-9a7d-835f225b8126', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.895778 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.895778 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:34.901198 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:34.903488 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:34.903488 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:34.906221 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.906221 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85626fc3-ef, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.906321 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85626fc3-ef, col_values=(('qos', UUID('10dae054-c433-4b26-8f24-1e3a8a0b9f65')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.906521 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85626fc3-ef, col_values=(('external_ids', {'iface-id': '85626fc3-ef41-492d-b3a0-2bb370305172', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:ef:10', 'vm-uuid': 'b6529a44-e324-41a7-8db4-fed678008b49'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.908655 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.908655 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:34.914887 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:34.914887 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:34.919223 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:34.919223 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.920779 np0000001565 nova-compute[98289]: INFO os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ef:10,bridge_name='br-int',has_traffic_filtering=True,id=85626fc3-ef41-492d-b3a0-2bb370305172,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85626fc3-ef')
May 27 23:05:34.921758 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:05:34.921985 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:34.922455 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=7679fe69-489d-4734-889b-15238db0b2de,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7679fe69-48') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:34.922659 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=7679fe69-489d-4734-889b-15238db0b2de,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7679fe69-48') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:05:34.922853 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.923031 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.923417 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:05:34.924104 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.924252 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13d3dcd6-6ad0-5472-8d8b-55e51168dfc8', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.925743 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.925743 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:34.926344 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:34.935988 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.938497 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.938675 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7679fe69-48, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.939675 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7679fe69-48, col_values=(('qos', UUID('b4606c42-0d5b-4f49-ad96-90e427773491')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.939903 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7679fe69-48, col_values=(('external_ids', {'iface-id': '7679fe69-489d-4734-889b-15238db0b2de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:67:cf', 'vm-uuid': 'b6529a44-e324-41a7-8db4-fed678008b49'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:34.941551 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:34.942064 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:34.944680 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:34.953172 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updating instance_info_cache with network_info: [{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:34.953908 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:34.954220 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:34.958013 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d9eb4094-e8d2-4c2d-9201-0cf243f0e358 req-bf4b1927-eb3c-4a82-a33a-1f0b5eae9f96 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updated VIF entry in instance network info cache for port e837edcc-48f7-475e-ab37-e584deffe1c5. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:05:34.963126 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d9eb4094-e8d2-4c2d-9201-0cf243f0e358 req-bf4b1927-eb3c-4a82-a33a-1f0b5eae9f96 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating instance_info_cache with network_info: [{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:34.964084 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.965635 np0000001565 nova-compute[98289]: INFO os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=7679fe69-489d-4734-889b-15238db0b2de,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7679fe69-48')
May 27 23:05:34.967386 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:05:34.967386 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:34.967386 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=b63228fe-f10e-44de-90aa-ff5a303961f1,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63228fe-f1') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:34.967386 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=b63228fe-f10e-44de-90aa-ff5a303961f1,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63228fe-f1') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:05:34.967676 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.967676 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.967902 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:05:34.971497 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.971497 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c06c5593-fc30-5c81-8967-deb664c52bba', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.971497 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.971863 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:34.988641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.992879 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.993020 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb63228fe-f1, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.993430 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb63228fe-f1, col_values=(('qos', UUID('c68976e3-da33-4358-b5c6-27bdbff699cd')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.993527 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb63228fe-f1, col_values=(('external_ids', {'iface-id': 'b63228fe-f10e-44de-90aa-ff5a303961f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:b1:85', 'vm-uuid': 'b6529a44-e324-41a7-8db4-fed678008b49'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:34.995029 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:34.995532 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:34.997028 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.50.100,3260]
May 27 23:05:34.997028 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.50.100,3260] successful.
May 27 23:05:34.997028 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:35.008873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:35.017149 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.018246 np0000001565 nova-compute[98289]: INFO os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=b63228fe-f10e-44de-90aa-ff5a303961f1,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63228fe-f1')
May 27 23:05:35.018961 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:05:35.019104 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:35.019661 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=1964f27a-2f2b-4e91-a8f4-95b400a98ed4,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964f27a-2f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:35.019949 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=1964f27a-2f2b-4e91-a8f4-95b400a98ed4,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964f27a-2f') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:05:35.020275 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.020528 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.020668 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:05:35.021671 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.021916 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6914d857-5fd0-540c-a7db-6e6ab5391b36', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.022673 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.40.100,3260]
May 27 23:05:35.022673 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.40.100,3260] successful.
May 27 23:05:35.022673 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:35.027198 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:35.035956 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:35.038912 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] HCTL ('19', '-', '-', 0) found on session 54 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:35.038912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:35.039778 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:35.045447 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.048037 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.048307 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1964f27a-2f, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.048588 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1964f27a-2f, col_values=(('qos', UUID('d71e50d0-5b2f-4a79-97ba-ec9f0d121b2f')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.048756 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1964f27a-2f, col_values=(('external_ids', {'iface-id': '1964f27a-2f2b-4e91-a8f4-95b400a98ed4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:b7:0f', 'vm-uuid': 'b6529a44-e324-41a7-8db4-fed678008b49'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.050954 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:35.063360 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching for a device in session 54 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:35.065619 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:35.065895 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:35.066211 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:35.066688 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:35.066812 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:35.068409 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] HCTL ('20', '-', '-', 0) found on session 55 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:35.068409 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:35.075441 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.077969 np0000001565 nova-compute[98289]: INFO os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=1964f27a-2f2b-4e91-a8f4-95b400a98ed4,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964f27a-2f')
May 27 23:05:35.078647 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:05:35.078807 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:35.079187 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3b:74,bridge_name='br-int',has_traffic_filtering=True,id=823809f8-1026-49bb-bea9-35e7f2b0a606,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823809f8-10') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:35.079407 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3b:74,bridge_name='br-int',has_traffic_filtering=True,id=823809f8-1026-49bb-bea9-35e7f2b0a606,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823809f8-10') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:05:35.079840 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.080006 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.080149 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:05:35.080923 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.081095 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41a483cd-0657-5422-980d-0a594995a7bc', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.082851 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:35.087082 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching for a device in session 55 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:35.087082 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:35.107022 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.112048 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.112289 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap823809f8-10, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.112697 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap823809f8-10, col_values=(('qos', UUID('1107be65-8333-476c-8b9a-589bf530c5a7')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.112886 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap823809f8-10, col_values=(('external_ids', {'iface-id': '823809f8-1026-49bb-bea9-35e7f2b0a606', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:3b:74', 'vm-uuid': 'b6529a44-e324-41a7-8db4-fed678008b49'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.115554 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.117182 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:35.144492 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.145504 np0000001565 nova-compute[98289]: INFO os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3b:74,bridge_name='br-int',has_traffic_filtering=True,id=823809f8-1026-49bb-bea9-35e7f2b0a606,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823809f8-10')
May 27 23:05:35.146301 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:05:35.146524 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:35.147021 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4d:67,bridge_name='br-int',has_traffic_filtering=True,id=3a02a883-ae80-41b7-873d-d30284a3b8aa,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a02a883-ae') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:35.147282 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4d:67,bridge_name='br-int',has_traffic_filtering=True,id=3a02a883-ae80-41b7-873d-d30284a3b8aa,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a02a883-ae') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:05:35.147511 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.147689 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.147864 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:05:35.150491 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.150540 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8646c420-f139-5d19-841f-c99d3e509745', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.154018 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:35.182703 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.189599 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.189599 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a02a883-ae, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.189599 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a02a883-ae, col_values=(('qos', UUID('989c4d77-9b78-428b-a0fe-fc40b25ece13')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.191450 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a02a883-ae, col_values=(('external_ids', {'iface-id': '3a02a883-ae80-41b7-873d-d30284a3b8aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:4d:67', 'vm-uuid': 'b6529a44-e324-41a7-8db4-fed678008b49'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:35.199360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.200840 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:35.234635 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.237039 np0000001565 nova-compute[98289]: INFO os_vif [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4d:67,bridge_name='br-int',has_traffic_filtering=True,id=3a02a883-ae80-41b7-873d-d30284a3b8aa,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a02a883-ae')
May 27 23:05:35.463078 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Releasing lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:35.464054 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:05:35.465265 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-38cdec44-b4c2-40ab-a4ea-d255052babf6 req-f1b85374-e918-4f5b-b09b-c1ad853e06e6 service nova] Acquired lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:35.465265 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-38cdec44-b4c2-40ab-a4ea-d255052babf6 req-f1b85374-e918-4f5b-b09b-c1ad853e06e6 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Refreshing network info cache for port ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:35.465346 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Creating image(s)
May 27 23:05:35.466345 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:35.467778 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:35.467778 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:35.467778 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:35.469516 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d9eb4094-e8d2-4c2d-9201-0cf243f0e358 req-bf4b1927-eb3c-4a82-a33a-1f0b5eae9f96 service nova] Releasing lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:35.698720 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "848a1295-d91a-4522-bf36-7d6843c01a28" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:35.698978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:35.775940 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:35.859034 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:05:35.968573 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<2b2f5344-3fbe-469b-bd1f-07b603ac1d33> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:05:35.969915 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-38cdec44-b4c2-40ab-a4ea-d255052babf6 req-f1b85374-e918-4f5b-b09b-c1ad853e06e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:35.975737 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "f81570fff449dcca094ff67d274d4eff61a7ca95" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:35.976350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "f81570fff449dcca094ff67d274d4eff61a7ca95" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.006s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:36.124474 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:36.202777 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Detaching volume e67d2f5e-8603-45c4-bb6c-60c287f67e27
May 27 23:05:36.249439 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Attempting to driver detach volume e67d2f5e-8603-45c4-bb6c-60c287f67e27 from mountpoint /dev/vdb
May 27 23:05:36.288600 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, 'status': 'reserved', 'instance': '848a1295-d91a-4522-bf36-7d6843c01a28', 'attached_at': '', 'detached_at': '', 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'serial': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:05:36.291585 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found disk vdb by alias ua-e67d2f5e-8603-45c4-bb6c-60c287f67e27 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:05:36.293223 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found disk vdb by alias ua-e67d2f5e-8603-45c4-bb6c-60c287f67e27 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:05:36.293223 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Attempting to detach device vdb from instance 848a1295-d91a-4522-bf36-7d6843c01a28 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:05:36.293223 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:05:36.293223 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:36.293223 np0000001565 nova-compute[98289]:   <alias name="ua-e67d2f5e-8603-45c4-bb6c-60c287f67e27"/>
May 27 23:05:36.293223 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-8"/>
May 27 23:05:36.293223 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:05:36.293223 np0000001565 nova-compute[98289]:   <serial>e67d2f5e-8603-45c4-bb6c-60c287f67e27</serial>
May 27 23:05:36.293223 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:05:36.293223 np0000001565 nova-compute[98289]: </disk>
May 27 23:05:36.293223 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:05:36.299157 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully detached device vdb from instance 848a1295-d91a-4522-bf36-7d6843c01a28 from the persistent domain config.
May 27 23:05:36.299157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] (1/8): Attempting to detach device vdb with device alias ua-e67d2f5e-8603-45c4-bb6c-60c287f67e27 from instance 848a1295-d91a-4522-bf36-7d6843c01a28 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:05:36.299157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:05:36.299157 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:36.299157 np0000001565 nova-compute[98289]:   <alias name="ua-e67d2f5e-8603-45c4-bb6c-60c287f67e27"/>
May 27 23:05:36.299157 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-8"/>
May 27 23:05:36.299157 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:05:36.299157 np0000001565 nova-compute[98289]:   <serial>e67d2f5e-8603-45c4-bb6c-60c287f67e27</serial>
May 27 23:05:36.299157 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:05:36.299157 np0000001565 nova-compute[98289]: </disk>
May 27 23:05:36.299157 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:05:36.337353 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-38cdec44-b4c2-40ab-a4ea-d255052babf6 req-f1b85374-e918-4f5b-b09b-c1ad853e06e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:36.543031 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-38cdec44-b4c2-40ab-a4ea-d255052babf6 req-f1b85374-e918-4f5b-b09b-c1ad853e06e6 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updated VIF entry in instance network info cache for port ceb9d24a-c097-4869-8358-4b045b4e9d08. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:05:36.543753 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-38cdec44-b4c2-40ab-a4ea-d255052babf6 req-f1b85374-e918-4f5b-b09b-c1ad853e06e6 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updating instance_info_cache with network_info: [{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:36.676191 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:36.765277 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:36.765585 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:36.765698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] No VIF found with MAC fa:16:3e:4e:52:68, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:05:36.766279 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] No VIF found with MAC fa:16:3e:d3:b7:0f, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:05:36.767077 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Using config drive
May 27 23:05:36.877424 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:36.881142 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:36.881573 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95.part --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:36.881910 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e67d2f5e-8603-45c4-bb6c-60c287f67e27 for instance 848a1295-d91a-4522-bf36-7d6843c01a28 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:05:36.883401 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Found WWN 330000000da324ef1 for multipath device dm-11 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:05:36.883401 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:36.883401 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== connect_volume: return (5469ms) {'type': 'block', 'scsi_wwn': '330000000da324ef1', 'path': '/dev/dm-11', 'multipath_id': '330000000da324ef1'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:36.883401 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000da324ef1', 'path': '/dev/dm-11', 'multipath_id': '330000000da324ef1'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:05:36.894476 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923136.8822305, 848a1295-d91a-4522-bf36-7d6843c01a28 => ua-e67d2f5e-8603-45c4-bb6c-60c287f67e27> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:05:36.901800 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully detached device vdb from instance 848a1295-d91a-4522-bf36-7d6843c01a28 from the live domain config.
May 27 23:05:36.904219 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:05:36.904638 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:05:36.904882 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:05:36.909889 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x726e60440fb0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, 'status': 'reserved', 'instance': '848a1295-d91a-4522-bf36-7d6843c01a28', 'attached_at': '', 'detached_at': '', 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'serial': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27'} {{(pid=98289) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 23:05:36.910107 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.cryptsetup [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] closing encrypted volume /dev/dm-9 {{(pid=98289) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 27 23:05:36.928235 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:05:36.928859 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:36.929115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:36.929679 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:36.930016 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e67d2f5e-8603-45c4-bb6c-60c287f67e27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:05:36.930223 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:36.961296 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:36.962381 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '55')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:05:36.962381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', '51')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:05:36.963054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27', '50')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:05:36.966075 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e387ec2c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27'): ({'sdj'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:05:36.966075 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Removing multipathed devices sdj, sdk {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:05:36.966075 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flush multipath device 3300000000f173ba6 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:05:36.981099 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95.part --force-share --output=json" returned: 0 in 0.099s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:36.981659 np0000001565 nova-compute[98289]: DEBUG nova.virt.images [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] bbac9f2e-6d3e-4928-a8b7-178798b2db6c was qcow2, converting to raw {{(pid=98289) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 23:05:36.982219 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:05:36.982655 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95.part /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95.converted {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:37.001409 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:05:37.041671 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:05:37.048732 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-38cdec44-b4c2-40ab-a4ea-d255052babf6 req-f1b85374-e918-4f5b-b09b-c1ad853e06e6 service nova] Releasing lock "refresh_cache-2b2f5344-3fbe-469b-bd1f-07b603ac1d33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:37.087177 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:05:37.087177 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:05:37.088729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:05:37.099982 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:05:37.100208 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:05:37.111181 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:37.136028 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95.part /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95.converted" returned: 0 in 0.153s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:37.147809 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27, portal: 192.168.40.100,3260]
May 27 23:05:37.147809 np0000001565 nova-compute[98289]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27, portal: 192.168.40.100,3260] successful.
May 27 23:05:37.147809 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:37.148498 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95.converted --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:37.172482 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:37.184077 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] instance snapshotting
May 27 23:05:37.187212 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:37.221585 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27, portal: 192.168.50.100,3260]
May 27 23:05:37.221585 np0000001565 nova-compute[98289]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-e67d2f5e-8603-45c4-bb6c-60c287f67e27, portal: 192.168.50.100,3260] successful.
May 27 23:05:37.221585 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:37.230416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95.converted --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:37.230965 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "f81570fff449dcca094ff67d274d4eff61a7ca95" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.255s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:37.231480 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:37.236355 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:37.237346 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:37.251915 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:37.255412 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:37.256150 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== disconnect_volume: return (327ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:37.256528 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:05:37.277745 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:37.297857 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Beginning live snapshot process
May 27 23:05:37.321610 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95 --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:37.322157 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "f81570fff449dcca094ff67d274d4eff61a7ca95" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:37.322486 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "f81570fff449dcca094ff67d274d4eff61a7ca95" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:37.323742 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:37.326189 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:37.326478 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:37.410484 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Creating config drive at /opt/stack/data/nova/instances/b6529a44-e324-41a7-8db4-fed678008b49/disk.config
May 27 23:05:37.412123 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-755854208',display_name='tempest-ServerActionsTestOtherA-server-755854208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestothera-server-755854208',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDbaj3DPBwSZJeJkSnhSxE7m4eskg4J4EL3Q2BBe+Q8XlC97E7Cxe9kHqz6aAye5+4WemBw1vcR74IA2SLmGxwKECL2TR/u5JVPPAw/fcZ9wwGfIrFs+wKKcahPL14eOA==',key_name='tempest-keypair-729756855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-p9ihn7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=c6934452-ac0c-4d70-8ab4-c09b80c8829f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:05:37.414153 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:37.414153 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:37.414995 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'pci_devices' on Instance uuid c6934452-ac0c-4d70-8ab4-c09b80c8829f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:37.415972 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95 --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:37.416289 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95,backing_fmt=raw /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:37.435214 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6529a44-e324-41a7-8db4-fed678008b49/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppzp4jkyd {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:37.463706 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95,backing_fmt=raw /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk 1073741824" returned: 0 in 0.047s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:37.464477 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "f81570fff449dcca094ff67d274d4eff61a7ca95" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.142s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:37.465048 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:37.484886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6529a44-e324-41a7-8db4-fed678008b49/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppzp4jkyd" returned: 0 in 0.050s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:37.554395 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f81570fff449dcca094ff67d274d4eff61a7ca95 --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:37.555054 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'migration_context' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:37.830685 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid 848a1295-d91a-4522-bf36-7d6843c01a28 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:37.919734 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] End _get_guest_xml xml=<domain type="qemu">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <uuid>c6934452-ac0c-4d70-8ab4-c09b80c8829f</uuid>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <name>instance-0000001f</name>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerActionsTestOtherA-server-755854208</nova:name>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:05:31</nova:creationTime>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:user uuid="8f0d298d70064eac8ffd4fe25b1e203b">tempest-ServerActionsTestOtherA-1786604563-project-member</nova:user>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:project uuid="d6f15f51479c4e37ab880af2031170be">tempest-ServerActionsTestOtherA-1786604563</nova:project>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         <nova:port uuid="3d5f116b-acb3-45c5-852a-ba903302ea2e">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <system>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <entry name="serial">c6934452-ac0c-4d70-8ab4-c09b80c8829f</entry>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <entry name="uuid">c6934452-ac0c-4d70-8ab4-c09b80c8829f</entry>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     </system>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <os>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   </os>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <features>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   </features>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   <devices>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.config"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <alias name="ua-dbaed51e-0782-4850-9c80-429a77200302"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-11"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <serial>dbaed51e-0782-4850-9c80-429a77200302</serial>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:30:d2:ed"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <target dev="tap3d5f116b-ac"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     </interface>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/console.log" append="off"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     </serial>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <video>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     </video>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     </rng>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:   </devices>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]: </domain>
May 27 23:05:37.919734 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:05:37.922622 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Preparing to wait for external event network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:05:37.922622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:37.922622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:37.922622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:37.923014 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-755854208',display_name='tempest-ServerActionsTestOtherA-server-755854208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestothera-server-755854208',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDbaj3DPBwSZJeJkSnhSxE7m4eskg4J4EL3Q2BBe+Q8XlC97E7Cxe9kHqz6aAye5+4WemBw1vcR74IA2SLmGxwKECL2TR/u5JVPPAw/fcZ9wwGfIrFs+wKKcahPL14eOA==',key_name='tempest-keypair-729756855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-p9ihn7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=c6934452-ac0c-4d70-8ab4-c09b80c8829f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:05:37.923306 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:37.924744 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:37.924744 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:05:37.925451 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:37.925451 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:37.925800 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:05:37.927581 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:37.927581 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23e1b558-eeef-5be8-bce7-680f21acb97b', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:37.927985 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:37.928882 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:37.949649 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:37.999727 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.007269 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.007480 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d5f116b-ac, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:38.007823 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d5f116b-ac, col_values=(('qos', UUID('6553e5d4-c62c-4198-bc43-7a9741ec8306')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:38.008115 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d5f116b-ac, col_values=(('external_ids', {'iface-id': '3d5f116b-acb3-45c5-852a-ba903302ea2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:d2:ed', 'vm-uuid': 'c6934452-ac0c-4d70-8ab4-c09b80c8829f'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:38.009946 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.011093 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:38.031149 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.059460 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<2b2f5344-3fbe-469b-bd1f-07b603ac1d33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:05:38.060108 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Rebasing disk image.
May 27 23:05:38.060108 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:38.074250 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.102658 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.104154 np0000001565 nova-compute[98289]: INFO os_vif [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac')
May 27 23:05:38.140459 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.141677 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.081s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:38.141951 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d -F raw /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:38.185370 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.216620 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.218362 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.242792 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.245452 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.283147 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.315584 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.354840 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.374116 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.418422 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.460742 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.487827 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.505240 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.518042 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dddb6f0c-e8a8-44a6-82af-f4c693b8f455 req-c276768d-ab38-4e60-8118-553139a0163a service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-85626fc3-ef41-492d-b3a0-2bb370305172 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:38.518042 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dddb6f0c-e8a8-44a6-82af-f4c693b8f455 req-c276768d-ab38-4e60-8118-553139a0163a service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:38.518042 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dddb6f0c-e8a8-44a6-82af-f4c693b8f455 req-c276768d-ab38-4e60-8118-553139a0163a service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:38.518042 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dddb6f0c-e8a8-44a6-82af-f4c693b8f455 req-c276768d-ab38-4e60-8118-553139a0163a service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:38.518042 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dddb6f0c-e8a8-44a6-82af-f4c693b8f455 req-c276768d-ab38-4e60-8118-553139a0163a service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Processing event network-vif-plugged-85626fc3-ef41-492d-b3a0-2bb370305172 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:05:38.598464 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.615501 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.617076 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.651004 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.659918 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.731641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.822133 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json -f qcow2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:38.841278 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3c4eb821-c20a-4f85-9bca-708d67bd0b93 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.142s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:38.894727 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3776a63e-628b-4ff2-99ec-097ecc4fea85 req-1e7a0535-490b-434c-87aa-8a4dd94f5e53 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:38.894727 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3776a63e-628b-4ff2-99ec-097ecc4fea85 req-1e7a0535-490b-434c-87aa-8a4dd94f5e53 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:38.894727 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3776a63e-628b-4ff2-99ec-097ecc4fea85 req-1e7a0535-490b-434c-87aa-8a4dd94f5e53 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:38.894907 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3776a63e-628b-4ff2-99ec-097ecc4fea85 req-1e7a0535-490b-434c-87aa-8a4dd94f5e53 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:38.894907 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3776a63e-628b-4ff2-99ec-097ecc4fea85 req-1e7a0535-490b-434c-87aa-8a4dd94f5e53 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Processing event network-vif-plugged-3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:05:38.909814 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.915650 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.918148 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.922158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json -f qcow2" returned: 0 in 0.100s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:38.922632 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json -f qcow2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:38.941413 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:38.946447 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.018971 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json -f qcow2" returned: 0 in 0.096s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:39.020021 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:39.024415 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:39.024760 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:39.070158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "848a1295-d91a-4522-bf36-7d6843c01a28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:39.070158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:39.070566 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:39.073727 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:39.074085 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:39.082004 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Terminating instance
May 27 23:05:39.136909 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.112s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:39.137345 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphl8tv2nl/488da433fa354720b049bfd4f15099c5.delta 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:39.193836 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphl8tv2nl/488da433fa354720b049bfd4f15099c5.delta 1073741824" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:39.194647 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Quiescing instance not available: QEMU guest agent is not enabled.
May 27 23:05:39.220492 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.226215 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.270188 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d -F raw /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk" returned: 0 in 1.128s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:39.270771 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:05:39.271001 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Ensure instance console log exists: /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:05:39.271275 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:39.271503 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:39.271695 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:39.273928 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Start _get_guest_xml network_info=[{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='dbfebda61d1d12dfd8e7ee424830fc20',container_format='bare',created_at=2026-05-27T23:05:09Z,direct_url=<?>,disk_format='qcow2',id=bbac9f2e-6d3e-4928-a8b7-178798b2db6c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-142893825-shelved',owner='475430e1d5044d9b97a65459543a1361',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-27T23:05:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3794921a-9377-46fd-b02e-fc402dcfa597', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7244f7e-f2ef-4495-889e-d4e4acc86535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': '2b2f5344-3fbe-469b-bd1f-07b603ac1d33', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7244f7e-f2ef-4495-889e-d4e4acc86535', 'serial': 'e7244f7e-f2ef-4495-889e-d4e4acc86535'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:05:39.276814 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:05:39.278200 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-142893825', uuid='2b2f5344-3fbe-469b-bd1f-07b603ac1d33'), owner=OwnerMeta(userid='dd1c936280234ce2ab39aacb89c5af22', username='tempest-AttachVolumeShelveTestJSON-876504441-project-member', projectid='475430e1d5044d9b97a65459543a1361', projectname='tempest-AttachVolumeShelveTestJSON-876504441'), image=ImageMeta(id='bbac9f2e-6d3e-4928-a8b7-178798b2db6c', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923139.2778602) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:05:39.279503 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:05:39.279843 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:05:39.281257 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:05:39.281257 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:05:39.282373 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:05:39.282716 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='dbfebda61d1d12dfd8e7ee424830fc20',container_format='bare',created_at=2026-05-27T23:05:09Z,direct_url=<?>,disk_format='qcow2',id=bbac9f2e-6d3e-4928-a8b7-178798b2db6c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-142893825-shelved',owner='475430e1d5044d9b97a65459543a1361',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-27T23:05:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:05:39.282848 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:05:39.282931 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:05:39.283053 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:05:39.283131 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:05:39.283243 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:05:39.283408 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:05:39.283503 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:05:39.283620 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:05:39.283715 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:05:39.283826 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:05:39.283979 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:39.395393 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.401481 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.446748 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] COPY block job progress, current cursor: 0 final cursor: 76611584 {{(pid=98289) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 23:05:39.501968 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923139.501579, b6529a44-e324-41a7-8db4-fed678008b49 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:39.502272 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b6529a44-e324-41a7-8db4-fed678008b49] VM Started (Lifecycle Event)
May 27 23:05:39.547062 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.552549 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.593177 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:05:39.615315 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.619433 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.630830 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:39.630935 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:39.631041 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No VIF found with MAC fa:16:3e:30:d2:ed, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:05:39.631486 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Using config drive
May 27 23:05:39.638696 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.787581 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<2b2f5344-3fbe-469b-bd1f-07b603ac1d33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:05:39.797538 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:05:39.797946 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7244f7e-f2ef-4495-889e-d4e4acc86535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:39.798127 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:39.798525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:39.798916 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7244f7e-f2ef-4495-889e-d4e4acc86535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:05:39.811625 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:39.812959 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:39.812959 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:39.813189 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:39.813489 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:39.813926 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:39.827679 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:39.827679 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:39.833951 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:39.833951 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:39.841907 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535] added
May 27 23:05:39.841907 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:39.841907 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:39.841907 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:39.841907 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:39.841907 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:39.841907 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:39.842067 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:39.842241 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:39.843142 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:39.845482 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535] added
May 27 23:05:39.845482 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:39.845482 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:39.845482 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:39.845482 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:39.845482 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:39.845482 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:39.845739 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:39.845947 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:39.846158 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:39.878276 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.889316 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.892569 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.914728 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.924703 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:39.926581 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Instance destroyed successfully.
May 27 23:05:39.927237 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'resources' on Instance uuid 848a1295-d91a-4522-bf36-7d6843c01a28 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:39.949905 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] COPY block job progress, current cursor: 76611584 final cursor: 76611584 {{(pid=98289) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 23:05:39.951768 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Skipping quiescing instance: QEMU guest agent is not enabled.
May 27 23:05:39.994758 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:05:39.995031 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphl8tv2nl/488da433fa354720b049bfd4f15099c5.delta /opt/stack/data/nova/instances/snapshots/tmphl8tv2nl/488da433fa354720b049bfd4f15099c5 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:40.010562 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:40.018067 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923140.0176017, b6529a44-e324-41a7-8db4-fed678008b49 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:40.018311 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b6529a44-e324-41a7-8db4-fed678008b49] VM Paused (Lifecycle Event)
May 27 23:05:40.138275 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:40.179310 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.190945 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.208688 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.211275 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphl8tv2nl/488da433fa354720b049bfd4f15099c5.delta /opt/stack/data/nova/instances/snapshots/tmphl8tv2nl/488da433fa354720b049bfd4f15099c5" returned: 0 in 0.214s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:40.215190 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Snapshot extracted, beginning image upload
May 27 23:05:40.236962 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.238125 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.263894 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Creating config drive at /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.config
May 27 23:05:40.267913 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnpd468ci {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:40.313982 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnpd468ci" returned: 0 in 0.046s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:40.430201 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-115844144',display_name='tempest-TestEncryptedCinderVolumes-server-115844144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-115844144',id=28,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz03M6Pp6+JXVyubKdP/48j2XS6503MAS8sWQc07W5KqxXl1uvnl7zYy8sBIiE5casLSvXJ9DEbyYjOTPnl1HWSQxdK5sCaLFkhMVFtUT8/ZoDQjidA3YWW6H5ehEvarw==',key_name='tempest-keypair-2021354636',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:44Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-rnmgqdog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=848a1295-d91a-4522-bf36-7d6843c01a28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "address": "fa:16:3e:a3:45:83", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7e54f9-e9", "ovs_interfaceid": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:05:40.430440 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "address": "fa:16:3e:a3:45:83", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7e54f9-e9", "ovs_interfaceid": "7f7e54f9-e9ef-4d69-b587-5a09865c22a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:40.431279 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:45:83,bridge_name='br-int',has_traffic_filtering=True,id=7f7e54f9-e9ef-4d69-b587-5a09865c22a2,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7e54f9-e9') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:40.431666 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:45:83,bridge_name='br-int',has_traffic_filtering=True,id=7f7e54f9-e9ef-4d69-b587-5a09865c22a2,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7e54f9-e9') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:05:40.433960 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.434023 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f7e54f9-e9, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:40.450739 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.451200 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:40.455414 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.456455 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.456601 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e048aad4-d680-426d-8c96-84eaaf076a21) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:40.457513 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.458107 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:40.462973 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.467350 np0000001565 nova-compute[98289]: INFO os_vif [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:45:83,bridge_name='br-int',has_traffic_filtering=True,id=7f7e54f9-e9ef-4d69-b587-5a09865c22a2,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f7e54f9-e9')
May 27 23:05:40.467350 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Deleting instance files /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28_del
May 27 23:05:40.467350 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Deletion of /opt/stack/data/nova/instances/848a1295-d91a-4522-bf36-7d6843c01a28_del complete
May 27 23:05:40.524061 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:40.525436 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:05:40.590108 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-85626fc3-ef41-492d-b3a0-2bb370305172 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.590392 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.590663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.591011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.591306 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No event matching network-vif-plugged-85626fc3-ef41-492d-b3a0-2bb370305172 in dict_keys([('network-vif-plugged', 'ba433465-ba01-4869-9685-b6c13a640b01'), ('network-vif-plugged', '7679fe69-489d-4734-889b-15238db0b2de'), ('network-vif-plugged', 'b63228fe-f10e-44de-90aa-ff5a303961f1'), ('network-vif-plugged', '1964f27a-2f2b-4e91-a8f4-95b400a98ed4'), ('network-vif-plugged', '823809f8-1026-49bb-bea9-35e7f2b0a606')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:05:40.591492 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received unexpected event network-vif-plugged-85626fc3-ef41-492d-b3a0-2bb370305172 for instance with vm_state building and task_state spawning.
May 27 23:05:40.591629 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-7679fe69-489d-4734-889b-15238db0b2de {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.591820 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.591968 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.592132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.592281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Processing event network-vif-plugged-7679fe69-489d-4734-889b-15238db0b2de {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:05:40.592522 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-7679fe69-489d-4734-889b-15238db0b2de {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.592663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.592828 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.593120 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.593310 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No event matching network-vif-plugged-7679fe69-489d-4734-889b-15238db0b2de in dict_keys([('network-vif-plugged', 'ba433465-ba01-4869-9685-b6c13a640b01'), ('network-vif-plugged', 'b63228fe-f10e-44de-90aa-ff5a303961f1'), ('network-vif-plugged', '1964f27a-2f2b-4e91-a8f4-95b400a98ed4'), ('network-vif-plugged', '823809f8-1026-49bb-bea9-35e7f2b0a606')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:05:40.593629 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received unexpected event network-vif-plugged-7679fe69-489d-4734-889b-15238db0b2de for instance with vm_state building and task_state spawning.
May 27 23:05:40.593788 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.593931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.594120 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.594295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.594408 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Processing event network-vif-plugged-b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:05:40.594556 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.594708 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.594844 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.594972 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.595113 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No event matching network-vif-plugged-b63228fe-f10e-44de-90aa-ff5a303961f1 in dict_keys([('network-vif-plugged', 'ba433465-ba01-4869-9685-b6c13a640b01'), ('network-vif-plugged', '1964f27a-2f2b-4e91-a8f4-95b400a98ed4'), ('network-vif-plugged', '823809f8-1026-49bb-bea9-35e7f2b0a606')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:05:40.595364 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received unexpected event network-vif-plugged-b63228fe-f10e-44de-90aa-ff5a303961f1 for instance with vm_state building and task_state spawning.
May 27 23:05:40.595409 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.595560 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.595724 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.595852 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.595984 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Processing event network-vif-plugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:05:40.596132 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.596270 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.596424 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.596553 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.596701 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No event matching network-vif-plugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 in dict_keys([('network-vif-plugged', 'ba433465-ba01-4869-9685-b6c13a640b01'), ('network-vif-plugged', '823809f8-1026-49bb-bea9-35e7f2b0a606')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:05:40.596846 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received unexpected event network-vif-plugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 for instance with vm_state building and task_state spawning.
May 27 23:05:40.596986 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.597134 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.597290 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.597442 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.597579 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Processing event network-vif-plugged-823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:05:40.597903 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.598041 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.598179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.598309 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.598468 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No event matching network-vif-plugged-823809f8-1026-49bb-bea9-35e7f2b0a606 in dict_keys([('network-vif-plugged', 'ba433465-ba01-4869-9685-b6c13a640b01')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:05:40.598602 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-0ee94bfd-89ae-421b-96c4-904c47bd4b38 req-4d8e1693-9f24-45b1-b690-866c060af7a9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received unexpected event network-vif-plugged-823809f8-1026-49bb-bea9-35e7f2b0a606 for instance with vm_state building and task_state spawning.
May 27 23:05:40.705395 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.737681 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.740746 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.827204 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.845760 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:40.846874 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:40.860611 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:40.860611 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:40.862822 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:40.862822 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:40.877564 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:40.879122 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.880071 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:40.886476 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:40.898216 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:40.898571 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:40.909102 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:40.909875 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:40.959366 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535, portal: 192.168.40.100,3260]
May 27 23:05:40.959366 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535, portal: 192.168.40.100,3260] successful.
May 27 23:05:40.959366 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:40.965829 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535, portal: 192.168.50.100,3260]
May 27 23:05:40.965829 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535, portal: 192.168.50.100,3260] successful.
May 27 23:05:40.965829 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:40.969991 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.970574 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.970944 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.971080 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.973097 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No event matching network-vif-plugged-3a02a883-ae80-41b7-873d-d30284a3b8aa in dict_keys([('network-vif-plugged', 'ba433465-ba01-4869-9685-b6c13a640b01')]) {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 23:05:40.973729 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received unexpected event network-vif-plugged-3a02a883-ae80-41b7-873d-d30284a3b8aa for instance with vm_state building and task_state spawning.
May 27 23:05:40.973895 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Received event network-vif-unplugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.974436 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:40.974650 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Acquiring lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.974802 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.974900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.975022 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] No waiting events found dispatching network-vif-unplugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:40.975139 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Received event network-vif-unplugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:05:40.975234 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Received event network-vif-unplugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.975358 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Acquiring lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.975851 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.975851 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Lock "848a1295-d91a-4522-bf36-7d6843c01a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.975851 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] No waiting events found dispatching network-vif-unplugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:40.975851 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Received event network-vif-unplugged-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:05:40.975957 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:40.976085 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:40.976491 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:40.976905 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 23:05:40.977430 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:40.979256 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:05:40.979377 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e3bc7ea7-8c8a-422a-8f69-465aae001ad6 req-a0c10160-ba68-4529-bbb4-0f3ed1fd264a service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Processing event network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:05:40.979592 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:05:40.979718 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:05:40.980047 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:40.983304 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:41.002382 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:41.002732 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:41.002957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:41.002957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:41.004199 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:41.005412 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:41.005864 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:41.005864 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:41.006267 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] HCTL ('15', '-', '-', 0) found on session 56 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:41.008990 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:41.011456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] HCTL ('16', '-', '-', 0) found on session 57 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:41.011571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:41.037887 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b6529a44-e324-41a7-8db4-fed678008b49] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:05:41.037887 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999096570999654 future=<Future at 0x726e58737830 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:41.037887 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998324963999721 future=<Future at 0x726e58737830 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:41.037887 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998217568999735 future=<Future at 0x726e58737830 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:41.037887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Searching for a device in session 57 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:41.037887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e7244f7e-f2ef-4495-889e-d4e4acc86535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:41.037887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Searching for a device in session 56 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:41.037887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7244f7e-f2ef-4495-889e-d4e4acc86535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:41.107383 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:41.245710 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:41.605868 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923141.6055214, c6934452-ac0c-4d70-8ab4-c09b80c8829f => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:41.606019 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] VM Started (Lifecycle Event)
May 27 23:05:41.607524 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:05:41.610796 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:05:41.618575 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Instance spawned successfully.
May 27 23:05:41.619059 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:05:41.813641 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:05:42.049583 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:42.108740 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:42.112767 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:05:42.127356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:42.127356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:42.127356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:42.127356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:42.127356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:42.127356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:42.551798 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Took 1.57 seconds to deallocate network for instance.
May 27 23:05:42.615253 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:05:42.615503 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923142.6153548, c6934452-ac0c-4d70-8ab4-c09b80c8829f => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:42.615611 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] VM Paused (Lifecycle Event)
May 27 23:05:42.635661 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Took 11.25 seconds to spawn the instance on the hypervisor.
May 27 23:05:42.635661 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:42.730544 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-30a94f08-627f-492b-943f-da870235da0a req-4d0b7ca4-c5d7-45d1-9e98-80f4b5c328d9 service nova] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Received event network-vif-deleted-7f7e54f9-e9ef-4d69-b587-5a09865c22a2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:42.831815 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Found WWN 330000000553b65f2 for multipath device dm-8 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:05:42.831815 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:42.831815 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000553b65f2', 'path': '/dev/dm-8', 'multipath_id': '330000000553b65f2'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:42.833306 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000553b65f2', 'path': '/dev/dm-8', 'multipath_id': '330000000553b65f2'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:05:42.948094 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7226bd40-320d-4dd5-81d5-3a91b99743e7 req-a25edd02-c933-42f9-95d9-0d68046ecc3e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:42.948343 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7226bd40-320d-4dd5-81d5-3a91b99743e7 req-a25edd02-c933-42f9-95d9-0d68046ecc3e service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:42.948577 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7226bd40-320d-4dd5-81d5-3a91b99743e7 req-a25edd02-c933-42f9-95d9-0d68046ecc3e service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:42.948765 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7226bd40-320d-4dd5-81d5-3a91b99743e7 req-a25edd02-c933-42f9-95d9-0d68046ecc3e service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:42.948918 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7226bd40-320d-4dd5-81d5-3a91b99743e7 req-a25edd02-c933-42f9-95d9-0d68046ecc3e service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Processing event network-vif-plugged-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:05:42.949571 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Instance event wait completed in 3 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:05:42.952445 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:05:42.954144 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Instance spawned successfully.
May 27 23:05:42.954511 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:05:42.992155 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Snapshot image upload complete
May 27 23:05:42.992453 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-05bb84ef-e788-4de5-8b03-3423a6c13435 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Took 5.80 seconds to snapshot the instance on the hypervisor.
May 27 23:05:43.047129 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-40ff54f2-c05b-4c1b-99d7-44c3a36b85f1 req-30fe7452-f87a-498f-9df0-46d53214a3a2 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:43.048785 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40ff54f2-c05b-4c1b-99d7-44c3a36b85f1 req-30fe7452-f87a-498f-9df0-46d53214a3a2 service nova] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:43.049032 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40ff54f2-c05b-4c1b-99d7-44c3a36b85f1 req-30fe7452-f87a-498f-9df0-46d53214a3a2 service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:43.049424 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40ff54f2-c05b-4c1b-99d7-44c3a36b85f1 req-30fe7452-f87a-498f-9df0-46d53214a3a2 service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:43.049590 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-40ff54f2-c05b-4c1b-99d7-44c3a36b85f1 req-30fe7452-f87a-498f-9df0-46d53214a3a2 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] No waiting events found dispatching network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:43.049887 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-40ff54f2-c05b-4c1b-99d7-44c3a36b85f1 req-30fe7452-f87a-498f-9df0-46d53214a3a2 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received unexpected event network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e for instance with vm_state active and task_state None.
May 27 23:05:43.067307 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:43.068238 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:43.119350 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:43.123288 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923143.1226816, c6934452-ac0c-4d70-8ab4-c09b80c8829f => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:43.123464 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] VM Resumed (Lifecycle Event)
May 27 23:05:43.148600 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Took 18.64 seconds to build instance.
May 27 23:05:43.341669 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-142893825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-142893825',id=26,image_ref='bbac9f2e-6d3e-4928-a8b7-178798b2db6c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-140352231',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:28Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-p40b4hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member',shelved_at='2026-05-27T23:05:15.663973',shelved_host='np0000001565',shelved_image_id='bbac9f2e-6d3e-4928-a8b7-178798b2db6c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=2b2f5344-3fbe-469b-bd1f-07b603ac1d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:05:43.341983 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:43.342538 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:43.347139 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:43.463255 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:43.463255 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:43.463255 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:43.463540 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:43.463952 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:43.465160 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:05:43.488069 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:43.578636 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:43.626035 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:43.627703 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:05:43.651536 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa6c2776-81f1-402f-8fb0-86304ea2c1bb tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.148s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:43.705667 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:43.705991 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:43.849978 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<2b2f5344-3fbe-469b-bd1f-07b603ac1d33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:05:43.851217 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] End _get_guest_xml xml=<domain type="qemu">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <uuid>2b2f5344-3fbe-469b-bd1f-07b603ac1d33</uuid>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <name>instance-0000001a</name>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-142893825</nova:name>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:05:39</nova:creationTime>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:user uuid="dd1c936280234ce2ab39aacb89c5af22">tempest-AttachVolumeShelveTestJSON-876504441-project-member</nova:user>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:project uuid="475430e1d5044d9b97a65459543a1361">tempest-AttachVolumeShelveTestJSON-876504441</nova:project>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         <nova:port uuid="ceb9d24a-c097-4869-8358-4b045b4e9d08">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <system>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <entry name="serial">2b2f5344-3fbe-469b-bd1f-07b603ac1d33</entry>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <entry name="uuid">2b2f5344-3fbe-469b-bd1f-07b603ac1d33</entry>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     </system>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <os>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   </os>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <features>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   </features>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   <devices>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.config"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <alias name="ua-e7244f7e-f2ef-4495-889e-d4e4acc86535"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-8"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <target dev="vdc" bus="virtio"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <serial>e7244f7e-f2ef-4495-889e-d4e4acc86535</serial>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ad:f3:02"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <target dev="tapceb9d24a-c0"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     </interface>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/console.log" append="off"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     </serial>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <video>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     </video>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     </rng>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:   </devices>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]: </domain>
May 27 23:05:43.851217 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:05:43.853935 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Preparing to wait for external event network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:05:43.853935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:43.853935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:43.853935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:43.854154 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-142893825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-142893825',id=26,image_ref='bbac9f2e-6d3e-4928-a8b7-178798b2db6c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-140352231',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:28Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-p40b4hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member',shelved_at='2026-05-27T23:05:15.663973',shelved_host='np0000001565',shelved_image_id='bbac9f2e-6d3e-4928-a8b7-178798b2db6c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=2b2f5344-3fbe-469b-bd1f-07b603ac1d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:05:43.857236 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:43.857236 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:43.857236 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:05:43.857236 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:43.857236 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:43.857236 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:05:43.863374 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:43.863498 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbfd3e06-faa3-5f4d-bd77-1d53cc641dc5', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:43.868406 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:43.869138 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:43.873453 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:43.873597 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapceb9d24a-c0, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:43.874088 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapceb9d24a-c0, col_values=(('qos', UUID('a0cf965c-2594-4057-aca3-6bc952e6153a')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:43.874221 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapceb9d24a-c0, col_values=(('external_ids', {'iface-id': 'ceb9d24a-c097-4869-8358-4b045b4e9d08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:f3:02', 'vm-uuid': '2b2f5344-3fbe-469b-bd1f-07b603ac1d33'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:43.876507 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:43.876852 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:43.884633 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:43.885939 np0000001565 nova-compute[98289]: INFO os_vif [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0')
May 27 23:05:43.973403 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Took 29.41 seconds to spawn the instance on the hypervisor.
May 27 23:05:43.974084 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:44.130295 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923144.1300068, b6529a44-e324-41a7-8db4-fed678008b49 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:44.130453 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b6529a44-e324-41a7-8db4-fed678008b49] VM Resumed (Lifecycle Event)
May 27 23:05:44.211278 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:44.488023 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Took 42.16 seconds to build instance.
May 27 23:05:44.634855 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:44.636298 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:05:44.725142 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.657s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:44.772855 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deleted allocations for instance 848a1295-d91a-4522-bf36-7d6843c01a28
May 27 23:05:44.989800 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.673s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:44.997357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:44.997890 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:45.035185 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-plugged-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:45.037771 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:45.037999 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:45.038216 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:45.038403 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-plugged-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:45.038555 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received unexpected event network-vif-plugged-ba433465-ba01-4869-9685-b6c13a640b01 for instance with vm_state active and task_state None.
May 27 23:05:45.038694 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Received event network-changed-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:45.038866 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Refreshing instance network info cache due to event network-changed-a94e67a9-7aeb-4935-b3f6-a13811736551. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:45.039019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] Acquiring lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:45.039137 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] Acquired lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:45.039281 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Refreshing network info cache for port a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:45.121128 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:05:45.121564 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:05:45.125867 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:05:45.418597 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:45.418725 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:45.418938 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:45.419082 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No VIF found with MAC fa:16:3e:ad:f3:02, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:05:45.419623 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Using config drive
May 27 23:05:45.503814 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'flavor' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:45.543083 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:45.630912 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:45.630912 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:45.630912 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:45.630912 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:05:45.782946 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c68b6949-b38a-4a79-8850-d011f51125ee tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "848a1295-d91a-4522-bf36-7d6843c01a28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.713s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:45.843112 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:45.922362 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'ec2_ids' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:45.984686 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Updated VIF entry in instance network info cache for port a94e67a9-7aeb-4935-b3f6-a13811736551. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:05:45.984974 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Updating instance_info_cache with network_info: [{"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:46.202344 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Stashing vm_state: active {{(pid=98289) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 27 23:05:46.426467 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<2b2f5344-3fbe-469b-bd1f-07b603ac1d33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:05:46.426467 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'keypairs' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:46.488697 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] Releasing lock "refresh_cache-3eb890c1-c528-489f-8109-4b7870bfcf33" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:46.488910 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-changed-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:46.489052 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Refreshing instance network info cache due to event network-changed-3d5f116b-acb3-45c5-852a-ba903302ea2e. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:46.489232 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] Acquiring lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:46.489359 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] Acquired lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:46.489502 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Refreshing network info cache for port 3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:46.510492 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:46.665086 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:46.742086 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:46.745495 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:46.761002 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:46.762593 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:46.828933 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:46.830347 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:05:46.832464 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:05:46.833509 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:46.897324 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:46.900627 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:46.925488 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:46.929399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:46.939829 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<2b2f5344-3fbe-469b-bd1f-07b603ac1d33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:05:46.944611 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:46.991712 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:47.010869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:47.017781 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:47.107758 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:47.108164 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:47.150846 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Creating config drive at /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.config
May 27 23:05:47.154860 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0de96a50-c9f9-4778-aa29-b167774a25ee req-00c1ea0b-e264-43c3-b8f1-a27a6e583968 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-changed-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:47.155060 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0de96a50-c9f9-4778-aa29-b167774a25ee req-00c1ea0b-e264-43c3-b8f1-a27a6e583968 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing instance network info cache due to event network-changed-ba433465-ba01-4869-9685-b6c13a640b01. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:47.155564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0de96a50-c9f9-4778-aa29-b167774a25ee req-00c1ea0b-e264-43c3-b8f1-a27a6e583968 service nova] Acquiring lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:47.155659 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0de96a50-c9f9-4778-aa29-b167774a25ee req-00c1ea0b-e264-43c3-b8f1-a27a6e583968 service nova] Acquired lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:47.155842 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0de96a50-c9f9-4778-aa29-b167774a25ee req-00c1ea0b-e264-43c3-b8f1-a27a6e583968 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Refreshing network info cache for port ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:47.165170 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp44iicnsp {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:47.212011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp44iicnsp" returned: 0 in 0.047s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:47.216636 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:47.224222 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:47.276897 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:05:47.277064 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Claim successful on node np0000001565
May 27 23:05:47.329400 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:47.330173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:47.403501 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:05:47.424719 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:47.431853 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:47.504636 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:47.538612 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:47.539178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:47.629558 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:47.629943 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:05:47.635736 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-11 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:05:47.637696 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:05:47.638111 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:05:47.638111 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-10 (vdc) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:05:47.646307 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:47.646454 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:47.646743 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Attaching volume 7f08da9e-88c8-4697-a761-28fc35c7222c to /dev/vdb
May 27 23:05:47.664000 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:47.668276 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-0de96a50-c9f9-4778-aa29-b167774a25ee req-00c1ea0b-e264-43c3-b8f1-a27a6e583968 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:47.675283 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Updated VIF entry in instance network info cache for port 3d5f116b-acb3-45c5-852a-ba903302ea2e. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:05:47.676202 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Updating instance_info_cache with network_info: [{"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:47.690200 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:47.695732 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:47.712665 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:47.727273 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:05:47.752276 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:47.789248 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:47.796356 np0000001565 nova-compute[98289]: INFO nova.compute.resource_tracker [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Updating resource usage from migration 4c007343-e595-4e99-9d27-229c4122eb7c
May 27 23:05:47.818094 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:05:47.818533 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:05:47.829142 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:05:47.832062 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:fe4e:5268', 'fe80::fc16:3eff:feec:ef10', 'fe80::f891:88ff:fe4f:b815', 'fe80::fc16:3eff:fe37:67cf', 'fe80::fc16:3eff:fe5e:b185', 'fe80::fc16:3eff:fed3:b70f', 'fe80::fc16:3eff:fed3:3b74', 'fe80::fc16:3eff:fe4e:4d67', 'fe80::c0e1:aaff:fe84:140a', 'fe80::ecad:ff:fefb:b023', 'fe80::fc16:3eff:fe30:d2ed', 'fe80::fc16:3eff:fead:f302'] 
May 27 23:05:47.832458 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:05:47.832731 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:05:47.833106 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:47.833522 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updating existing volume attachment record: 47be0527-37c8-4c66-91fc-d59698ec36c1 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:05:47.882949 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:48.014698 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:48.016454 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:48.045599 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:48.104665 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:48.113616 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:48.134187 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:48.138568 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:48.138568 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-8 (vdc) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:05:48.142822 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:48.184354 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274d371d-51b1-4bd4-9632-744e240eda4f req-942bb42b-89b0-44aa-a54e-c203f938e5ac service nova] Releasing lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:48.244524 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-0de96a50-c9f9-4778-aa29-b167774a25ee req-00c1ea0b-e264-43c3-b8f1-a27a6e583968 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:48.255595 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:48.256013 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:48.359608 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:48.363944 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:05:48.365059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:48.412406 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:05:48.412969 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:48.413246 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:48.415183 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:48.416316 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:05:48.426484 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:48.427652 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=11381MB free_disk=74.02126693725586GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:05:48.428172 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:48.433465 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:48.434258 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:48.435887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:48.436158 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:48.436520 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:48.436748 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:48.454265 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:48.454265 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:48.461129 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:05:48.461129 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:48.466240 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0de96a50-c9f9-4778-aa29-b167774a25ee req-00c1ea0b-e264-43c3-b8f1-a27a6e583968 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updated VIF entry in instance network info cache for port ba433465-ba01-4869-9685-b6c13a640b01. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:05:48.466240 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0de96a50-c9f9-4778-aa29-b167774a25ee req-00c1ea0b-e264-43c3-b8f1-a27a6e583968 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating instance_info_cache with network_info: [{"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:48.472218 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c] added
May 27 23:05:48.472218 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:48.472218 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:48.472218 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:48.472218 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:48.472218 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:48.472218 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:48.472465 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:48.472615 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:48.472759 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:48.479859 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c] added
May 27 23:05:48.479859 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:05:48.479859 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:48.479859 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:48.479859 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:05:48.479859 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:05:48.479859 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:48.480085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:05:48.480218 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0435(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:05:48.480527 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:05:48.500146 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:48.629235 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923148.6288369, 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:48.630686 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] VM Started (Lifecycle Event)
May 27 23:05:48.672096 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:48.672287 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:48.875967 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:48.969435 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0de96a50-c9f9-4778-aa29-b167774a25ee req-00c1ea0b-e264-43c3-b8f1-a27a6e583968 service nova] Releasing lock "refresh_cache-b6529a44-e324-41a7-8db4-fed678008b49" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:49.132727 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:49.136058 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923149.1358156, 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:49.136260 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] VM Paused (Lifecycle Event)
May 27 23:05:49.170254 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1e77a558-e136-426c-b5bd-138848c0f7f3 req-4a0384ab-71b9-4ce3-8b74-5a685a28805d service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:49.170443 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1e77a558-e136-426c-b5bd-138848c0f7f3 req-4a0384ab-71b9-4ce3-8b74-5a685a28805d service nova] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:49.170651 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1e77a558-e136-426c-b5bd-138848c0f7f3 req-4a0384ab-71b9-4ce3-8b74-5a685a28805d service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:49.170831 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1e77a558-e136-426c-b5bd-138848c0f7f3 req-4a0384ab-71b9-4ce3-8b74-5a685a28805d service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:49.171211 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1e77a558-e136-426c-b5bd-138848c0f7f3 req-4a0384ab-71b9-4ce3-8b74-5a685a28805d service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Processing event network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:05:49.171359 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1e77a558-e136-426c-b5bd-138848c0f7f3 req-4a0384ab-71b9-4ce3-8b74-5a685a28805d service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:49.171485 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1e77a558-e136-426c-b5bd-138848c0f7f3 req-4a0384ab-71b9-4ce3-8b74-5a685a28805d service nova] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:49.171605 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1e77a558-e136-426c-b5bd-138848c0f7f3 req-4a0384ab-71b9-4ce3-8b74-5a685a28805d service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:49.171712 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1e77a558-e136-426c-b5bd-138848c0f7f3 req-4a0384ab-71b9-4ce3-8b74-5a685a28805d service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:49.171812 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1e77a558-e136-426c-b5bd-138848c0f7f3 req-4a0384ab-71b9-4ce3-8b74-5a685a28805d service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] No waiting events found dispatching network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:49.171920 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-1e77a558-e136-426c-b5bd-138848c0f7f3 req-4a0384ab-71b9-4ce3-8b74-5a685a28805d service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received unexpected event network-vif-plugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 for instance with vm_state shelved_offloaded and task_state spawning.
May 27 23:05:49.172174 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:05:49.174650 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:49.179817 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:05:49.182875 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Instance spawned successfully.
May 27 23:05:49.463743 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:49.473227 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:05:49.481355 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:49.487725 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:49.487725 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:05:49.496757 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:05:49.496757 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:49.504353 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:49.512777 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.529217 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.529765 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.535989 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.536447 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:49.587510 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c, portal: 192.168.40.100,3260]
May 27 23:05:49.587510 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c, portal: 192.168.40.100,3260] successful.
May 27 23:05:49.587510 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:49.597315 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c, portal: 192.168.50.100,3260]
May 27 23:05:49.597315 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c, portal: 192.168.50.100,3260] successful.
May 27 23:05:49.597315 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:49.603680 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:49.612216 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:49.630356 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:49.630356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:49.631396 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] HCTL ('21', '-', '-', 0) found on session 58 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:49.631396 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:49.638947 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:49.639852 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:49.640258 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:49.640258 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:49.640606 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:05:49.641898 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] HCTL ('22', '-', '-', 0) found on session 59 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:05:49.642066 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:05:49.642442 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923149.642224, 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:49.642720 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] VM Resumed (Lifecycle Event)
May 27 23:05:49.648810 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Searching for a device in session 58 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:49.648810 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:49.669680 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Searching for a device in session 59 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:05:49.669680 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:05:49.681881 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.919s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:49.681988 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Migrating
May 27 23:05:49.682206 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:05:49.688579 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.646s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:49.707627 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:05:49.707839 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Claim successful on node np0000001565
May 27 23:05:49.973970 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-660b8820-f194-4208-ab5c-ad5e85b88445 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.334s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:50.148579 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:50.150415 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:05:50.207861 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:50.207861 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquired lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:50.207861 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:05:50.436696 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:05:50.465815 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:50.466227 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:50.711364 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:50.968765 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:05:51.093480 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:51.247420 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Updating instance_info_cache with network_info: [{"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:51.357826 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:51.358030 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:51.452993 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Found WWN 33000000058f57dee for multipath device dm-9 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:05:51.453250 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:51.453422 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '33000000058f57dee', 'path': '/dev/dm-9', 'multipath_id': '33000000058f57dee'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:51.453542 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058f57dee', 'path': '/dev/dm-9', 'multipath_id': '33000000058f57dee'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:05:51.455627 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'flavor' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:51.537696 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:51.749586 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Releasing lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:51.860357 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:51.958305 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Attempting to attach volume 7f08da9e-88c8-4697-a761-28fc35c7222c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:05:51.959428 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:05:51.959428 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:05:51.959428 np0000001565 nova-compute[98289]:   <alias name="ua-7f08da9e-88c8-4697-a761-28fc35c7222c"/>
May 27 23:05:51.959428 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-9"/>
May 27 23:05:51.959428 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:05:51.959428 np0000001565 nova-compute[98289]:   <serial>7f08da9e-88c8-4697-a761-28fc35c7222c</serial>
May 27 23:05:51.959428 np0000001565 nova-compute[98289]: </disk>
May 27 23:05:51.959428 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:05:52.370433 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.682s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:52.371041 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 3.943s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:52.372002 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:05:52.890347 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:05:52.890853 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:05:52.890903 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:52.891739 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:52.976695 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6981493505a48ddb709a72af53b32e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7499fc96c14d4fb66aa37e4a78012f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:05:52.985770 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Stashing vm_state: active {{(pid=98289) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 27 23:05:53.262723 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Starting migrate_disk_and_power_off {{(pid=98289) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 27 23:05:53.287996 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.292888 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.319421 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.397163 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Applying migration context for instance c6934452-ac0c-4d70-8ab4-c09b80c8829f as it has an incoming, in-progress migration 4c007343-e595-4e99-9d27-229c4122eb7c. Migration status is migrating {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 27 23:05:53.397839 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:05:53.399279 np0000001565 nova-compute[98289]: INFO nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating resource usage from migration 34edc8f7-eac5-4c5e-86f6-a7ecfcf6fc05
May 27 23:05:53.399420 np0000001565 nova-compute[98289]: INFO nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Updating resource usage from migration 4c007343-e595-4e99-9d27-229c4122eb7c
May 27 23:05:53.467352 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance f47a00cc-da92-40c9-a668-9a160670addd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:05:53.467568 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 3eb890c1-c528-489f-8109-4b7870bfcf33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:05:53.467655 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6a99f05a-6544-4994-9a1a-d98c320d088a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:05:53.467758 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6ab04c1a-7858-471e-95fd-5b04d1da3061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:05:53.467865 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance ad096c70-bfa7-4c5c-88bc-aacf02a9a386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:05:53.467956 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance a7839c43-8fd9-4deb-81c9-f128963f09ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:05:53.468035 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance b6529a44-e324-41a7-8db4-fed678008b49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:05:53.468153 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:05:53.468245 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Migration 4c007343-e595-4e99-9d27-229c4122eb7c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 27 23:05:53.468347 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance c6934452-ac0c-4d70-8ab4-c09b80c8829f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:05:53.468439 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:05:53.474723 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.482210 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.499958 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.525426 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-530b8a08-401a-4348-b665-5f72d649f591 req-fe2a1203-c2be-4cca-8ce2-d06a6211738c service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:53.527712 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-530b8a08-401a-4348-b665-5f72d649f591 req-fe2a1203-c2be-4cca-8ce2-d06a6211738c service nova] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:53.527875 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-530b8a08-401a-4348-b665-5f72d649f591 req-fe2a1203-c2be-4cca-8ce2-d06a6211738c service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:53.527980 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-530b8a08-401a-4348-b665-5f72d649f591 req-fe2a1203-c2be-4cca-8ce2-d06a6211738c service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:53.528140 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-530b8a08-401a-4348-b665-5f72d649f591 req-fe2a1203-c2be-4cca-8ce2-d06a6211738c service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] No waiting events found dispatching network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:53.528547 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-530b8a08-401a-4348-b665-5f72d649f591 req-fe2a1203-c2be-4cca-8ce2-d06a6211738c service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received unexpected event network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e for instance with vm_state active and task_state resize_migrating.
May 27 23:05:53.562194 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Successfully created port: 0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:05:53.574593 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.581493 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:53.600648 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999648732999958 future=<Future at 0x726e6016f200 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:53.604443 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Instance destroyed successfully.
May 27 23:05:53.604443 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-755854208',display_name='tempest-ServerActionsTestOtherA-server-755854208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestothera-server-755854208',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDbaj3DPBwSZJeJkSnhSxE7m4eskg4J4EL3Q2BBe+Q8XlC97E7Cxe9kHqz6aAye5+4WemBw1vcR74IA2SLmGxwKECL2TR/u5JVPPAw/fcZ9wwGfIrFs+wKKcahPL14eOA==',key_name='tempest-keypair-729756855',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:42Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-p9ihn7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=c6934452-ac0c-4d70-8ab4-c09b80c8829f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-872418179-network", "vif_mac": "fa:16:3e:30:d2:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:05:53.604443 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-872418179-network", "vif_mac": "fa:16:3e:30:d2:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:53.604443 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:53.604443 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:05:53.605757 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.606081 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d5f116b-ac, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:53.608415 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.609428 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:53.621293 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:53.621498 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:53.621629 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:53.621762 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No VIF found with MAC fa:16:3e:4e:c5:82, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:05:53.640942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.642265 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.642527 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6553e5d4-c62c-4198-bc43-7a9741ec8306) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:53.643244 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.643929 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:53.646701 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.649230 np0000001565 nova-compute[98289]: INFO os_vif [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac')
May 27 23:05:53.650824 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:05:53.650824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:53.650824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:05:53.651223 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:05:53.651597 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:05:53.651832 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:53.692099 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:05:53.695385 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '59')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '55')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '54')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e601c5580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'): ({'sdn'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:05:53.695385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Removing multipathed devices sdo, sdn {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:05:53.696266 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flush multipath device 330000000da324ef1 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:05:53.747852 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:05:53.779799 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.780747 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.813272 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:05:53.857985 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:05:53.860780 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:05:53.860780 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:05:53.875265 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:05:53.875265 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:05:53.888323 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:53.908431 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:05:53.932845 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.40.100,3260]
May 27 23:05:53.932845 np0000001565 nova-compute[98289]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.40.100,3260] successful.
May 27 23:05:53.932845 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:53.956807 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:53.962503 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:53.971215 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 27 23:05:53.971364 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Migration 34edc8f7-eac5-4c5e-86f6-a7ecfcf6fc05 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 27 23:05:53.971507 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance a6723b2d-e0b1-495c-910d-3ef37d877c05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:05:53.971726 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:05:53.971857 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=2944MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:05:48 up 34 min,  2 users,  load average: 7.85, 6.70, 3.51\n', 'num_instances': '11', 'num_vm_active': '10', 'num_task_None': '9', 'num_os_type_None': '11', 'num_proj_0ec877dc7b2240969ac89c13673f8799': '5', 'io_workload': '3', 'num_proj_d6f15f51479c4e37ab880af2031170be': '2', 'num_proj_475430e1d5044d9b97a65459543a1361': '1', 'num_task_resize_prep': '1', 'num_proj_0a9dde83267d415abbd137e795ac45e9': '1', 'num_proj_3c3b9a9477ae4742b8584b00bec574cc': '1', 'num_task_resize_migrating': '1', 'num_vm_building': '1', 'num_proj_4d7499fc96c14d4fb66aa37e4a78012f': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:05:53.977034 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:54.025753 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.50.100,3260]
May 27 23:05:54.025753 np0000001565 nova-compute[98289]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.50.100,3260] successful.
May 27 23:05:54.025753 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:54.059627 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:05:54.059627 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:05:54.059627 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== disconnect_volume: return (408ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:54.059627 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:05:54.061980 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] skipping disk /dev/dm-11 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:05:54.062718 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f_resize/disk.config /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.config {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:54.113299 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "cp -r /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f_resize/disk.config /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.config" returned: 0 in 0.050s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:54.152315 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Successfully updated port: 0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:05:54.218956 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f271067b-c2e1-4c51-a599-aeb5e8234a59 req-ae2981a8-38e6-45f9-a87c-4620baf2f16c service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Received event network-changed-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:54.221252 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f271067b-c2e1-4c51-a599-aeb5e8234a59 req-ae2981a8-38e6-45f9-a87c-4620baf2f16c service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Refreshing instance network info cache due to event network-changed-0a402bfd-33f6-497c-98f2-fa3d90821848. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:05:54.221252 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f271067b-c2e1-4c51-a599-aeb5e8234a59 req-ae2981a8-38e6-45f9-a87c-4620baf2f16c service nova] Acquiring lock "refresh_cache-225ad6d6-6422-4bab-994c-fcc6c720b0ea" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:54.221252 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f271067b-c2e1-4c51-a599-aeb5e8234a59 req-ae2981a8-38e6-45f9-a87c-4620baf2f16c service nova] Acquired lock "refresh_cache-225ad6d6-6422-4bab-994c-fcc6c720b0ea" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:54.221252 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f271067b-c2e1-4c51-a599-aeb5e8234a59 req-ae2981a8-38e6-45f9-a87c-4620baf2f16c service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Refreshing network info cache for port 0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:05:54.655693 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "refresh_cache-225ad6d6-6422-4bab-994c-fcc6c720b0ea" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:54.679982 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:54.680237 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:54.722511 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f271067b-c2e1-4c51-a599-aeb5e8234a59 req-ae2981a8-38e6-45f9-a87c-4620baf2f16c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:54.791852 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f271067b-c2e1-4c51-a599-aeb5e8234a59 req-ae2981a8-38e6-45f9-a87c-4620baf2f16c service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:05:54.921173 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:05:54.922298 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:05:54.922567 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Creating image(s)
May 27 23:05:54.923014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "/opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:54.924385 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "/opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:54.927045 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "/opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:54.928363 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:54.932071 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:54.937304 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f271067b-c2e1-4c51-a599-aeb5e8234a59 req-ae2981a8-38e6-45f9-a87c-4620baf2f16c service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:54.937481 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:55.039097 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:55.039576 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:55.040049 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:55.040506 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:55.043599 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:05:55.043969 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:55.149621 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.104s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:55.150423 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:55.191105 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:55.198841 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd5d9085-45f3-4bea-aa7a-e12426fcc0b2 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.552s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:55.220979 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk 1073741824" returned: 0 in 0.070s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:55.222360 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:55.222360 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:55.272146 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:55.272507 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:55.312702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:55.319007 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Checking if we can resize image /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:05:55.319007 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:55.343024 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Port 3d5f116b-acb3-45c5-852a-ba903302ea2e binding to destination host np0000001565 is already ACTIVE {{(pid=98289) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 23:05:55.438596 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f271067b-c2e1-4c51-a599-aeb5e8234a59 req-ae2981a8-38e6-45f9-a87c-4620baf2f16c service nova] Releasing lock "refresh_cache-225ad6d6-6422-4bab-994c-fcc6c720b0ea" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:55.439785 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquired lock "refresh_cache-225ad6d6-6422-4bab-994c-fcc6c720b0ea" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:55.440393 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:05:55.444124 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:55.444595 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Cannot resize image /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:05:55.445025 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:05:55.445292 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Ensure instance console log exists: /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:05:55.446144 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:55.446885 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:55.447305 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:55.606260 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fe1a13ba-42b3-4ab0-949a-357374643b3c req-915ba30e-a433-4f80-bf35-8e08e1e4ddb6 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:55.606755 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe1a13ba-42b3-4ab0-949a-357374643b3c req-915ba30e-a433-4f80-bf35-8e08e1e4ddb6 service nova] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:55.606965 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe1a13ba-42b3-4ab0-949a-357374643b3c req-915ba30e-a433-4f80-bf35-8e08e1e4ddb6 service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:55.607138 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe1a13ba-42b3-4ab0-949a-357374643b3c req-915ba30e-a433-4f80-bf35-8e08e1e4ddb6 service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:55.607298 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fe1a13ba-42b3-4ab0-949a-357374643b3c req-915ba30e-a433-4f80-bf35-8e08e1e4ddb6 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] No waiting events found dispatching network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:55.607839 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-fe1a13ba-42b3-4ab0-949a-357374643b3c req-915ba30e-a433-4f80-bf35-8e08e1e4ddb6 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received unexpected event network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e for instance with vm_state active and task_state resize_migrating.
May 27 23:05:55.646352 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Rescuing
May 27 23:05:55.646517 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:55.646598 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquired lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:55.646712 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:05:55.705502 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:05:55.706088 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.335s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:55.706644 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.169s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:55.707110 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:05:55.711830 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:05:55.712041 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Claim successful on node np0000001565
May 27 23:05:56.008175 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:05:56.030179 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00044409900010577985 future=<Future at 0x726e58737830 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:56.030320 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:56.030470 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=12.569784252999852 future=<Future at 0x726e6016f200 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:56.030547 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=12.569696065999779 future=<Future at 0x726e6016f200 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:56.032114 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Emitting event <LifecycleEvent: 1779923141.0296311, 848a1295-d91a-4522-bf36-7d6843c01a28 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:05:56.032295 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] VM Stopped (Lifecycle Event)
May 27 23:05:56.151504 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:56.220533 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:56.354469 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Updating instance_info_cache with network_info: [{"id": "0a402bfd-33f6-497c-98f2-fa3d90821848", "address": "fa:16:3e:94:b6:ed", "network": {"id": "8735eb81-21d5-4f21-a6eb-53a9644b4eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1470727070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d7499fc96c14d4fb66aa37e4a78012f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a402bfd-33", "ovs_interfaceid": "0a402bfd-33f6-497c-98f2-fa3d90821848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:56.356983 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:05:56.365229 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:56.365486 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:56.365594 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:56.520451 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:56.538905 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-48584868-8f9a-47a5-a17b-8e0b91b57fa6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 848a1295-d91a-4522-bf36-7d6843c01a28] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:05:56.672928 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updating instance_info_cache with network_info: [{"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:56.863158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Releasing lock "refresh_cache-225ad6d6-6422-4bab-994c-fcc6c720b0ea" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:56.863509 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Instance network_info: |[{"id": "0a402bfd-33f6-497c-98f2-fa3d90821848", "address": "fa:16:3e:94:b6:ed", "network": {"id": "8735eb81-21d5-4f21-a6eb-53a9644b4eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1470727070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d7499fc96c14d4fb66aa37e4a78012f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a402bfd-33", "ovs_interfaceid": "0a402bfd-33f6-497c-98f2-fa3d90821848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:05:56.865583 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Start _get_guest_xml network_info=[{"id": "0a402bfd-33f6-497c-98f2-fa3d90821848", "address": "fa:16:3e:94:b6:ed", "network": {"id": "8735eb81-21d5-4f21-a6eb-53a9644b4eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1470727070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d7499fc96c14d4fb66aa37e4a78012f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a402bfd-33", "ovs_interfaceid": "0a402bfd-33f6-497c-98f2-fa3d90821848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:05:56.868205 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:05:56.870463 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-1904737129', uuid='225ad6d6-6422-4bab-994c-fcc6c720b0ea'), owner=OwnerMeta(userid='e6981493505a48ddb709a72af53b32e2', username='tempest-TestServerVolumeAttachmentScenario-1351084007-project-member', projectid='4d7499fc96c14d4fb66aa37e4a78012f', projectname='tempest-TestServerVolumeAttachmentScenario-1351084007'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0a402bfd-33f6-497c-98f2-fa3d90821848", "address": "fa:16:3e:94:b6:ed", "network": {"id": "8735eb81-21d5-4f21-a6eb-53a9644b4eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1470727070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d7499fc96c14d4fb66aa37e4a78012f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a402bfd-33", "ovs_interfaceid": "0a402bfd-33f6-497c-98f2-fa3d90821848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923156.8699336) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:05:56.873525 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:05:56.873525 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:05:56.874168 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:05:56.874452 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:05:56.876014 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:05:56.879355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:05:56.879355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:05:56.879355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:05:56.879355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:05:56.879355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:05:56.879355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:05:56.879355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:05:56.879355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:05:56.879355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:05:56.879355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:05:56.879355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:05:56.898021 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1904737129',display_name='tempest-TestServerVolumeAttachmentScenario-server-1904737129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testservervolumeattachmentscenario-server-1904737129',id=32,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB13SwsiBOAlMVT+VIsGjYXmE64ey9TquoOH13ukkDBHlieqsEQnVLo8RPdyJ2lj4GyKJ3ozNNBMWYEKioNU/unRpN+YoTY4RtHSexXuspbT98NJQjJFmQBvmEdtR+LOMA==',key_name='tempest-keypair-1577371764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d7499fc96c14d4fb66aa37e4a78012f',ramdisk_id='',reservation_id='r-k03kq343',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1351084007',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1351084007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6981493505a48ddb709a72af53b32e2',uuid=225ad6d6-6422-4bab-994c-fcc6c720b0ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a402bfd-33f6-497c-98f2-fa3d90821848", "address": "fa:16:3e:94:b6:ed", "network": {"id": "8735eb81-21d5-4f21-a6eb-53a9644b4eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1470727070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d7499fc96c14d4fb66aa37e4a78012f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a402bfd-33", "ovs_interfaceid": "0a402bfd-33f6-497c-98f2-fa3d90821848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:05:56.898466 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Converting VIF {"id": "0a402bfd-33f6-497c-98f2-fa3d90821848", "address": "fa:16:3e:94:b6:ed", "network": {"id": "8735eb81-21d5-4f21-a6eb-53a9644b4eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1470727070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d7499fc96c14d4fb66aa37e4a78012f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a402bfd-33", "ovs_interfaceid": "0a402bfd-33f6-497c-98f2-fa3d90821848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:56.899289 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:b6:ed,bridge_name='br-int',has_traffic_filtering=True,id=0a402bfd-33f6-497c-98f2-fa3d90821848,network=Network(8735eb81-21d5-4f21-a6eb-53a9644b4eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a402bfd-33') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:56.900076 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lazy-loading 'pci_devices' on Instance uuid 225ad6d6-6422-4bab-994c-fcc6c720b0ea {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:57.175745 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Releasing lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:57.359813 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:05:57.360058 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:05:57.393416 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:57.402356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] End _get_guest_xml xml=<domain type="qemu">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <uuid>225ad6d6-6422-4bab-994c-fcc6c720b0ea</uuid>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <name>instance-00000020</name>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1904737129</nova:name>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:05:56</nova:creationTime>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:user uuid="e6981493505a48ddb709a72af53b32e2">tempest-TestServerVolumeAttachmentScenario-1351084007-project-member</nova:user>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:project uuid="4d7499fc96c14d4fb66aa37e4a78012f">tempest-TestServerVolumeAttachmentScenario-1351084007</nova:project>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         <nova:port uuid="0a402bfd-33f6-497c-98f2-fa3d90821848">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <system>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <entry name="serial">225ad6d6-6422-4bab-994c-fcc6c720b0ea</entry>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <entry name="uuid">225ad6d6-6422-4bab-994c-fcc6c720b0ea</entry>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     </system>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <os>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   </os>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <features>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   </features>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   <devices>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk.config"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     </disk>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:94:b6:ed"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <target dev="tap0a402bfd-33"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     </interface>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/console.log" append="off"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     </serial>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <video>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     </video>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     </rng>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:   </devices>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]: </domain>
May 27 23:05:57.402356 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:05:57.408875 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Preparing to wait for external event network-vif-plugged-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:05:57.408875 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:57.408875 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:57.408875 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:57.408875 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1904737129',display_name='tempest-TestServerVolumeAttachmentScenario-server-1904737129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testservervolumeattachmentscenario-server-1904737129',id=32,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB13SwsiBOAlMVT+VIsGjYXmE64ey9TquoOH13ukkDBHlieqsEQnVLo8RPdyJ2lj4GyKJ3ozNNBMWYEKioNU/unRpN+YoTY4RtHSexXuspbT98NJQjJFmQBvmEdtR+LOMA==',key_name='tempest-keypair-1577371764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d7499fc96c14d4fb66aa37e4a78012f',ramdisk_id='',reservation_id='r-k03kq343',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1351084007',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1351084007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6981493505a48ddb709a72af53b32e2',uuid=225ad6d6-6422-4bab-994c-fcc6c720b0ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a402bfd-33f6-497c-98f2-fa3d90821848", "address": "fa:16:3e:94:b6:ed", "network": {"id": "8735eb81-21d5-4f21-a6eb-53a9644b4eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1470727070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d7499fc96c14d4fb66aa37e4a78012f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a402bfd-33", "ovs_interfaceid": "0a402bfd-33f6-497c-98f2-fa3d90821848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:05:57.411301 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Converting VIF {"id": "0a402bfd-33f6-497c-98f2-fa3d90821848", "address": "fa:16:3e:94:b6:ed", "network": {"id": "8735eb81-21d5-4f21-a6eb-53a9644b4eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1470727070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d7499fc96c14d4fb66aa37e4a78012f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a402bfd-33", "ovs_interfaceid": "0a402bfd-33f6-497c-98f2-fa3d90821848", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:05:57.411301 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:b6:ed,bridge_name='br-int',has_traffic_filtering=True,id=0a402bfd-33f6-497c-98f2-fa3d90821848,network=Network(8735eb81-21d5-4f21-a6eb-53a9644b4eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a402bfd-33') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:05:57.411301 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:b6:ed,bridge_name='br-int',has_traffic_filtering=True,id=0a402bfd-33f6-497c-98f2-fa3d90821848,network=Network(8735eb81-21d5-4f21-a6eb-53a9644b4eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a402bfd-33') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:05:57.411549 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:57.411867 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:57.414690 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:05:57.415704 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:57.415887 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ef454f0-2afe-5458-911a-aeee2a952a91', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:57.416662 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:57.417246 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:57.418931 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:57.421162 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:57.421317 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a402bfd-33, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:57.421645 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a402bfd-33, col_values=(('qos', UUID('5d2ec9dc-0d8d-4208-a531-e0752e974ed4')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:57.421799 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a402bfd-33, col_values=(('external_ids', {'iface-id': '0a402bfd-33f6-497c-98f2-fa3d90821848', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:b6:ed', 'vm-uuid': '225ad6d6-6422-4bab-994c-fcc6c720b0ea'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:05:57.424189 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:57.425816 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:05:57.430507 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:57.431821 np0000001565 nova-compute[98289]: INFO os_vif [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:b6:ed,bridge_name='br-int',has_traffic_filtering=True,id=0a402bfd-33f6-497c-98f2-fa3d90821848,network=Network(8735eb81-21d5-4f21-a6eb-53a9644b4eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a402bfd-33')
May 27 23:05:57.493819 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:05:57.493954 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquired lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:05:57.494099 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:05:57.698932 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:05:57.699353 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:05:57.699915 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:05:57.700176 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:05:57.700484 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:05:57.700755 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:05:57.701009 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:05:57.701177 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:05:57.701484 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.42 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:05:57.865359 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:05:57.996241 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:58.261691 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:58.370421 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.664s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:58.371270 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 4.790s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:58.371533 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:05:58.388394 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Updating instance_info_cache with network_info: [{"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:05:58.502746 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:58.824382 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:58.835484 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:58.848254 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:58.857142 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:58.881099 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:05:58.881272 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Claim successful on node np0000001565
May 27 23:05:58.886723 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:58.888027 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:05:58.888214 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:05:58.888471 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:58.888682 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:58.891394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Releasing lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:05:58.896293 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:05:58.948325 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:58.948652 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:05:58.948925 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No VIF found with MAC fa:16:3e:94:b6:ed, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:05:58.949263 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Using config drive
May 27 23:05:59.010861 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e15e4b45c874974b28db7f3448a3945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b69ef10bedf41b48b1455ae48aa534e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:05:59.086022 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-299e2c29-aebe-4aea-997b-a765f4785c38 req-18617ed0-8a3d-4d58-a7df-31c7e0422a5f service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:05:59.086022 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-299e2c29-aebe-4aea-997b-a765f4785c38 req-18617ed0-8a3d-4d58-a7df-31c7e0422a5f service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:59.086022 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-299e2c29-aebe-4aea-997b-a765f4785c38 req-18617ed0-8a3d-4d58-a7df-31c7e0422a5f service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:59.086022 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-299e2c29-aebe-4aea-997b-a765f4785c38 req-18617ed0-8a3d-4d58-a7df-31c7e0422a5f service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:59.086022 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-299e2c29-aebe-4aea-997b-a765f4785c38 req-18617ed0-8a3d-4d58-a7df-31c7e0422a5f service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] No waiting events found dispatching network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:05:59.086022 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-299e2c29-aebe-4aea-997b-a765f4785c38 req-18617ed0-8a3d-4d58-a7df-31c7e0422a5f service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received unexpected event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f for instance with vm_state active and task_state rescuing.
May 27 23:05:59.137529 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999593559000004 future=<Future at 0x726e587020f0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:05:59.140201 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Instance destroyed successfully.
May 27 23:05:59.140201 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'numa_topology' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:59.388051 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:05:59.391000 np0000001565 nova-compute[98289]: INFO nova.compute.resource_tracker [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating resource usage from migration 34edc8f7-eac5-4c5e-86f6-a7ecfcf6fc05
May 27 23:05:59.405380 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:05:59.424217 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:05:59.446873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:59.472510 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:05:59.484220 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:05:59.484515 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:05:59.491676 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:05:59.493792 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:fe4e:5268', 'fe80::fc16:3eff:feec:ef10', 'fe80::f891:88ff:fe4f:b815', 'fe80::fc16:3eff:fe37:67cf', 'fe80::fc16:3eff:fe5e:b185', 'fe80::fc16:3eff:fed3:b70f', 'fe80::fc16:3eff:fed3:3b74', 'fe80::fc16:3eff:fe4e:4d67', 'fe80::c0e1:aaff:fe84:140a', 'fe80::ecad:ff:fefb:b023', 'fe80::fc16:3eff:fead:f302', 'fe80::f886:b6ff:fe99:9ebe'] 
May 27 23:05:59.493941 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:05:59.494075 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:05:59.494456 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:05:59.543758 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Successfully created port: 08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:05:59.635133 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Creating config drive at /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk.config
May 27 23:05:59.642247 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6zzpr0pn {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:05:59.674770 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Attempting a stable device rescue
May 27 23:05:59.704610 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6zzpr0pn" returned: 0 in 0.062s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:05:59.792019 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98289) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 23:05:59.797959 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Instance directory exists: not creating {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 23:05:59.798218 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Creating image(s)
May 27 23:05:59.799888 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:05:59.800416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:05:59.800876 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:05:59.801129 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'trusted_certs' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:05:59.894566 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:06:00.114082 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Successfully updated port: 08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:06:00.187802 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:00.231411 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:00.240706 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:06:00.240907 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:06:00.304785 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Object Instance<ad096c70-bfa7-4c5c-88bc-aacf02a9a386> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:06:00.305016 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "a7d36853d3960a1d1323edca15629c7b48be9bf9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:00.305416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "a7d36853d3960a1d1323edca15629c7b48be9bf9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:00.317284 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:00.418048 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-30e53e09-814e-4a18-b6bf-5160efb2a5e9 req-5110bd9c-4d51-4ab1-b2ef-5cb5511d02a7 service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Received event network-vif-plugged-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:00.418048 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-30e53e09-814e-4a18-b6bf-5160efb2a5e9 req-5110bd9c-4d51-4ab1-b2ef-5cb5511d02a7 service nova] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:00.418048 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-30e53e09-814e-4a18-b6bf-5160efb2a5e9 req-5110bd9c-4d51-4ab1-b2ef-5cb5511d02a7 service nova] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:00.418048 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-30e53e09-814e-4a18-b6bf-5160efb2a5e9 req-5110bd9c-4d51-4ab1-b2ef-5cb5511d02a7 service nova] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:00.418048 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-30e53e09-814e-4a18-b6bf-5160efb2a5e9 req-5110bd9c-4d51-4ab1-b2ef-5cb5511d02a7 service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Processing event network-vif-plugged-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:06:00.569883 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:00.576159 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:00.584612 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:00.615490 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:00.616189 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "refresh_cache-8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:00.616276 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquired lock "refresh_cache-8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:00.616468 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:06:00.631790 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:00.659365 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Starting finish_migration {{(pid=98289) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 27 23:06:00.660077 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Instance directory exists: not creating {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 23:06:00.661366 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Creating image(s)
May 27 23:06:00.661366 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:06:00.661366 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Ensure instance console log exists: /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:06:00.661366 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:00.661591 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:00.661749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:00.662313 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Start _get_guest_xml network_info=[{"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-872418179-network", "vif_mac": "fa:16:3e:30:d2:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '33bee095-6cdd-4f0e-85b2-4a69c200010f', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'c6934452-ac0c-4d70-8ab4-c09b80c8829f', 'attached_at': '2026-05-27T23:06:00.000000', 'detached_at': '', 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'serial': 'dbaed51e-0782-4850-9c80-429a77200302'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:06:00.664600 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:06:00.665518 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-755854208', uuid='c6934452-ac0c-4d70-8ab4-c09b80c8829f'), owner=OwnerMeta(userid='8f0d298d70064eac8ffd4fe25b1e203b', username='tempest-ServerActionsTestOtherA-1786604563-project-member', projectid='d6f15f51479c4e37ab880af2031170be', projectname='tempest-ServerActionsTestOtherA-1786604563'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-872418179-network", "vif_mac": "fa:16:3e:30:d2:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923160.6652064) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:06:00.666998 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:06:00.667192 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:06:00.668264 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:06:00.668791 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:06:00.669950 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:06:00.670205 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:06:00.670342 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:06:00.670474 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:06:00.670593 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:06:00.670676 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:06:00.670964 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:06:00.672008 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:06:00.672008 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:06:00.672008 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:06:00.672008 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:06:00.672008 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:06:00.682347 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:00.745804 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:06:00.776041 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.config --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:00.776952 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:00.777560 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "/opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:00.779123 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "/opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:00.779123 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:06:00.779506 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:00.779779 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:00.780281 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:00.780650 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:06:00.795711 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:00.795990 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:00.797414 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:06:00.797414 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:00.797585 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:00.797692 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:06:00.814109 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:06:00.814109 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:00.821664 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:06:00.821664 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:00.828578 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302] added
May 27 23:06:00.828578 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:06:00.828578 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:00.828578 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:00.828578 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:00.828578 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:00.828578 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:00.830448 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:06:00.830448 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:06:00.830448 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:06:00.834949 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302] added
May 27 23:06:00.834949 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:06:00.834949 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:00.834949 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:00.834949 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:00.834949 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:00.834949 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:00.836650 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:06:00.836650 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.039(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:06:00.836650 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:06:00.909000 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:06:00.910695 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:06:00.911188 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Creating image(s)
May 27 23:06:00.911929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:00.912272 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:00.913089 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:00.914340 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:00.919029 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:00.921021 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:01.023449 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:01.024069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:01.024949 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:01.025790 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:01.030471 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:01.030987 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:01.115017 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:01.115599 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:01.149198 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:06:01.159006 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923161.1527224, 225ad6d6-6422-4bab-994c-fcc6c720b0ea => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:01.159006 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] VM Started (Lifecycle Event)
May 27 23:06:01.169495 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:01.169495 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:01.169495 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:01.169653 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:01.175708 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:06:01.178745 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] No waiting events found dispatching network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:01.178913 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received unexpected event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f for instance with vm_state active and task_state rescuing.
May 27 23:06:01.179041 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Received event network-changed-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:01.179149 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Refreshing instance network info cache due to event network-changed-08e938e2-06e5-4e01-ba76-5db7c55efa5a. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:06:01.179286 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] Acquiring lock "refresh_cache-8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:01.182046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk 1073741824" returned: 0 in 0.066s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:01.182546 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:01.182948 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:01.210755 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Instance spawned successfully.
May 27 23:06:01.212680 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:06:01.227562 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:06:01.243987 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:01.246692 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:01.247015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9.part --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:01.267014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.896s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:01.267761 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Migrating
May 27 23:06:01.269271 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:06:01.277206 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:01.280379 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:06:01.280823 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:01.355736 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9.part --force-share --output=json" returned: 0 in 0.108s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:01.356111 np0000001565 nova-compute[98289]: DEBUG nova.virt.images [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] 1f3ecd2c-22d0-441d-8241-3a14d4bdaa34 was qcow2, converting to raw {{(pid=98289) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 23:06:01.356738 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:06:01.357049 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9.part /opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9.converted {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:01.383306 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:01.385503 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Cannot resize image /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:06:01.386475 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:06:01.387558 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Ensure instance console log exists: /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:06:01.389352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:01.389352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:01.389791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:01.482151 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:01.519172 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9.part /opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9.converted" returned: 0 in 0.162s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:01.530564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9.converted --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:01.652480 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9.converted --force-share --output=json" returned: 0 in 0.122s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:01.654167 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "a7d36853d3960a1d1323edca15629c7b48be9bf9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.349s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:01.654838 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:01.663289 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:01.665470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "a7d36853d3960a1d1323edca15629c7b48be9bf9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:01.665927 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "a7d36853d3960a1d1323edca15629c7b48be9bf9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:01.666302 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:01.673604 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:01.675994 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:01.678027 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:01.699345 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Updating instance_info_cache with network_info: [{"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:01.717350 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:01.738966 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:01.739071 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:01.739459 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:01.739711 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:01.739993 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:01.740287 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:01.783105 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9 --force-share --output=json" returned: 0 in 0.105s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:01.786150 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9,backing_fmt=raw /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.rescue {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:01.814483 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:01.814756 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:01.815376 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:06:01.831840 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:06:01.835674 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:06:01.844071 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7d36853d3960a1d1323edca15629c7b48be9bf9,backing_fmt=raw /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.rescue" returned: 0 in 0.060s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:01.845845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "a7d36853d3960a1d1323edca15629c7b48be9bf9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:01.845845 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'migration_context' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:01.849113 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:01.849113 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:01.854736 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:01.854736 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:01.862184 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:01.869679 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.881054 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.881703 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.888661 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.889148 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:01.935536 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.50.100,3260]
May 27 23:06:01.935536 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.50.100,3260] successful.
May 27 23:06:01.935536 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:01.948627 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.40.100,3260]
May 27 23:06:01.948627 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.40.100,3260] successful.
May 27 23:06:01.948627 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:01.948879 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:01.962648 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:01.972007 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:01.972458 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:01.972766 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:01.972832 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:01.975017 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] HCTL ('19', '-', '-', 0) found on session 60 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:01.975177 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:01.985113 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:01.985657 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:01.985657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:01.985994 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:01.991657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] HCTL ('20', '-', '-', 0) found on session 61 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:01.991657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:01.991657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching for a device in session 60 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:01.991657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:02.004414 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Searching for a device in session 61 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:02.004414 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:02.214753 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Releasing lock "refresh_cache-8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:02.215057 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Instance network_info: |[{"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:06:02.216871 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] Acquired lock "refresh_cache-8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:02.216871 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Refreshing network info cache for port 08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:06:02.218502 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Start _get_guest_xml network_info=[{"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:06:02.219977 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:06:02.219977 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923162.2200317, 225ad6d6-6422-4bab-994c-fcc6c720b0ea => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:02.219977 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] VM Paused (Lifecycle Event)
May 27 23:06:02.226199 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:06:02.227743 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1506449161', uuid='8e6a355e-e4c7-4d32-9a78-9ce892cd35ef'), owner=OwnerMeta(userid='1e15e4b45c874974b28db7f3448a3945', username='tempest-TestEncryptedCinderVolumes-762189049-project-member', projectid='8b69ef10bedf41b48b1455ae48aa534e', projectname='tempest-TestEncryptedCinderVolumes-762189049'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923162.2273571) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:06:02.229273 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:06:02.229775 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:06:02.230901 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:06:02.231182 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:06:02.232287 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:06:02.232748 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:06:02.234355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:06:02.234355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:06:02.234355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:06:02.234355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:06:02.234355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:06:02.234355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:06:02.234355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:06:02.234355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:06:02.234355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:06:02.234355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:06:02.245626 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Took 7.32 seconds to spawn the instance on the hypervisor.
May 27 23:06:02.245811 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:02.255576 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1506449161',display_name='tempest-TestEncryptedCinderVolumes-server-1506449161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1506449161',id=33,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgzwmMHRUJg1sZJ/hmk8m1xSi+BBD6J7xKwl6HGLuPEe+QDPuvTW/oi2EK3vsV/j+lTrKWLG76DbPz8HRJ70nQ96ZNyy2dZunvB2MgpS0x+pmG60Zlp192auWB2y7TRug==',key_name='tempest-keypair-1061378884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-7jjhl631',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=8e6a355e-e4c7-4d32-9a78-9ce892cd35ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:06:02.258265 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:02.258265 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=08e938e2-06e5-4e01-ba76-5db7c55efa5a,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08e938e2-06') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:02.258265 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:02.318586 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:02.348093 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Object Instance<ad096c70-bfa7-4c5c-88bc-aacf02a9a386> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:06:02.348413 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:06:02.351480 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Start _get_guest_xml network_info=[{"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "vif_mac": "fa:16:3e:4e:c5:82"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1f3ecd2c-22d0-441d-8241-3a14d4bdaa34', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '47be0527-37c8-4c66-91fc-d59698ec36c1', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, 'status': 'reserved', 'instance': 'ad096c70-bfa7-4c5c-88bc-aacf02a9a386', 'attached_at': '', 'detached_at': '', 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'serial': '7f08da9e-88c8-4697-a761-28fc35c7222c'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:06:02.351737 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'resources' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:02.426303 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:02.487536 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-acdb7d6e-1464-46ba-a894-62e9c51e20fb req-8c6eb408-118d-4333-b188-56bdccbae33f service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Received event network-vif-plugged-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:02.488019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-acdb7d6e-1464-46ba-a894-62e9c51e20fb req-8c6eb408-118d-4333-b188-56bdccbae33f service nova] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:02.488204 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-acdb7d6e-1464-46ba-a894-62e9c51e20fb req-8c6eb408-118d-4333-b188-56bdccbae33f service nova] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:02.491018 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-acdb7d6e-1464-46ba-a894-62e9c51e20fb req-8c6eb408-118d-4333-b188-56bdccbae33f service nova] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:02.491180 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-acdb7d6e-1464-46ba-a894-62e9c51e20fb req-8c6eb408-118d-4333-b188-56bdccbae33f service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] No waiting events found dispatching network-vif-plugged-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:02.491323 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-acdb7d6e-1464-46ba-a894-62e9c51e20fb req-8c6eb408-118d-4333-b188-56bdccbae33f service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Received unexpected event network-vif-plugged-0a402bfd-33f6-497c-98f2-fa3d90821848 for instance with vm_state active and task_state None.
May 27 23:06:02.671437 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:02.722404 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:02.725667 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:02.733608 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923162.7324848, 225ad6d6-6422-4bab-994c-fcc6c720b0ea => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:02.733608 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] VM Resumed (Lifecycle Event)
May 27 23:06:02.756004 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Took 14.83 seconds to build instance.
May 27 23:06:02.760762 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] End _get_guest_xml xml=<domain type="qemu">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <uuid>8e6a355e-e4c7-4d32-9a78-9ce892cd35ef</uuid>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <name>instance-00000021</name>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1506449161</nova:name>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:06:02</nova:creationTime>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:user uuid="1e15e4b45c874974b28db7f3448a3945">tempest-TestEncryptedCinderVolumes-762189049-project-member</nova:user>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:project uuid="8b69ef10bedf41b48b1455ae48aa534e">tempest-TestEncryptedCinderVolumes-762189049</nova:project>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         <nova:port uuid="08e938e2-06e5-4e01-ba76-5db7c55efa5a">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <system>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <entry name="serial">8e6a355e-e4c7-4d32-9a78-9ce892cd35ef</entry>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <entry name="uuid">8e6a355e-e4c7-4d32-9a78-9ce892cd35ef</entry>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     </system>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <os>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   </os>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <features>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   </features>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   <devices>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk.config"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:7f:44:6c"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <target dev="tap08e938e2-06"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     </interface>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/console.log" append="off"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     </serial>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <video>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     </video>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     </rng>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:   </devices>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]: </domain>
May 27 23:06:02.760762 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:06:02.768595 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Preparing to wait for external event network-vif-plugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:06:02.768595 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:02.768595 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:02.768595 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:02.768595 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1506449161',display_name='tempest-TestEncryptedCinderVolumes-server-1506449161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1506449161',id=33,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgzwmMHRUJg1sZJ/hmk8m1xSi+BBD6J7xKwl6HGLuPEe+QDPuvTW/oi2EK3vsV/j+lTrKWLG76DbPz8HRJ70nQ96ZNyy2dZunvB2MgpS0x+pmG60Zlp192auWB2y7TRug==',key_name='tempest-keypair-1061378884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-7jjhl631',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=8e6a355e-e4c7-4d32-9a78-9ce892cd35ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:06:02.768595 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:02.770925 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=08e938e2-06e5-4e01-ba76-5db7c55efa5a,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08e938e2-06') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:02.771661 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=08e938e2-06e5-4e01-ba76-5db7c55efa5a,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08e938e2-06') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:06:02.771744 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:02.772780 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:02.772780 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:06:02.774551 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:02.774679 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '164cba75-830e-55cf-86b8-d9b9acc8cddf', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:02.775421 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:02.776014 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:02.783743 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:02.788179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:02.788412 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08e938e2-06, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:02.788770 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08e938e2-06, col_values=(('qos', UUID('ecc51d38-20e5-408b-9c60-76c4aebff4b3')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:02.791167 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08e938e2-06, col_values=(('external_ids', {'iface-id': '08e938e2-06e5-4e01-ba76-5db7c55efa5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:44:6c', 'vm-uuid': '8e6a355e-e4c7-4d32-9a78-9ce892cd35ef'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:02.795774 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:02.802538 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:06:02.803174 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:02.804686 np0000001565 nova-compute[98289]: INFO os_vif [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=08e938e2-06e5-4e01-ba76-5db7c55efa5a,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08e938e2-06')
May 27 23:06:02.835440 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating instance_info_cache with network_info: [{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:02.853983 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Object Instance<ad096c70-bfa7-4c5c-88bc-aacf02a9a386> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:06:02.860939 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:06:02.860939 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1943859222', uuid='ad096c70-bfa7-4c5c-88bc-aacf02a9a386'), owner=OwnerMeta(userid='079fa79ceda94eba85570c510d7e8b24', username='tempest-ServerStableDeviceRescueTest-1802307985-project-member', projectid='0a9dde83267d415abbd137e795ac45e9', projectname='tempest-ServerStableDeviceRescueTest-1802307985'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "vif_mac": "fa:16:3e:4e:c5:82"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923162.8602881) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:06:02.862567 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:06:02.863233 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:06:02.867353 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:06:02.868481 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:06:02.868844 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'vcpu_model' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:03.080018 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:03.226866 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Updated VIF entry in instance network info cache for port 08e938e2-06e5-4e01-ba76-5db7c55efa5a. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:06:03.227102 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Updating instance_info_cache with network_info: [{"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:03.235042 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:03.239646 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:03.257499 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.357s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:03.337387 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:03.372192 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Object Instance<ad096c70-bfa7-4c5c-88bc-aacf02a9a386> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:06:03.387825 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:03.470215 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.config --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:03.471464 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:03.471888 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:03.473874 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:03.473874 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:06:03.474194 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:03.475201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:03.504201 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:03.687771 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6a07373f-2f01-4358-a7d4-df5b5b9a29a5 req-f89de0cd-9515-4bbc-8fa6-7b92e30c898c service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Received event network-changed-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:03.687986 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6a07373f-2f01-4358-a7d4-df5b5b9a29a5 req-f89de0cd-9515-4bbc-8fa6-7b92e30c898c service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Refreshing instance network info cache due to event network-changed-0a402bfd-33f6-497c-98f2-fa3d90821848. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:06:03.688242 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6a07373f-2f01-4358-a7d4-df5b5b9a29a5 req-f89de0cd-9515-4bbc-8fa6-7b92e30c898c service nova] Acquiring lock "refresh_cache-225ad6d6-6422-4bab-994c-fcc6c720b0ea" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:03.688515 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6a07373f-2f01-4358-a7d4-df5b5b9a29a5 req-f89de0cd-9515-4bbc-8fa6-7b92e30c898c service nova] Acquired lock "refresh_cache-225ad6d6-6422-4bab-994c-fcc6c720b0ea" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:03.688721 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6a07373f-2f01-4358-a7d4-df5b5b9a29a5 req-f89de0cd-9515-4bbc-8fa6-7b92e30c898c service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Refreshing network info cache for port 0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:06:03.729348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3344e704-659a-4d8d-bc5b-4ccc1fd99d55 req-cd5be4cc-8337-4c28-a161-31b82d32dc37 service nova] Releasing lock "refresh_cache-8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:03.821558 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Found WWN 330000000da324ef1 for multipath device dm-11 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:06:03.821558 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:03.821558 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000da324ef1', 'path': '/dev/dm-11', 'multipath_id': '330000000da324ef1'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:03.821558 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000da324ef1', 'path': '/dev/dm-11', 'multipath_id': '330000000da324ef1'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:06:03.821558 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.346s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:03.821558 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:06:03.834242 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:03.835077 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:03.835267 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:06:03.835926 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:03.836537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:03.836724 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:03.850730 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:03.850730 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:03.859354 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:03.859354 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:03.864984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:03.873606 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:03.891393 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:03.891911 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:03.891911 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:03.892892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] HCTL ('21', '0', '0', 0) found on session 58 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:03.893017 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Scanning host 21 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:03.902750 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:03.903106 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:03.903431 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:03.903480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:03.904025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Searching for a device in session 58 and hctl ('21', '0', '0', 0) yield: sdp {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:03.904239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:03.905509 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] HCTL ('22', '0', '0', 0) found on session 59 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:03.905660 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Scanning host 22 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:03.915527 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Searching for a device in session 59 and hctl ('22', '0', '0', 0) yield: sdq {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:03.915709 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:04.191606 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-6a07373f-2f01-4358-a7d4-df5b5b9a29a5 req-f89de0cd-9515-4bbc-8fa6-7b92e30c898c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:04.327039 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:04.328499 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:04.328499 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No VIF found with MAC fa:16:3e:7f:44:6c, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:06:04.329099 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-755854208',display_name='tempest-ServerActionsTestOtherA-server-755854208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='tempest-serveractionstestothera-server-755854208',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDbaj3DPBwSZJeJkSnhSxE7m4eskg4J4EL3Q2BBe+Q8XlC97E7Cxe9kHqz6aAye5+4WemBw1vcR74IA2SLmGxwKECL2TR/u5JVPPAw/fcZ9wwGfIrFs+wKKcahPL14eOA==',key_name='tempest-keypair-729756855',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:42Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-p9ihn7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=c6934452-ac0c-4d70-8ab4-c09b80c8829f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-872418179-network", "vif_mac": "fa:16:3e:30:d2:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:06:04.329323 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-872418179-network", "vif_mac": "fa:16:3e:30:d2:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:04.330559 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Using config drive
May 27 23:06:04.331004 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:04.332821 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] End _get_guest_xml xml=<domain type="qemu">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <uuid>c6934452-ac0c-4d70-8ab4-c09b80c8829f</uuid>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <name>instance-0000001f</name>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <memory>262144</memory>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerActionsTestOtherA-server-755854208</nova:name>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:06:00</nova:creationTime>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.micro" id="84">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:memory>256</nova:memory>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:user uuid="8f0d298d70064eac8ffd4fe25b1e203b">tempest-ServerActionsTestOtherA-1786604563-project-member</nova:user>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:project uuid="d6f15f51479c4e37ab880af2031170be">tempest-ServerActionsTestOtherA-1786604563</nova:project>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         <nova:port uuid="3d5f116b-acb3-45c5-852a-ba903302ea2e">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <system>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <entry name="serial">c6934452-ac0c-4d70-8ab4-c09b80c8829f</entry>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <entry name="uuid">c6934452-ac0c-4d70-8ab4-c09b80c8829f</entry>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     </system>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <os>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   </os>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <features>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   </features>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   <devices>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/disk.config"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <alias name="ua-dbaed51e-0782-4850-9c80-429a77200302"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-11"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <serial>dbaed51e-0782-4850-9c80-429a77200302</serial>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:30:d2:ed"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <target dev="tap3d5f116b-ac"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     </interface>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f/console.log" append="off"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     </serial>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <video>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     </video>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     </rng>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:   </devices>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]: </domain>
May 27 23:06:04.332821 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:06:04.337848 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-755854208',display_name='tempest-ServerActionsTestOtherA-server-755854208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='tempest-serveractionstestothera-server-755854208',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDbaj3DPBwSZJeJkSnhSxE7m4eskg4J4EL3Q2BBe+Q8XlC97E7Cxe9kHqz6aAye5+4WemBw1vcR74IA2SLmGxwKECL2TR/u5JVPPAw/fcZ9wwGfIrFs+wKKcahPL14eOA==',key_name='tempest-keypair-729756855',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:42Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-p9ihn7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=c6934452-ac0c-4d70-8ab4-c09b80c8829f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-872418179-network", "vif_mac": "fa:16:3e:30:d2:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:06:04.337848 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-872418179-network", "vif_mac": "fa:16:3e:30:d2:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:04.337848 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:04.337848 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:06:04.339079 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:04.339410 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:04.339705 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:06:04.341496 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:04.341719 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23e1b558-eeef-5be8-bce7-680f21acb97b', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:04.346818 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:04.353582 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:04.357551 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:04.358013 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d5f116b-ac, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:04.358316 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d5f116b-ac, col_values=(('qos', UUID('bbf13676-91c4-4156-9293-177404e51478')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:04.358501 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d5f116b-ac, col_values=(('external_ids', {'iface-id': '3d5f116b-acb3-45c5-852a-ba903302ea2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:d2:ed', 'vm-uuid': 'c6934452-ac0c-4d70-8ab4-c09b80c8829f'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:04.362284 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:04.376537 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:04.377458 np0000001565 nova-compute[98289]: INFO os_vif [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac')
May 27 23:06:04.476137 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-6a07373f-2f01-4358-a7d4-df5b5b9a29a5 req-f89de0cd-9515-4bbc-8fa6-7b92e30c898c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:04.598474 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6a07373f-2f01-4358-a7d4-df5b5b9a29a5 req-f89de0cd-9515-4bbc-8fa6-7b92e30c898c service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Updated VIF entry in instance network info cache for port 0a402bfd-33f6-497c-98f2-fa3d90821848. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:06:04.598816 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6a07373f-2f01-4358-a7d4-df5b5b9a29a5 req-f89de0cd-9515-4bbc-8fa6-7b92e30c898c service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Updating instance_info_cache with network_info: [{"id": "0a402bfd-33f6-497c-98f2-fa3d90821848", "address": "fa:16:3e:94:b6:ed", "network": {"id": "8735eb81-21d5-4f21-a6eb-53a9644b4eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1470727070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d7499fc96c14d4fb66aa37e4a78012f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a402bfd-33", "ovs_interfaceid": "0a402bfd-33f6-497c-98f2-fa3d90821848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:04.837385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:06:04.847357 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:04.855543 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Starting migrate_disk_and_power_off {{(pid=98289) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 27 23:06:04.910387 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:04.935106 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:05.018951 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Creating config drive at /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk.config
May 27 23:06:05.022774 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpguvhe1du {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:05.084473 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpguvhe1du" returned: 0 in 0.061s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:05.098850 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:05.102050 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6a07373f-2f01-4358-a7d4-df5b5b9a29a5 req-f89de0cd-9515-4bbc-8fa6-7b92e30c898c service nova] Releasing lock "refresh_cache-225ad6d6-6422-4bab-994c-fcc6c720b0ea" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:05.117501 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:05.276501 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999515983000038 future=<Future at 0x726e386705c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:05.278146 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Instance destroyed successfully.
May 27 23:06:05.279979 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-1',id=27,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:33Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-iujlpdk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a6723b2d-e0b1-495c-910d-3ef37d877c05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:df:36:53"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:05.280272 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:df:36:53"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:05.281362 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:05.281823 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:05.283469 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:05.283797 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap112f36c6-7f, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:05.291087 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:05.299720 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:05.302688 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:05.303010 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c80bc5f2-8b25-4c98-b516-0fafe0bb9a97) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:05.305020 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:05.306072 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:05.320124 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:05.321469 np0000001565 nova-compute[98289]: INFO os_vif [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f')
May 27 23:06:05.626815 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:05.662771 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:05.741188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:05.787411 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received event network-vif-unplugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:05.787411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:05.787411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:05.787411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:05.787411 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] No waiting events found dispatching network-vif-unplugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:05.787411 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received unexpected event network-vif-unplugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 for instance with vm_state active and task_state resize_migrating.
May 27 23:06:05.787411 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received event network-vif-unplugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:05.788482 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:05.788973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:05.789344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:05.790040 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] No waiting events found dispatching network-vif-unplugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:05.790317 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-d7c39a6e-ca4e-4380-bbd6-c9ca6832190e req-01447069-79d7-4c0b-8bb6-c19393daef07 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received unexpected event network-vif-unplugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 for instance with vm_state active and task_state resize_migrating.
May 27 23:06:05.851147 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-191df2e1-0c7b-4ac2-871b-56fa901e6dd2 req-7c8ed548-87da-4ed6-a69b-8d5fb0961216 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Received event network-vif-plugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:05.852012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-191df2e1-0c7b-4ac2-871b-56fa901e6dd2 req-7c8ed548-87da-4ed6-a69b-8d5fb0961216 service nova] Acquiring lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:05.852012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-191df2e1-0c7b-4ac2-871b-56fa901e6dd2 req-7c8ed548-87da-4ed6-a69b-8d5fb0961216 service nova] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:05.852012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-191df2e1-0c7b-4ac2-871b-56fa901e6dd2 req-7c8ed548-87da-4ed6-a69b-8d5fb0961216 service nova] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:05.852012 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-191df2e1-0c7b-4ac2-871b-56fa901e6dd2 req-7c8ed548-87da-4ed6-a69b-8d5fb0961216 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Processing event network-vif-plugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:06:05.857844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Found WWN 33000000058f57dee for multipath device dm-9 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:06:05.857844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.036s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:05.857844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] <== connect_volume: return (2382ms) {'type': 'block', 'scsi_wwn': '33000000058f57dee', 'path': '/dev/dm-9', 'multipath_id': '33000000058f57dee'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:05.857844 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058f57dee', 'path': '/dev/dm-9', 'multipath_id': '33000000058f57dee'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:06:05.866708 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Detected multiple connections on this host for volume: dad32169-263d-43eb-a14f-f0ffa8abca81, skipping target disconnect.
May 27 23:06:05.875284 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:05.908429 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:05.908429 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:05.908429 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] No VIF found with MAC fa:16:3e:30:d2:ed, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:06:05.908429 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Using config drive
May 27 23:06:05.984305 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:05.986480 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:06.003125 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:06.018797 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:06.022882 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:06.058004 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:06.073439 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:06.080165 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:06.080618 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:06:06.081375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05_resize/disk /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:06.187986 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "cp -r /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05_resize/disk /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk" returned: 0 in 0.106s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:06.188287 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05_resize/disk.config /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.config {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:06.229851 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "cp -r /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05_resize/disk.config /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.config" returned: 0 in 0.041s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:06.230247 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05_resize/disk.info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.info {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:06.269849 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "cp -r /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05_resize/disk.info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.info" returned: 0 in 0.039s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:06.351796 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:06.373347 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1943859222',display_name='tempest-ServerStableDeviceRescueTest-server-1943859222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverstabledevicerescuetest-server-1943859222',id=29,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4U9ViTrCULeRb7mQ/X1fO1QgXgc1LqIgnb6WCOaeMGhLLzqC0QHpKJ1Bbctl4NVcIQtYWdUqUMmwvYfkC1eR3iPLLrQTNmpQGvAlfRR6KOUaB1y+iwgjbjpPeOqqREDQ==',key_name='tempest-keypair-1511877382',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:57Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a9dde83267d415abbd137e795ac45e9',ramdisk_id='',reservation_id='r-ereta0ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1802307985',owner_user_name='tempest-ServerStableDeviceRescueTest-1802307985-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='079fa79ceda94eba85570c510d7e8b24',uuid=ad096c70-bfa7-4c5c-88bc-aacf02a9a386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "vif_mac": "fa:16:3e:4e:c5:82"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:06:06.373631 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Converting VIF {"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "vif_mac": "fa:16:3e:4e:c5:82"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:06.374960 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:c5:82,bridge_name='br-int',has_traffic_filtering=True,id=a298890f-00ec-4f5b-9f68-df34a845fd8f,network=Network(72b5d6af-fd17-4011-9ac7-d7d70cf9f85f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa298890f-00') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:06.375250 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'pci_devices' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:06.386011 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:06.496356 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:06.542998 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:06.549994 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:06.587787 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:06:06.588759 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923166.588068, 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:06.589005 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] VM Started (Lifecycle Event)
May 27 23:06:06.592969 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:06:06.596107 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Instance spawned successfully.
May 27 23:06:06.596984 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:06:06.883248 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Object Instance<ad096c70-bfa7-4c5c-88bc-aacf02a9a386> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:06:06.884829 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] End _get_guest_xml xml=<domain type="qemu">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <uuid>ad096c70-bfa7-4c5c-88bc-aacf02a9a386</uuid>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <name>instance-0000001d</name>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1943859222</nova:name>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:06:02</nova:creationTime>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:user uuid="079fa79ceda94eba85570c510d7e8b24">tempest-ServerStableDeviceRescueTest-1802307985-project-member</nova:user>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:project uuid="0a9dde83267d415abbd137e795ac45e9">tempest-ServerStableDeviceRescueTest-1802307985</nova:project>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         <nova:port uuid="a298890f-00ec-4f5b-9f68-df34a845fd8f">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <system>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <entry name="serial">ad096c70-bfa7-4c5c-88bc-aacf02a9a386</entry>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <entry name="uuid">ad096c70-bfa7-4c5c-88bc-aacf02a9a386</entry>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </system>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <os>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   </os>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <features>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   </features>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   <devices>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.config"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <alias name="ua-7f08da9e-88c8-4697-a761-28fc35c7222c"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-9"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <serial>7f08da9e-88c8-4697-a761-28fc35c7222c</serial>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.rescue"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <target dev="vdc" bus="virtio"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <boot order="1"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:4e:c5:82"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <target dev="tapa298890f-00"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </interface>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/console.log" append="off"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </serial>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <video>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </video>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </rng>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:   </devices>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]: </domain>
May 27 23:06:06.884829 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:06:06.889307 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Instance destroyed successfully.
May 27 23:06:07.092620 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:07.094828 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:07.111408 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:07.111599 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:07.113046 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:07.113344 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:07.113669 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:07.113958 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:07.179412 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Instance event wait completed in 0 seconds for  {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:06:07.181282 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Instance running successfully.
May 27 23:06:07.182141 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Failed to set time: agent not configured {{(pid=98289) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 27 23:06:07.182286 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b3aabaab-0287-403a-ad42-5c63878355ca tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] finish_migration finished successfully. {{(pid=98289) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 27 23:06:07.436111 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:07.436445 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:07.531026 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Port 112f36c6-7fa0-4a72-9edf-c9421eccd857 binding to destination host np0000001565 is already ACTIVE {{(pid=98289) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 23:06:07.597559 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:06:07.597903 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923167.5976415, 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:07.598067 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] VM Paused (Lifecycle Event)
May 27 23:06:07.624291 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Took 6.71 seconds to spawn the instance on the hypervisor.
May 27 23:06:07.624613 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:07.890528 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:07.894006 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:07.894006 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:07.894220 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:07.894460 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] No waiting events found dispatching network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:07.894679 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received unexpected event network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e for instance with vm_state resized and task_state None.
May 27 23:06:07.894861 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:07.895116 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:07.895368 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:07.895558 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:07.895747 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] No waiting events found dispatching network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:07.899261 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-da8c9ef8-ca5e-4241-8018-804bbf12df23 req-78884c76-0883-4cde-9378-91886b0d5c0f service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received unexpected event network-vif-plugged-3d5f116b-acb3-45c5-852a-ba903302ea2e for instance with vm_state resized and task_state None.
May 27 23:06:07.921920 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-77ee9b53-1277-46bc-8544-e258ada5e463 req-547e00d9-66b0-4888-8e44-19798f0e2042 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Received event network-vif-plugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:07.922510 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-77ee9b53-1277-46bc-8544-e258ada5e463 req-547e00d9-66b0-4888-8e44-19798f0e2042 service nova] Acquiring lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:07.922623 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-77ee9b53-1277-46bc-8544-e258ada5e463 req-547e00d9-66b0-4888-8e44-19798f0e2042 service nova] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:07.922859 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-77ee9b53-1277-46bc-8544-e258ada5e463 req-547e00d9-66b0-4888-8e44-19798f0e2042 service nova] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:07.923015 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-77ee9b53-1277-46bc-8544-e258ada5e463 req-547e00d9-66b0-4888-8e44-19798f0e2042 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] No waiting events found dispatching network-vif-plugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:07.923127 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-77ee9b53-1277-46bc-8544-e258ada5e463 req-547e00d9-66b0-4888-8e44-19798f0e2042 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Received unexpected event network-vif-plugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a for instance with vm_state active and task_state None.
May 27 23:06:08.101484 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:08.103253 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923168.1030161, 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:08.103408 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] VM Resumed (Lifecycle Event)
May 27 23:06:08.137112 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Took 16.66 seconds to build instance.
May 27 23:06:08.407247 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:08.407247 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:08.407247 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:08.407247 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:08.407247 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] No VIF found with MAC fa:16:3e:4e:c5:82, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:06:08.407577 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Using config drive
May 27 23:06:08.516468 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:08.540899 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:06:08.556667 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:08.556905 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:08.557538 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:08.601528 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0010976369999298186 future=<Future at 0x726e6016f200 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:08.601691 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:08.601864 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.535206933000154 future=<Future at 0x726e587020f0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:08.603347 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.535099820000141 future=<Future at 0x726e587020f0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:08.603347 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Emitting event <LifecycleEvent: 1779923153.6001801, c6934452-ac0c-4d70-8ab4-c09b80c8829f => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:08.603347 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] VM Stopped (Lifecycle Event)
May 27 23:06:08.606442 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:08.609849 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:08.638627 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2cab4053-0bbf-4b97-82e3-9f8b32854bf8 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.172s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:08.743157 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:06:08.910311 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'ec2_ids' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:08.933069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:08.933205 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:08.933386 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Going to confirm migration 3 {{(pid=98289) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 27 23:06:09.106586 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0c7766c-a03a-4b83-8d57-918fcb2e33e7 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:09.112097 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923169.1118672, c6934452-ac0c-4d70-8ab4-c09b80c8829f => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:09.112201 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] VM Resumed (Lifecycle Event)
May 27 23:06:09.418450 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Object Instance<ad096c70-bfa7-4c5c-88bc-aacf02a9a386> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:06:09.418565 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'keypairs' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:09.446073 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:09.515311 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:09.515610 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:09.515747 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquired lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:09.515893 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:06:09.516057 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'info_cache' on Instance uuid c6934452-ac0c-4d70-8ab4-c09b80c8829f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:09.564828 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:09.614300 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:09.616675 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:09.631930 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:09.631930 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:09.631930 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:06:09.924058 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Object Instance<ad096c70-bfa7-4c5c-88bc-aacf02a9a386> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:06:09.927156 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:10.053854 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Creating config drive at /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.config.rescue
May 27 23:06:10.058922 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp7d6e8bq {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:10.111443 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp7d6e8bq" returned: 0 in 0.052s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:10.119927 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923170.1194563, c6934452-ac0c-4d70-8ab4-c09b80c8829f => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:10.120132 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] VM Started (Lifecycle Event)
May 27 23:06:10.133429 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:10.234923 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d912fc51-f34d-4649-8c38-75ca30dffca9 req-e8044503-a9a8-4220-9b7c-2992a5a24780 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Received event network-changed-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:10.235545 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d912fc51-f34d-4649-8c38-75ca30dffca9 req-e8044503-a9a8-4220-9b7c-2992a5a24780 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Refreshing instance network info cache due to event network-changed-08e938e2-06e5-4e01-ba76-5db7c55efa5a. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:06:10.235857 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d912fc51-f34d-4649-8c38-75ca30dffca9 req-e8044503-a9a8-4220-9b7c-2992a5a24780 service nova] Acquiring lock "refresh_cache-8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:10.235972 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d912fc51-f34d-4649-8c38-75ca30dffca9 req-e8044503-a9a8-4220-9b7c-2992a5a24780 service nova] Acquired lock "refresh_cache-8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:10.236122 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d912fc51-f34d-4649-8c38-75ca30dffca9 req-e8044503-a9a8-4220-9b7c-2992a5a24780 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Refreshing network info cache for port 08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:06:10.305236 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:10.466238 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:10.520971 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:10.577292 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:10.610701 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:10.624118 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:10.630458 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:10.663149 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating instance_info_cache with network_info: [{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:10.696966 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:10.738371 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d912fc51-f34d-4649-8c38-75ca30dffca9 req-e8044503-a9a8-4220-9b7c-2992a5a24780 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:10.808808 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-95a9a0ac-4393-4242-884d-e4d360779b26 req-4957b3e2-bc46-4a3e-932e-1edbb5fc0055 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:10.809097 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-95a9a0ac-4393-4242-884d-e4d360779b26 req-4957b3e2-bc46-4a3e-932e-1edbb5fc0055 service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:10.809305 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-95a9a0ac-4393-4242-884d-e4d360779b26 req-4957b3e2-bc46-4a3e-932e-1edbb5fc0055 service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:10.809519 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-95a9a0ac-4393-4242-884d-e4d360779b26 req-4957b3e2-bc46-4a3e-932e-1edbb5fc0055 service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:10.809707 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-95a9a0ac-4393-4242-884d-e4d360779b26 req-4957b3e2-bc46-4a3e-932e-1edbb5fc0055 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] No waiting events found dispatching network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:10.809903 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-95a9a0ac-4393-4242-884d-e4d360779b26 req-4957b3e2-bc46-4a3e-932e-1edbb5fc0055 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received unexpected event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f for instance with vm_state active and task_state rescuing.
May 27 23:06:10.930769 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:10.994402 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:10.996686 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:11.028782 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:11.096091 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Updating instance_info_cache with network_info: [{"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:11.167224 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d912fc51-f34d-4649-8c38-75ca30dffca9 req-e8044503-a9a8-4220-9b7c-2992a5a24780 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:11.170411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:11.321632 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d912fc51-f34d-4649-8c38-75ca30dffca9 req-e8044503-a9a8-4220-9b7c-2992a5a24780 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Updated VIF entry in instance network info cache for port 08e938e2-06e5-4e01-ba76-5db7c55efa5a. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:06:11.321632 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d912fc51-f34d-4649-8c38-75ca30dffca9 req-e8044503-a9a8-4220-9b7c-2992a5a24780 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Updating instance_info_cache with network_info: [{"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:11.534018 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for ad096c70-bfa7-4c5c-88bc-aacf02a9a386 due to new event <LifecycleEvent: 1779923171.5329096, ad096c70-bfa7-4c5c-88bc-aacf02a9a386 => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:06:11.534018 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923171.5329096, ad096c70-bfa7-4c5c-88bc-aacf02a9a386 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:11.534018 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] VM Resumed (Lifecycle Event)
May 27 23:06:11.540368 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f14a7480-bd2b-47f9-b05f-76153adc55c6 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:11.599904 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Releasing lock "refresh_cache-c6934452-ac0c-4d70-8ab4-c09b80c8829f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:11.600082 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'migration_context' on Instance uuid c6934452-ac0c-4d70-8ab4-c09b80c8829f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:11.679014 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:11.689456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:06:11.711924 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:11.762931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:06:11.763271 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:06:11.773580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:06:11.775647 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:fe4e:5268', 'fe80::fc16:3eff:feec:ef10', 'fe80::f891:88ff:fe4f:b815', 'fe80::fc16:3eff:fe37:67cf', 'fe80::fc16:3eff:fe5e:b185', 'fe80::fc16:3eff:fed3:b70f', 'fe80::fc16:3eff:fed3:3b74', 'fe80::fc16:3eff:fe4e:4d67', 'fe80::c0e1:aaff:fe84:140a', 'fe80::ecad:ff:fefb:b023', 'fe80::fc16:3eff:fead:f302', 'fe80::f886:b6ff:fe99:9ebe', 'fe80::fc16:3eff:fe94:b6ed', 'fe80::906a:e4ff:fe34:5279', 'fe80::fc16:3eff:fe7f:446c', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fe30:d2ed', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4'] 
May 27 23:06:11.775802 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:06:11.775952 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:06:11.776192 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:11.824208 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d912fc51-f34d-4649-8c38-75ca30dffca9 req-e8044503-a9a8-4220-9b7c-2992a5a24780 service nova] Releasing lock "refresh_cache-8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:12.035999 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:12.038794 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:12.102362 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Object Instance<c6934452-ac0c-4d70-8ab4-c09b80c8829f> lazy-loaded attributes: info_cache,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:06:12.103657 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:12.103927 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:12.541680 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923172.5413694, ad096c70-bfa7-4c5c-88bc-aacf02a9a386 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:12.541937 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] VM Started (Lifecycle Event)
May 27 23:06:12.881903 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a51430c3-3800-4ffa-a75a-ad8e9ec20e95 req-27424b84-febf-45a5-b45c-efbc5b68d545 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:12.882104 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a51430c3-3800-4ffa-a75a-ad8e9ec20e95 req-27424b84-febf-45a5-b45c-efbc5b68d545 service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:12.882261 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a51430c3-3800-4ffa-a75a-ad8e9ec20e95 req-27424b84-febf-45a5-b45c-efbc5b68d545 service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:12.882399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a51430c3-3800-4ffa-a75a-ad8e9ec20e95 req-27424b84-febf-45a5-b45c-efbc5b68d545 service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:12.882547 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a51430c3-3800-4ffa-a75a-ad8e9ec20e95 req-27424b84-febf-45a5-b45c-efbc5b68d545 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] No waiting events found dispatching network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:12.882702 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-a51430c3-3800-4ffa-a75a-ad8e9ec20e95 req-27424b84-febf-45a5-b45c-efbc5b68d545 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received unexpected event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f for instance with vm_state rescued and task_state unrescuing.
May 27 23:06:12.928557 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Starting finish_migration {{(pid=98289) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 27 23:06:12.928557 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Instance directory exists: not creating {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 23:06:12.928557 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Creating image(s)
May 27 23:06:12.929358 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:13.030081 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.100s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:13.033353 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:06:13.033353 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:13.054824 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:13.065444 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:13.123305 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:13.125054 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Cannot resize image /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:06:13.207225 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Unrescuing
May 27 23:06:13.207965 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:13.208144 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquired lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:13.208368 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:06:13.494022 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:06:13.494253 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:06:13.518934 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:13.569843 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 27 23:06:13.626598 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:06:13.626770 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Ensure instance console log exists: /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:06:13.627150 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:13.627275 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:13.627426 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:13.630183 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Start _get_guest_xml network_info=[{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:df:36:53"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'afb27edd-a120-401f-81c5-4c1014da22b5', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'a6723b2d-e0b1-495c-910d-3ef37d877c05', 'attached_at': '2026-05-27T23:06:12.000000', 'detached_at': '', 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'multiattach': True, 'serial': 'dad32169-263d-43eb-a14f-f0ffa8abca81'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:06:13.632592 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:06:13.634021 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='a6723b2d-e0b1-495c-910d-3ef37d877c05'), owner=OwnerMeta(userid='2c6d94c1e6da4237aa5dd517c31e03d7', username='tempest-AttachVolumeMultiAttachTest-781715127-project-member', projectid='0ec877dc7b2240969ac89c13673f8799', projectname='tempest-AttachVolumeMultiAttachTest-781715127'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:df:36:53"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923173.633668) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:06:13.634988 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:06:13.635350 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:06:13.636175 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:06:13.636379 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:06:13.637384 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:06:13.637696 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:06:13.637841 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:06:13.637931 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:06:13.638053 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:06:13.638143 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:06:13.638226 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:06:13.638395 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:06:13.638498 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:06:13.638610 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:06:13.638707 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:06:13.638836 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:06:13.653535 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a36e725d-46c4-47d9-beda-5cde1b9d3b35 req-4aed4742-0966-4471-a873-1dcb4183751c service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-changed-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:13.653976 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a36e725d-46c4-47d9-beda-5cde1b9d3b35 req-4aed4742-0966-4471-a873-1dcb4183751c service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Refreshing instance network info cache due to event network-changed-a298890f-00ec-4f5b-9f68-df34a845fd8f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:06:13.654254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a36e725d-46c4-47d9-beda-5cde1b9d3b35 req-4aed4742-0966-4471-a873-1dcb4183751c service nova] Acquiring lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:13.654701 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:13.715839 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:13.743265 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.config --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:13.743827 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:13.744234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:13.745019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:13.745687 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:06:13.746142 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:13.746295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:13.746875 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:13.747134 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:06:13.763929 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:13.763929 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:13.764285 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:13.764546 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:06:13.764886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:13.765186 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:13.781246 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:13.781246 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:13.786552 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:13.786552 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:13.801002 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:13.802119 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:13.829501 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:13.830255 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:13.830255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:13.830985 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('8', '0', '0', 0) found on session 45 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:13.831375 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:13.837325 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:13.838175 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.074s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:13.838175 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:13.839220 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('7', '0', '0', 0) found on session 44 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:13.839363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:13.849796 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 45 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:13.849977 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:13.850615 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 44 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:13.850796 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:13.997700 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:06:14.094369 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:14.137631 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00048160999995161546 future=<Future at 0x726e587020f0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:14.137769 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:14.137816 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.13816075800014 future=<Future at 0x726e386705c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:14.138113 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.137862855000094 future=<Future at 0x726e386705c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:14.245366 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updating instance_info_cache with network_info: [{"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:14.747360 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Releasing lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:14.747943 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'flavor' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:14.750015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a36e725d-46c4-47d9-beda-5cde1b9d3b35 req-4aed4742-0966-4471-a873-1dcb4183751c service nova] Acquired lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:14.750315 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a36e725d-46c4-47d9-beda-5cde1b9d3b35 req-4aed4742-0966-4471-a873-1dcb4183751c service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Refreshing network info cache for port a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:06:14.768113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:06:15.014815 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.911s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:15.254579 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a36e725d-46c4-47d9-beda-5cde1b9d3b35 req-4aed4742-0966-4471-a873-1dcb4183751c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:15.288706 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:15.300654 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:15.307951 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:15.317047 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:15.322324 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:15.349514 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:15.493234 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-97fd8878-d0da-4c99-8bd3-366c5d65a411 req-41ee84ed-3b10-4687-9d22-2251a658aee1 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:15.494091 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97fd8878-d0da-4c99-8bd3-366c5d65a411 req-41ee84ed-3b10-4687-9d22-2251a658aee1 service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:15.494850 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97fd8878-d0da-4c99-8bd3-366c5d65a411 req-41ee84ed-3b10-4687-9d22-2251a658aee1 service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:15.494850 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-97fd8878-d0da-4c99-8bd3-366c5d65a411 req-41ee84ed-3b10-4687-9d22-2251a658aee1 service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:15.494850 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-97fd8878-d0da-4c99-8bd3-366c5d65a411 req-41ee84ed-3b10-4687-9d22-2251a658aee1 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] No waiting events found dispatching network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:15.495159 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-97fd8878-d0da-4c99-8bd3-366c5d65a411 req-41ee84ed-3b10-4687-9d22-2251a658aee1 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received unexpected event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f for instance with vm_state rescued and task_state unrescuing.
May 27 23:06:15.647822 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999697718999869 future=<Future at 0x726e38670c20 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:15.649097 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Instance destroyed successfully.
May 27 23:06:15.649628 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'numa_topology' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:15.660755 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Deleted allocation for migration 4c007343-e595-4e99-9d27-229c4122eb7c
May 27 23:06:15.690289 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a36e725d-46c4-47d9-beda-5cde1b9d3b35 req-4aed4742-0966-4471-a873-1dcb4183751c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:15.732957 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fa3588e4-68e7-4ee8-ad50-4375e091dad4 req-81457ce0-a43c-4625-97fc-990ee7033790 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-changed-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:15.734950 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fa3588e4-68e7-4ee8-ad50-4375e091dad4 req-81457ce0-a43c-4625-97fc-990ee7033790 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Refreshing instance network info cache due to event network-changed-a298890f-00ec-4f5b-9f68-df34a845fd8f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:06:15.735135 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fa3588e4-68e7-4ee8-ad50-4375e091dad4 req-81457ce0-a43c-4625-97fc-990ee7033790 service nova] Acquiring lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:15.793829 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found WWN 3300000004f18c080 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:06:15.794106 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.047s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:15.794294 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== connect_volume: return (2047ms) {'type': 'block', 'scsi_wwn': '3300000004f18c080', 'path': '/dev/dm-0', 'multipath_id': '3300000004f18c080'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:15.794498 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004f18c080', 'path': '/dev/dm-0', 'multipath_id': '3300000004f18c080'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:06:15.845515 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a36e725d-46c4-47d9-beda-5cde1b9d3b35 req-4aed4742-0966-4471-a873-1dcb4183751c service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updated VIF entry in instance network info cache for port a298890f-00ec-4f5b-9f68-df34a845fd8f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:06:15.845515 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a36e725d-46c4-47d9-beda-5cde1b9d3b35 req-4aed4742-0966-4471-a873-1dcb4183751c service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updating instance_info_cache with network_info: [{"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:16.153001 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Object Instance<ad096c70-bfa7-4c5c-88bc-aacf02a9a386> lazy-loaded attributes: flavor,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:06:16.166720 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b853624c-ad0a-40a6-b81a-a32c895bf53a tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.233s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:16.295487 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0a0052bd-fc61-427f-bb88-e2b0eae970e1 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Get console output
May 27 23:06:16.307353 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='multiattach-server-1',id=27,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:33Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-iujlpdk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a6723b2d-e0b1-495c-910d-3ef37d877c05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:df:36:53"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:06:16.307353 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:df:36:53"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:16.307353 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:16.309650 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] End _get_guest_xml xml=<domain type="qemu">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <uuid>a6723b2d-e0b1-495c-910d-3ef37d877c05</uuid>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <name>instance-0000001b</name>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <memory>262144</memory>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <nova:name>multiattach-server-1</nova:name>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:06:13</nova:creationTime>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.micro" id="84">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:memory>256</nova:memory>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:user uuid="2c6d94c1e6da4237aa5dd517c31e03d7">tempest-AttachVolumeMultiAttachTest-781715127-project-member</nova:user>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:project uuid="0ec877dc7b2240969ac89c13673f8799">tempest-AttachVolumeMultiAttachTest-781715127</nova:project>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         <nova:port uuid="112f36c6-7fa0-4a72-9edf-c9421eccd857">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <system>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <entry name="serial">a6723b2d-e0b1-495c-910d-3ef37d877c05</entry>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <entry name="uuid">a6723b2d-e0b1-495c-910d-3ef37d877c05</entry>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     </system>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <os>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   </os>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <features>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   </features>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   <devices>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk.config"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <alias name="ua-dad32169-263d-43eb-a14f-f0ffa8abca81"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <serial>dad32169-263d-43eb-a14f-f0ffa8abca81</serial>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <shareable/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:df:36:53"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <target dev="tap112f36c6-7f"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     </interface>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/console.log" append="off"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     </serial>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <video>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     </video>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     </rng>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:   </devices>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]: </domain>
May 27 23:06:16.309650 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:06:16.312979 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='multiattach-server-1',id=27,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:04:33Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-iujlpdk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a6723b2d-e0b1-495c-910d-3ef37d877c05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:df:36:53"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:06:16.312979 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "vif_mac": "fa:16:3e:df:36:53"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:16.312979 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:16.312979 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:06:16.312979 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:16.313214 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:16.313572 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:06:16.315428 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:16.315428 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f957b50-b023-518c-b04f-c80e38f82f59', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:16.316576 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:16.317412 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:16.323245 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:16.330719 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:16.330719 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap112f36c6-7f, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:16.330719 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap112f36c6-7f, col_values=(('qos', UUID('f224576a-7fec-4096-a5db-42b58bdce0f4')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:16.330719 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap112f36c6-7f, col_values=(('external_ids', {'iface-id': '112f36c6-7fa0-4a72-9edf-c9421eccd857', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:36:53', 'vm-uuid': 'a6723b2d-e0b1-495c-910d-3ef37d877c05'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:16.331391 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:16.332846 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:16.341344 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:16.341930 np0000001565 nova-compute[98289]: INFO os_vif [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f')
May 27 23:06:16.347699 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a36e725d-46c4-47d9-beda-5cde1b9d3b35 req-4aed4742-0966-4471-a873-1dcb4183751c service nova] Releasing lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:16.349769 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fa3588e4-68e7-4ee8-ad50-4375e091dad4 req-81457ce0-a43c-4625-97fc-990ee7033790 service nova] Acquired lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:16.349985 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fa3588e4-68e7-4ee8-ad50-4375e091dad4 req-81457ce0-a43c-4625-97fc-990ee7033790 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Refreshing network info cache for port a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:06:16.428560 np0000001565 nova-compute[98289]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 27 23:06:16.620402 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:16.661365 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:16.670925 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:16.755984 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:16.856484 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-fa3588e4-68e7-4ee8-ad50-4375e091dad4 req-81457ce0-a43c-4625-97fc-990ee7033790 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:16.994855 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:17.004816 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:17.008403 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:17.031578 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:17.034839 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:17.245346 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-fa3588e4-68e7-4ee8-ad50-4375e091dad4 req-81457ce0-a43c-4625-97fc-990ee7033790 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:17.396889 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fa3588e4-68e7-4ee8-ad50-4375e091dad4 req-81457ce0-a43c-4625-97fc-990ee7033790 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updated VIF entry in instance network info cache for port a298890f-00ec-4f5b-9f68-df34a845fd8f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:06:17.397312 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fa3588e4-68e7-4ee8-ad50-4375e091dad4 req-81457ce0-a43c-4625-97fc-990ee7033790 service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updating instance_info_cache with network_info: [{"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:17.465363 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for ad096c70-bfa7-4c5c-88bc-aacf02a9a386 due to new event <LifecycleEvent: 1779923177.4648159, ad096c70-bfa7-4c5c-88bc-aacf02a9a386 => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:06:17.465520 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923177.4648159, ad096c70-bfa7-4c5c-88bc-aacf02a9a386 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:17.465682 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] VM Resumed (Lifecycle Event)
May 27 23:06:17.467710 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5128ddf8-4119-4bfa-bea8-975c36d1bbac tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:17.556610 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:17.557881 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:17.560727 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:17.561198 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:17.561405 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] No waiting events found dispatching network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:17.561570 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received unexpected event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f for instance with vm_state active and task_state None.
May 27 23:06:17.561712 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:17.561883 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:17.562066 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:17.562202 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:17.562439 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] No waiting events found dispatching network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:17.562586 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received unexpected event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f for instance with vm_state active and task_state None.
May 27 23:06:17.562722 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:17.562879 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:17.563057 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:17.563189 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:17.563315 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] No waiting events found dispatching network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:17.563474 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5073dbbf-6523-4299-83ad-2629a59b4579 req-c6912dc7-c7f7-4419-b1e7-fc65e372093d service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received unexpected event network-vif-plugged-a298890f-00ec-4f5b-9f68-df34a845fd8f for instance with vm_state active and task_state None.
May 27 23:06:17.869605 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:17.869777 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:17.869950 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:17.870095 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:df:36:53, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:06:17.870741 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Using config drive
May 27 23:06:17.901208 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fa3588e4-68e7-4ee8-ad50-4375e091dad4 req-81457ce0-a43c-4625-97fc-990ee7033790 service nova] Releasing lock "refresh_cache-ad096c70-bfa7-4c5c-88bc-aacf02a9a386" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:17.969426 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:17.971573 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:18.316488 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:18.345390 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:18.351690 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:18.457366 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:18.482269 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923178.4818923, ad096c70-bfa7-4c5c-88bc-aacf02a9a386 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:18.482475 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] VM Started (Lifecycle Event)
May 27 23:06:18.523899 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:18.564909 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5ac3fa68-b30e-421a-9543-4be9d8f09298 req-23c54120-a252-439a-b674-a74fd1b0b875 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received event network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:18.567194 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5ac3fa68-b30e-421a-9543-4be9d8f09298 req-23c54120-a252-439a-b674-a74fd1b0b875 service nova] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:18.567194 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5ac3fa68-b30e-421a-9543-4be9d8f09298 req-23c54120-a252-439a-b674-a74fd1b0b875 service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:18.567761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5ac3fa68-b30e-421a-9543-4be9d8f09298 req-23c54120-a252-439a-b674-a74fd1b0b875 service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:18.568018 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5ac3fa68-b30e-421a-9543-4be9d8f09298 req-23c54120-a252-439a-b674-a74fd1b0b875 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] No waiting events found dispatching network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:18.568142 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5ac3fa68-b30e-421a-9543-4be9d8f09298 req-23c54120-a252-439a-b674-a74fd1b0b875 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received unexpected event network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 for instance with vm_state active and task_state resize_finish.
May 27 23:06:18.986561 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:18.991009 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:19.107389 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Instance event wait completed in 0 seconds for  {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:06:19.110238 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Instance running successfully.
May 27 23:06:19.114938 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Failed to set time: agent not configured {{(pid=98289) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 27 23:06:19.114938 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-760c8320-254b-492b-8fe0-fd4d74b80504 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] finish_migration finished successfully. {{(pid=98289) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 27 23:06:19.494242 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for a6723b2d-e0b1-495c-910d-3ef37d877c05 due to new event <LifecycleEvent: 1779923179.4923556, a6723b2d-e0b1-495c-910d-3ef37d877c05 => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:06:19.494242 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923179.4923556, a6723b2d-e0b1-495c-910d-3ef37d877c05 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:19.494242 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] VM Resumed (Lifecycle Event)
May 27 23:06:19.996253 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:19.998687 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:20.276391 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003083010001319053 future=<Future at 0x726e386705c0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:20.276391 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:20.276578 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.369877192999866 future=<Future at 0x726e38670c20 state=cancelled>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:20.276578 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.3698084130001 future=<Future at 0x726e38670c20 state=cancelled>) was cancelled while queued, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:20.276661 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:20.503163 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923180.50122, a6723b2d-e0b1-495c-910d-3ef37d877c05 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:20.503163 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] VM Started (Lifecycle Event)
May 27 23:06:20.653836 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2125928e-06a1-4bc8-9a23-559e5ecafe32 req-b75d8d22-7be9-4932-93bb-319727564e83 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received event network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:20.654808 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2125928e-06a1-4bc8-9a23-559e5ecafe32 req-b75d8d22-7be9-4932-93bb-319727564e83 service nova] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:20.654808 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2125928e-06a1-4bc8-9a23-559e5ecafe32 req-b75d8d22-7be9-4932-93bb-319727564e83 service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:20.654808 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2125928e-06a1-4bc8-9a23-559e5ecafe32 req-b75d8d22-7be9-4932-93bb-319727564e83 service nova] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:20.654808 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2125928e-06a1-4bc8-9a23-559e5ecafe32 req-b75d8d22-7be9-4932-93bb-319727564e83 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] No waiting events found dispatching network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:20.654808 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-2125928e-06a1-4bc8-9a23-559e5ecafe32 req-b75d8d22-7be9-4932-93bb-319727564e83 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received unexpected event network-vif-plugged-112f36c6-7fa0-4a72-9edf-c9421eccd857 for instance with vm_state resized and task_state None.
May 27 23:06:20.792647 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:20.792827 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:20.793105 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Going to confirm migration 4 {{(pid=98289) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 27 23:06:21.006490 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:21.007845 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:21.298447 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:21.343575 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:21.422210 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:21.422524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:21.422718 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:21.422872 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:06:21.423055 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'info_cache' on Instance uuid a6723b2d-e0b1-495c-910d-3ef37d877c05 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:22.427727 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:22.711388 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:22.854489 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating instance_info_cache with network_info: [{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:23.357323 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:23.357323 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'migration_context' on Instance uuid a6723b2d-e0b1-495c-910d-3ef37d877c05 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:23.524090 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:23.860399 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Object Instance<a6723b2d-e0b1-495c-910d-3ef37d877c05> lazy-loaded attributes: info_cache,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:06:23.864844 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:23.865209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:24.977733 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:06:24.978151 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:06:25.480811 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:06:26.356054 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:26.492900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.628s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:26.730413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:26.730644 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:26.730874 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:26.731037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:26.731207 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:26.734095 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Terminating instance
May 27 23:06:27.018821 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:27.018971 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:27.112626 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Deleted allocation for migration 34edc8f7-eac5-4c5e-86f6-a7ecfcf6fc05
May 27 23:06:27.241281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:06:27.264830 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.267171 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.289937 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.292544 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.310691 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.333600 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.414208 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.450757 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aa49f011-7f21-4aeb-88a7-37dbf7191be0 req-0d093d64-125f-4d98-9c94-ddac014d1c60 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:27.451031 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aa49f011-7f21-4aeb-88a7-37dbf7191be0 req-0d093d64-125f-4d98-9c94-ddac014d1c60 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:27.451170 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aa49f011-7f21-4aeb-88a7-37dbf7191be0 req-0d093d64-125f-4d98-9c94-ddac014d1c60 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:27.451304 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aa49f011-7f21-4aeb-88a7-37dbf7191be0 req-0d093d64-125f-4d98-9c94-ddac014d1c60 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:27.451407 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aa49f011-7f21-4aeb-88a7-37dbf7191be0 req-0d093d64-125f-4d98-9c94-ddac014d1c60 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:27.451552 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aa49f011-7f21-4aeb-88a7-37dbf7191be0 req-0d093d64-125f-4d98-9c94-ddac014d1c60 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-ba433465-ba01-4869-9685-b6c13a640b01 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:27.491790 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.497301 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.521212 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Detaching volume e7244f7e-f2ef-4495-889e-d4e4acc86535
May 27 23:06:27.532712 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.549370 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.551435 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.553585 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.572016 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-74bb98ca-1a29-425c-9c9b-513b9b99c723 req-4ddf560d-faba-41cf-b3a0-abb4ae2621ad service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-7679fe69-489d-4734-889b-15238db0b2de {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:27.576508 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.578624 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74bb98ca-1a29-425c-9c9b-513b9b99c723 req-4ddf560d-faba-41cf-b3a0-abb4ae2621ad service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:27.578830 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74bb98ca-1a29-425c-9c9b-513b9b99c723 req-4ddf560d-faba-41cf-b3a0-abb4ae2621ad service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:27.578950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74bb98ca-1a29-425c-9c9b-513b9b99c723 req-4ddf560d-faba-41cf-b3a0-abb4ae2621ad service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:27.579069 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-74bb98ca-1a29-425c-9c9b-513b9b99c723 req-4ddf560d-faba-41cf-b3a0-abb4ae2621ad service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-7679fe69-489d-4734-889b-15238db0b2de {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:27.579176 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-74bb98ca-1a29-425c-9c9b-513b9b99c723 req-4ddf560d-faba-41cf-b3a0-abb4ae2621ad service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-7679fe69-489d-4734-889b-15238db0b2de for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:27.589991 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.598342 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Attempting to driver detach volume e7244f7e-f2ef-4495-889e-d4e4acc86535 from mountpoint /dev/vdc
May 27 23:06:27.608168 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Found disk vdc by alias ua-e7244f7e-f2ef-4495-889e-d4e4acc86535 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:06:27.609890 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Found disk vdc by alias ua-e7244f7e-f2ef-4495-889e-d4e4acc86535 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:06:27.609890 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Attempting to detach device vdc from instance 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:06:27.610560 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:06:27.610560 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:27.610560 np0000001565 nova-compute[98289]:   <alias name="ua-e7244f7e-f2ef-4495-889e-d4e4acc86535"/>
May 27 23:06:27.610560 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-8"/>
May 27 23:06:27.610560 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:06:27.610560 np0000001565 nova-compute[98289]:   <serial>e7244f7e-f2ef-4495-889e-d4e4acc86535</serial>
May 27 23:06:27.610560 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:06:27.610560 np0000001565 nova-compute[98289]: </disk>
May 27 23:06:27.610560 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:06:27.617790 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.619999 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fa0353f-63be-4503-86ca-0b60c1c287b1 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 6.827s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:27.626570 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Successfully detached device vdc from instance 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 from the persistent domain config.
May 27 23:06:27.626570 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] (1/8): Attempting to detach device vdc with device alias ua-e7244f7e-f2ef-4495-889e-d4e4acc86535 from instance 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:06:27.626570 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:06:27.626570 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:27.626570 np0000001565 nova-compute[98289]:   <alias name="ua-e7244f7e-f2ef-4495-889e-d4e4acc86535"/>
May 27 23:06:27.626570 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-8"/>
May 27 23:06:27.626570 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:06:27.626570 np0000001565 nova-compute[98289]:   <serial>e7244f7e-f2ef-4495-889e-d4e4acc86535</serial>
May 27 23:06:27.626570 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:06:27.626570 np0000001565 nova-compute[98289]: </disk>
May 27 23:06:27.626570 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:06:27.658152 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.686345 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.743256 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.767784 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bf5512cc-d803-4eea-a575-c91ee61d992c req-003ff1ce-4703-4271-986b-601e1d18ca2b service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:27.767784 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bf5512cc-d803-4eea-a575-c91ee61d992c req-003ff1ce-4703-4271-986b-601e1d18ca2b service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:27.767784 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bf5512cc-d803-4eea-a575-c91ee61d992c req-003ff1ce-4703-4271-986b-601e1d18ca2b service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:27.767974 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bf5512cc-d803-4eea-a575-c91ee61d992c req-003ff1ce-4703-4271-986b-601e1d18ca2b service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:27.768010 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bf5512cc-d803-4eea-a575-c91ee61d992c req-003ff1ce-4703-4271-986b-601e1d18ca2b service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:27.768121 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bf5512cc-d803-4eea-a575-c91ee61d992c req-003ff1ce-4703-4271-986b-601e1d18ca2b service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-3a02a883-ae80-41b7-873d-d30284a3b8aa for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:27.831041 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.848023 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.903747 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:27.930133 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99970488200006 future=<Future at 0x726e58383a40 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:27.930595 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99922483599994 future=<Future at 0x726e58383a40 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:27.930691 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999109076999957 future=<Future at 0x726e58383a40 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:27.935002 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Instance destroyed successfully.
May 27 23:06:27.935762 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lazy-loading 'resources' on Instance uuid b6529a44-e324-41a7-8db4-fed678008b49 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:27.947877 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.222717 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923188.222088, 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 => ua-e7244f7e-f2ef-4495-889e-d4e4acc86535> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:06:28.223832 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-e7244f7e-f2ef-4495-889e-d4e4acc86535 for instance 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:06:28.225766 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Successfully detached device vdc from instance 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 from the live domain config.
May 27 23:06:28.226594 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:06:28.226846 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7244f7e-f2ef-4495-889e-d4e4acc86535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:28.226960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:28.227272 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:28.227550 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7244f7e-f2ef-4495-889e-d4e4acc86535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:06:28.227661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:28.264925 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:28.265599 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '61')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:06:28.265599 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', '56')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:28.266903 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535', '57')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:28.268062 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3879c860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535'): ({'sdk'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:06:28.268295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Removing multipathed devices sdj, sdk {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:06:28.268569 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Flush multipath device 330000000553b65f2 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:06:28.300928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:28.352283 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:28.394726 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:06:28.394933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:06:28.396640 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:06:28.412652 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:06:28.412883 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:06:28.425989 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:28.441906 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:43Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:28.442166 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "ba433465-ba01-4869-9685-b6c13a640b01", "address": "fa:16:3e:4e:52:68", "network": {"id": "b4e502e1-c0f5-4c3f-af29-947c5bf15452", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-89585869-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba433465-ba", "ovs_interfaceid": "ba433465-ba01-4869-9685-b6c13a640b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:28.442755 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:52:68,bridge_name='br-int',has_traffic_filtering=True,id=ba433465-ba01-4869-9685-b6c13a640b01,network=Network(b4e502e1-c0f5-4c3f-af29-947c5bf15452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba433465-ba') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:28.442965 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:52:68,bridge_name='br-int',has_traffic_filtering=True,id=ba433465-ba01-4869-9685-b6c13a640b01,network=Network(b4e502e1-c0f5-4c3f-af29-947c5bf15452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba433465-ba') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:28.444153 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.444359 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba433465-ba, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.445533 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.446446 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.475295 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.476753 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.477009 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4328d892-dfaf-4841-9e75-19bbe43ea6a7) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.477774 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.478529 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.478998 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535, portal: 192.168.40.100,3260]
May 27 23:06:28.478998 np0000001565 nova-compute[98289]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535, portal: 192.168.40.100,3260] successful.
May 27 23:06:28.478998 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:28.507635 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.510214 np0000001565 nova-compute[98289]: INFO os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:52:68,bridge_name='br-int',has_traffic_filtering=True,id=ba433465-ba01-4869-9685-b6c13a640b01,network=Network(b4e502e1-c0f5-4c3f-af29-947c5bf15452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba433465-ba')
May 27 23:06:28.510782 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:43Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:28.510936 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "85626fc3-ef41-492d-b3a0-2bb370305172", "address": "fa:16:3e:ec:ef:10", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85626fc3-ef", "ovs_interfaceid": "85626fc3-ef41-492d-b3a0-2bb370305172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:28.511524 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ef:10,bridge_name='br-int',has_traffic_filtering=True,id=85626fc3-ef41-492d-b3a0-2bb370305172,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85626fc3-ef') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:28.511757 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ef:10,bridge_name='br-int',has_traffic_filtering=True,id=85626fc3-ef41-492d-b3a0-2bb370305172,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85626fc3-ef') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:28.512855 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.513416 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:28.513609 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85626fc3-ef, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.514758 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.515685 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.529017 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:28.544019 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.544019 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.544670 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.544670 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10dae054-c433-4b26-8f24-1e3a8a0b9f65) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.545210 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.545838 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.576543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535, portal: 192.168.50.100,3260]
May 27 23:06:28.576543 np0000001565 nova-compute[98289]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-e7244f7e-f2ef-4495-889e-d4e4acc86535, portal: 192.168.50.100,3260] successful.
May 27 23:06:28.576543 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:28.576806 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.578843 np0000001565 nova-compute[98289]: INFO os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ef:10,bridge_name='br-int',has_traffic_filtering=True,id=85626fc3-ef41-492d-b3a0-2bb370305172,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85626fc3-ef')
May 27 23:06:28.579650 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:43Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:28.580191 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "7679fe69-489d-4734-889b-15238db0b2de", "address": "fa:16:3e:37:67:cf", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7679fe69-48", "ovs_interfaceid": "7679fe69-489d-4734-889b-15238db0b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:28.580586 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=7679fe69-489d-4734-889b-15238db0b2de,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7679fe69-48') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:28.580832 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=7679fe69-489d-4734-889b-15238db0b2de,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7679fe69-48') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:28.581724 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.581907 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7679fe69-48, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.582991 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.583913 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.603141 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:28.603582 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.604199 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:28.604384 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] <== disconnect_volume: return (377ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:28.604516 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:06:28.606063 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.606927 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4606c42-0d5b-4f49-ad96-90e427773491) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.607522 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.608125 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.630677 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.633425 np0000001565 nova-compute[98289]: INFO os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:67:cf,bridge_name='br-int',has_traffic_filtering=True,id=7679fe69-489d-4734-889b-15238db0b2de,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7679fe69-48')
May 27 23:06:28.633425 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:43Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:28.633425 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "b63228fe-f10e-44de-90aa-ff5a303961f1", "address": "fa:16:3e:5e:b1:85", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63228fe-f1", "ovs_interfaceid": "b63228fe-f10e-44de-90aa-ff5a303961f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:28.633975 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=b63228fe-f10e-44de-90aa-ff5a303961f1,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63228fe-f1') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:28.634210 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=b63228fe-f10e-44de-90aa-ff5a303961f1,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63228fe-f1') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:28.635388 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.635698 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb63228fe-f1, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.636720 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.637715 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.656364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.656364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.656364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c68976e3-da33-4358-b5c6-27bdbff699cd) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.656364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.656364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.672618 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.674491 np0000001565 nova-compute[98289]: INFO os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=b63228fe-f10e-44de-90aa-ff5a303961f1,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63228fe-f1')
May 27 23:06:28.675185 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:43Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:28.675476 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "address": "fa:16:3e:d3:b7:0f", "network": {"id": "7ecae8a7-608b-46de-98c3-9869fe202c9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1346781556", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964f27a-2f", "ovs_interfaceid": "1964f27a-2f2b-4e91-a8f4-95b400a98ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:28.677051 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=1964f27a-2f2b-4e91-a8f4-95b400a98ed4,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964f27a-2f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:28.677505 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=1964f27a-2f2b-4e91-a8f4-95b400a98ed4,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964f27a-2f') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:28.678271 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.679713 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1964f27a-2f, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.681095 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.681958 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.691845 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.693241 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.693435 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d71e50d0-5b2f-4a79-97ba-ec9f0d121b2f) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.694913 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.702834 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.705612 np0000001565 nova-compute[98289]: INFO os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=1964f27a-2f2b-4e91-a8f4-95b400a98ed4,network=Network(7ecae8a7-608b-46de-98c3-9869fe202c9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964f27a-2f')
May 27 23:06:28.706556 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:43Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:28.707171 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "823809f8-1026-49bb-bea9-35e7f2b0a606", "address": "fa:16:3e:d3:3b:74", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap823809f8-10", "ovs_interfaceid": "823809f8-1026-49bb-bea9-35e7f2b0a606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:28.707510 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3b:74,bridge_name='br-int',has_traffic_filtering=True,id=823809f8-1026-49bb-bea9-35e7f2b0a606,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823809f8-10') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:28.707764 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3b:74,bridge_name='br-int',has_traffic_filtering=True,id=823809f8-1026-49bb-bea9-35e7f2b0a606,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823809f8-10') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:28.708782 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.709017 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap823809f8-10, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.710451 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.711633 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.717473 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.718535 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.718704 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1107be65-8333-476c-8b9a-589bf530c5a7) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.719237 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.719792 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.724089 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.726551 np0000001565 nova-compute[98289]: INFO os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3b:74,bridge_name='br-int',has_traffic_filtering=True,id=823809f8-1026-49bb-bea9-35e7f2b0a606,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap823809f8-10')
May 27 23:06:28.727421 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-177896744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-device-tagging-server-177896744',id=30,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2P03IHtJAqEY8mZzbgAQatyR8HJrglD5wRr4RyCJzn+BQbAEJSHkg6/BqilgfWamkkJ5kqR5il267wFq+NPeRwVx+frJFyKv95i60G/u5yZZRqQh1slVyTr4Mi9Q3ExA==',key_name='tempest-keypair-1760140809',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:43Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c3b9a9477ae4742b8584b00bec574cc',ramdisk_id='',reservation_id='r-0jergyhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-425781554',owner_user_name='tempest-TaggedBootDevicesTest_v242-425781554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b3b7912ee004099b8839d39df504d9b',uuid=b6529a44-e324-41a7-8db4-fed678008b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:28.727628 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converting VIF {"id": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "address": "fa:16:3e:4e:4d:67", "network": {"id": "bc21f9f3-ed10-4742-b6c5-15c532ca85e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-89561312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3c3b9a9477ae4742b8584b00bec574cc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a02a883-ae", "ovs_interfaceid": "3a02a883-ae80-41b7-873d-d30284a3b8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:28.728222 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4d:67,bridge_name='br-int',has_traffic_filtering=True,id=3a02a883-ae80-41b7-873d-d30284a3b8aa,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a02a883-ae') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:28.728503 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4d:67,bridge_name='br-int',has_traffic_filtering=True,id=3a02a883-ae80-41b7-873d-d30284a3b8aa,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a02a883-ae') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:28.729350 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.729561 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a02a883-ae, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.730597 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.732767 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.733737 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.733906 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=989c4d77-9b78-428b-a0fe-fc40b25ece13) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:28.734759 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.735312 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:28.735824 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:28.739304 np0000001565 nova-compute[98289]: INFO os_vif [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4d:67,bridge_name='br-int',has_traffic_filtering=True,id=3a02a883-ae80-41b7-873d-d30284a3b8aa,network=Network(bc21f9f3-ed10-4742-b6c5-15c532ca85e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a02a883-ae')
May 27 23:06:28.740886 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:06:28.741516 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15be4e68-7a48-451f-8f22-d208bcdd4a79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:28.741709 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:28.742186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:28.742733 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15be4e68-7a48-451f-8f22-d208bcdd4a79', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:06:28.742918 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:28.774955 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79 (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:28.775361 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '61')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:06:28.775361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', '46')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:28.776408 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79', '47')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:28.777290 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58797c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:06:28.777473 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:06:28.778676 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Flush multipath device 330000000db980d49 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:06:28.842793 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:28.897123 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:28.940693 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:06:28.940936 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:06:28.943103 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:06:28.955897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:06:28.956188 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:06:28.970640 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.017439 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79, portal: 192.168.40.100,3260]
May 27 23:06:29.017439 np0000001565 nova-compute[98289]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79, portal: 192.168.40.100,3260] successful.
May 27 23:06:29.017439 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.039896 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.052787 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.096403 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79, portal: 192.168.50.100,3260]
May 27 23:06:29.096403 np0000001565 nova-compute[98289]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-15be4e68-7a48-451f-8f22-d208bcdd4a79, portal: 192.168.50.100,3260] successful.
May 27 23:06:29.096403 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.122419 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.123369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:29.123369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] <== disconnect_volume: return (381ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:29.123369 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:06:29.124549 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:06:29.124728 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ce7cd08-1e78-4594-8471-016861339cfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:29.124854 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:29.125312 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:29.125730 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ce7cd08-1e78-4594-8471-016861339cfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:06:29.125902 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:29.155133 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:29.155616 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:29.155616 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '61')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:06:29.156063 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '48')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:29.160356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc', '49')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:29.160356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58797c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc'): ({'sdi'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:06:29.160356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Removing multipathed devices sdi, sdh {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:06:29.160356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Flush multipath device 33000000094a7dc4b {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:06:29.175191 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'flavor' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:29.193838 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:29.229966 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:29.285095 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:06:29.285384 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:06:29.287311 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:06:29.300761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:06:29.301086 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:06:29.314545 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.356684 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc, portal: 192.168.40.100,3260]
May 27 23:06:29.356684 np0000001565 nova-compute[98289]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc, portal: 192.168.40.100,3260] successful.
May 27 23:06:29.356684 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.377714 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.391533 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.429440 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc, portal: 192.168.50.100,3260]
May 27 23:06:29.429440 np0000001565 nova-compute[98289]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-4ce7cd08-1e78-4594-8471-016861339cfc, portal: 192.168.50.100,3260] successful.
May 27 23:06:29.429440 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.456957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.457153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:29.457272 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] <== disconnect_volume: return (332ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:29.457531 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:06:29.460762 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:06:29.461701 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:29.462297 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:29.462297 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:29.462679 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fdccea8d-bfcf-463c-8850-32f83d9f50d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:06:29.462897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:06:29.496546 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:29.496546 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:29.496546 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:29.496546 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:29.496546 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:29.496546 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:29.496546 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:29.496546 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:29.496546 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:29.496546 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:29.496546 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:29.496848 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:29.496848 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:29.496848 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:29.496848 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:29.496848 np0000001565 nova-compute[98289]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:29.496848 np0000001565 nova-compute[98289]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6 (non-flash)
May 27 23:06:29.496848 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:29.496848 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:29.496848 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:29.496848 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:29.496848 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:29.497012 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '61')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:06:29.497012 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '53')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:29.497970 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6', '52')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:29.498936 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3879c040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6'): ({'sdl'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:06:29.499755 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Removing multipathed devices sdm, sdl {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:06:29.500086 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Flush multipath device 33000000089e8e1e1 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:06:29.509129 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6be61c0f-4472-42d8-9543-9a52ef935f2a req-45b19310-e5fc-4c6a-a506-2e0a3e95d813 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.509545 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6be61c0f-4472-42d8-9543-9a52ef935f2a req-45b19310-e5fc-4c6a-a506-2e0a3e95d813 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:29.509727 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6be61c0f-4472-42d8-9543-9a52ef935f2a req-45b19310-e5fc-4c6a-a506-2e0a3e95d813 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:29.509844 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6be61c0f-4472-42d8-9543-9a52ef935f2a req-45b19310-e5fc-4c6a-a506-2e0a3e95d813 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:29.509946 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6be61c0f-4472-42d8-9543-9a52ef935f2a req-45b19310-e5fc-4c6a-a506-2e0a3e95d813 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:29.510052 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6be61c0f-4472-42d8-9543-9a52ef935f2a req-45b19310-e5fc-4c6a-a506-2e0a3e95d813 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-ba433465-ba01-4869-9685-b6c13a640b01 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:29.532978 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:29.588122 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:29.625806 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:06:29.626022 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:06:29.627384 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:06:29.638537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:06:29.638743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:06:29.651704 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-7679fe69-489d-4734-889b-15238db0b2de {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.652295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:29.653037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:29.653037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:29.653140 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-7679fe69-489d-4734-889b-15238db0b2de {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:29.653245 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-7679fe69-489d-4734-889b-15238db0b2de for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:29.653686 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-85626fc3-ef41-492d-b3a0-2bb370305172 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.653686 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:29.654434 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.654961 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:29.655022 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:29.655149 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-85626fc3-ef41-492d-b3a0-2bb370305172 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:29.655324 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-85626fc3-ef41-492d-b3a0-2bb370305172 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:29.657740 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-85626fc3-ef41-492d-b3a0-2bb370305172 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.657942 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:29.658218 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:29.658405 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:29.658553 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-85626fc3-ef41-492d-b3a0-2bb370305172 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:29.658651 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-85626fc3-ef41-492d-b3a0-2bb370305172 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:29.658797 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.659133 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:29.659282 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:29.659410 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:29.659538 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:29.659634 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:29.659757 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.659861 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:29.659971 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:29.660063 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:29.660157 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:29.660321 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:29.660384 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.660496 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:29.660623 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:29.660695 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:29.660783 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:29.660874 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-b63228fe-f10e-44de-90aa-ff5a303961f1 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:29.660962 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.661073 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:29.661192 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:29.661293 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:29.661404 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:29.661500 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-b63228fe-f10e-44de-90aa-ff5a303961f1 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:29.661650 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.661772 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:29.661912 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:29.662046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:29.662127 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:29.662218 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-823809f8-1026-49bb-bea9-35e7f2b0a606 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:29.662377 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.662485 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:29.662652 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:29.662652 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:29.662740 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:29.662833 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-823809f8-1026-49bb-bea9-35e7f2b0a606 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:29.662920 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-changed-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.663003 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Refreshing instance network info cache due to event network-changed-e837edcc-48f7-475e-ab37-e584deffe1c5. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:06:29.663112 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Acquiring lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:29.663195 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Acquired lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:29.663284 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Refreshing network info cache for port e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:06:29.689694 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6, portal: 192.168.40.100,3260]
May 27 23:06:29.689694 np0000001565 nova-compute[98289]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6, portal: 192.168.40.100,3260] successful.
May 27 23:06:29.689694 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.710602 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.721611 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.759428 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6, portal: 192.168.50.100,3260]
May 27 23:06:29.759428 np0000001565 nova-compute[98289]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-fdccea8d-bfcf-463c-8850-32f83d9f50d6, portal: 192.168.50.100,3260] successful.
May 27 23:06:29.759428 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.781658 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:29.781658 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:29.781658 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] <== disconnect_volume: return (319ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:29.781658 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:06:29.781869 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Deleting instance files /opt/stack/data/nova/instances/b6529a44-e324-41a7-8db4-fed678008b49_del
May 27 23:06:29.782478 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Deletion of /opt/stack/data/nova/instances/b6529a44-e324-41a7-8db4-fed678008b49_del complete
May 27 23:06:29.844412 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b1aacd5a-6125-4462-84be-8f59cb633c3a req-a5a10f5f-db70-4138-b28c-897bcc102ed9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:29.844647 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b1aacd5a-6125-4462-84be-8f59cb633c3a req-a5a10f5f-db70-4138-b28c-897bcc102ed9 service nova] Acquiring lock "b6529a44-e324-41a7-8db4-fed678008b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:29.845103 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b1aacd5a-6125-4462-84be-8f59cb633c3a req-a5a10f5f-db70-4138-b28c-897bcc102ed9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:29.845103 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b1aacd5a-6125-4462-84be-8f59cb633c3a req-a5a10f5f-db70-4138-b28c-897bcc102ed9 service nova] Lock "b6529a44-e324-41a7-8db4-fed678008b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:29.845103 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b1aacd5a-6125-4462-84be-8f59cb633c3a req-a5a10f5f-db70-4138-b28c-897bcc102ed9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] No waiting events found dispatching network-vif-unplugged-3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:29.845300 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b1aacd5a-6125-4462-84be-8f59cb633c3a req-a5a10f5f-db70-4138-b28c-897bcc102ed9 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-unplugged-3a02a883-ae80-41b7-873d-d30284a3b8aa for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:30.165402 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:30.181171 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b1b79498-29c1-4f07-bdba-78d59cc69b7b tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.162s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:30.289775 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Took 3.05 seconds to destroy the instance on the hypervisor.
May 27 23:06:30.290805 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:06:30.290805 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:06:30.290960 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: b6529a44-e324-41a7-8db4-fed678008b49] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:06:30.291640 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:30.312729 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:30.314033 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:30.314033 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:30.314033 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:30.314033 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:30.318486 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Terminating instance
May 27 23:06:30.480316 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:30.512086 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:30.652077 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updated VIF entry in instance network info cache for port e837edcc-48f7-475e-ab37-e584deffe1c5. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:06:30.655206 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating instance_info_cache with network_info: [{"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:30.824582 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:06:30.854127 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:30.859214 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:30.881684 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:30.887044 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:30.910346 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:30.911672 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:31.154954 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:31.161552 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2722bdde-e9b5-494f-98b7-c650c0c6d6fe req-f1f1737d-706c-47be-818c-319fdc9212fc service nova] Releasing lock "refresh_cache-a7839c43-8fd9-4deb-81c9-f128963f09ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:31.164546 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:31.188755 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99964983899963 future=<Future at 0x726e58374710 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:31.190455 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Instance destroyed successfully.
May 27 23:06:31.190991 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'resources' on Instance uuid 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:31.569442 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:31.569442 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:31.569442 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:31.569442 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:31.569442 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] No waiting events found dispatching network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:31.569442 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:31.569442 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:31.569442 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] Acquiring lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:31.569442 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:31.570512 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:31.571147 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] No waiting events found dispatching network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:31.571147 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e4bfcfd2-cf52-4486-9f60-54943e6b9bfd req-f6c989c9-f794-4bdf-abcd-37aa96ba4e43 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-vif-unplugged-ceb9d24a-c097-4869-8358-4b045b4e9d08 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:31.693609 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-142893825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-142893825',id=26,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM62J859+2pEbRLjdd0fhBLRZfGayfP3B5a1x5kH0UqnsmLNgl1KQR/DwJ2a1t/AckJdkTll1d8uU014SH0svwq0a9RyZ286r4Ur1QP2gPVWcPtA6gTS/kM+gxaRXalFIA==',key_name='tempest-keypair-140352231',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:49Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-p40b4hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=2b2f5344-3fbe-469b-bd1f-07b603ac1d33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:31.693881 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "address": "fa:16:3e:ad:f3:02", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceb9d24a-c0", "ovs_interfaceid": "ceb9d24a-c097-4869-8358-4b045b4e9d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:31.694422 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:31.694635 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:31.695521 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:31.695756 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapceb9d24a-c0, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:31.696891 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:31.697527 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:31.697936 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:31.698725 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:31.698875 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0cf965c-2594-4057-aca3-6bc952e6153a) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:31.699380 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:31.699780 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:31.702058 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:31.703723 np0000001565 nova-compute[98289]: INFO os_vif [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f3:02,bridge_name='br-int',has_traffic_filtering=True,id=ceb9d24a-c097-4869-8358-4b045b4e9d08,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceb9d24a-c0')
May 27 23:06:31.703990 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Deleting instance files /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33_del
May 27 23:06:31.713151 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Deletion of /opt/stack/data/nova/instances/2b2f5344-3fbe-469b-bd1f-07b603ac1d33_del complete
May 27 23:06:32.190216 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d526243a-3da3-48f5-acc8-0bd34edc78d5 req-4e5567db-93be-483e-8a55-06bf8ecd0ff8 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received event network-changed-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:32.190865 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d526243a-3da3-48f5-acc8-0bd34edc78d5 req-4e5567db-93be-483e-8a55-06bf8ecd0ff8 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Refreshing instance network info cache due to event network-changed-112f36c6-7fa0-4a72-9edf-c9421eccd857. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:06:32.191060 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d526243a-3da3-48f5-acc8-0bd34edc78d5 req-4e5567db-93be-483e-8a55-06bf8ecd0ff8 service nova] Acquiring lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:32.191178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d526243a-3da3-48f5-acc8-0bd34edc78d5 req-4e5567db-93be-483e-8a55-06bf8ecd0ff8 service nova] Acquired lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:32.191314 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d526243a-3da3-48f5-acc8-0bd34edc78d5 req-4e5567db-93be-483e-8a55-06bf8ecd0ff8 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Refreshing network info cache for port 112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:06:32.220203 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Took 1.40 seconds to destroy the instance on the hypervisor.
May 27 23:06:32.220853 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:06:32.221049 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:06:32.221138 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:06:32.221388 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:32.340362 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:32.693846 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d526243a-3da3-48f5-acc8-0bd34edc78d5 req-4e5567db-93be-483e-8a55-06bf8ecd0ff8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:32.887409 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-31f80b75-474f-47df-85fd-b665b1c3f4ec req-e62bd8bf-9f9f-457e-969a-a948218ac16a service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-deleted-ba433465-ba01-4869-9685-b6c13a640b01 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:32.887409 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-31f80b75-474f-47df-85fd-b665b1c3f4ec req-e62bd8bf-9f9f-457e-969a-a948218ac16a service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Neutron deleted interface ba433465-ba01-4869-9685-b6c13a640b01; detaching it from the instance and deleting it from the info cache
May 27 23:06:32.892204 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-31f80b75-474f-47df-85fd-b665b1c3f4ec req-e62bd8bf-9f9f-457e-969a-a948218ac16a service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Detach interface failed, port_id=ba433465-ba01-4869-9685-b6c13a640b01, reason: Instance b6529a44-e324-41a7-8db4-fed678008b49 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:06:33.128791 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d526243a-3da3-48f5-acc8-0bd34edc78d5 req-4e5567db-93be-483e-8a55-06bf8ecd0ff8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:33.301423 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d526243a-3da3-48f5-acc8-0bd34edc78d5 req-4e5567db-93be-483e-8a55-06bf8ecd0ff8 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updated VIF entry in instance network info cache for port 112f36c6-7fa0-4a72-9edf-c9421eccd857. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:06:33.301702 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d526243a-3da3-48f5-acc8-0bd34edc78d5 req-4e5567db-93be-483e-8a55-06bf8ecd0ff8 service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating instance_info_cache with network_info: [{"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:33.378012 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:33.545870 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:33.633837 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7c176dca-1de1-41f5-a61f-470074ace636 req-ebc61d44-8257-465f-a612-a7e64dffb42c service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-deleted-b63228fe-f10e-44de-90aa-ff5a303961f1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:33.634462 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-7c176dca-1de1-41f5-a61f-470074ace636 req-ebc61d44-8257-465f-a612-a7e64dffb42c service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Neutron deleted interface b63228fe-f10e-44de-90aa-ff5a303961f1; detaching it from the instance and deleting it from the info cache
May 27 23:06:33.635769 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7c176dca-1de1-41f5-a61f-470074ace636 req-ebc61d44-8257-465f-a612-a7e64dffb42c service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Detach interface failed, port_id=b63228fe-f10e-44de-90aa-ff5a303961f1, reason: Instance b6529a44-e324-41a7-8db4-fed678008b49 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:06:33.803627 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d526243a-3da3-48f5-acc8-0bd34edc78d5 req-4e5567db-93be-483e-8a55-06bf8ecd0ff8 service nova] Releasing lock "refresh_cache-a6723b2d-e0b1-495c-910d-3ef37d877c05" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:33.879835 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Took 1.66 seconds to deallocate network for instance.
May 27 23:06:34.051734 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:34.250155 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5ff68991-46d0-4ee0-a090-025ceadb1306 req-2c1b5aa5-c7a5-44df-8757-8fd5e45d3f03 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-deleted-3a02a883-ae80-41b7-873d-d30284a3b8aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:34.250528 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5ff68991-46d0-4ee0-a090-025ceadb1306 req-2c1b5aa5-c7a5-44df-8757-8fd5e45d3f03 service nova] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Received event network-vif-deleted-ceb9d24a-c097-4869-8358-4b045b4e9d08 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:34.386023 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:34.386167 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:34.553950 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Took 4.26 seconds to deallocate network for instance.
May 27 23:06:34.954968 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e4e9ac38-4941-4646-840b-abad92aa89f1 req-4d62e7d5-d90e-4a63-ba9a-536a136904a2 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-deleted-1964f27a-2f2b-4e91-a8f4-95b400a98ed4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:34.956013 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e4e9ac38-4941-4646-840b-abad92aa89f1 req-4d62e7d5-d90e-4a63-ba9a-536a136904a2 service nova] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Received event network-vif-deleted-823809f8-1026-49bb-bea9-35e7f2b0a606 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:34.956681 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:06:34.956883 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:06:35.459157 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:06:35.966646 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.580s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:36.039246 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Deleted allocations for instance 2b2f5344-3fbe-469b-bd1f-07b603ac1d33
May 27 23:06:36.196825 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Took 1.64 seconds to detach 3 volumes for instance.
May 27 23:06:36.699827 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:36.704736 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:36.704736 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:37.047187 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b41f15a-6bb2-40a3-8420-b1d33b585066 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "2b2f5344-3fbe-469b-bd1f-07b603ac1d33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.734s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:37.195631 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:37.195851 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:37.196064 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:37.196236 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:37.196383 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:37.198686 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Terminating instance
May 27 23:06:37.252340 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:06:37.252551 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:06:37.703543 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:06:37.723467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:37.732139 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:37.755630 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:37.756809 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:06:37.905397 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5de477cf-7b9e-4289-b7b5-52495afa0f91 req-f9a757e3-0586-433d-b9b3-16b17d92fe9e service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:37.909936 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:37.910156 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5de477cf-7b9e-4289-b7b5-52495afa0f91 req-f9a757e3-0586-433d-b9b3-16b17d92fe9e service nova] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:37.910846 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5de477cf-7b9e-4289-b7b5-52495afa0f91 req-f9a757e3-0586-433d-b9b3-16b17d92fe9e service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:37.910846 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5de477cf-7b9e-4289-b7b5-52495afa0f91 req-f9a757e3-0586-433d-b9b3-16b17d92fe9e service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:37.911794 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5de477cf-7b9e-4289-b7b5-52495afa0f91 req-f9a757e3-0586-433d-b9b3-16b17d92fe9e service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] No waiting events found dispatching network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:37.913912 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5de477cf-7b9e-4289-b7b5-52495afa0f91 req-f9a757e3-0586-433d-b9b3-16b17d92fe9e service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:37.913912 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:38.010663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:38.023669 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:38.037658 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99969727900043 future=<Future at 0x726e387e1160 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:38.045222 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Instance destroyed successfully.
May 27 23:06:38.045685 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'resources' on Instance uuid c6934452-ac0c-4d70-8ab4-c09b80c8829f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:38.263077 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.560s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:38.312189 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Deleted allocations for instance b6529a44-e324-41a7-8db4-fed678008b49
May 27 23:06:38.547240 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:38.550009 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-755854208',display_name='tempest-ServerActionsTestOtherA-server-755854208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='tempest-serveractionstestothera-server-755854208',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDbaj3DPBwSZJeJkSnhSxE7m4eskg4J4EL3Q2BBe+Q8XlC97E7Cxe9kHqz6aAye5+4WemBw1vcR74IA2SLmGxwKECL2TR/u5JVPPAw/fcZ9wwGfIrFs+wKKcahPL14eOA==',key_name='tempest-keypair-729756855',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:06:07Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-p9ihn7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:06:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=c6934452-ac0c-4d70-8ab4-c09b80c8829f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:38.551032 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "address": "fa:16:3e:30:d2:ed", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5f116b-ac", "ovs_interfaceid": "3d5f116b-acb3-45c5-852a-ba903302ea2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:38.554466 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:38.554953 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:38.556277 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:38.556524 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d5f116b-ac, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:38.558576 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:38.559498 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:38.561198 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:38.562056 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:38.562197 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbf13676-91c4-4156-9293-177404e51478) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:38.562632 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:38.563183 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:38.563489 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:38.565557 np0000001565 nova-compute[98289]: INFO os_vif [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:d2:ed,bridge_name='br-int',has_traffic_filtering=True,id=3d5f116b-acb3-45c5-852a-ba903302ea2e,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5f116b-ac')
May 27 23:06:38.568036 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:06:38.568367 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:38.568488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:38.568767 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:38.569017 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dbaed51e-0782-4850-9c80-429a77200302', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:06:38.569127 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:06:38.597656 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:38.597656 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:38.597656 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:38.597656 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:38.597656 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:38.597656 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:38.597656 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:38.597656 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:38.597656 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:38.598009 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:38.598009 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:38.598009 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:38.598009 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:38.598009 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:38.598009 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:38.598009 np0000001565 nova-compute[98289]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:38.598009 np0000001565 nova-compute[98289]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302 (non-flash)
May 27 23:06:38.598009 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:38.598228 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '61')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:06:38.598228 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '61')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:38.599553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302', '60')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:38.600865 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e602caa20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'): ({'sdn'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:06:38.601111 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Removing multipathed devices sdo, sdn {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:06:38.601407 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Flush multipath device 330000000da324ef1 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:06:38.657502 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:38.720153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:38.763900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:06:38.764046 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:06:38.765020 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:06:38.775547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:06:38.775711 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:06:38.787084 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:38.821596 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.40.100,3260]
May 27 23:06:38.821596 np0000001565 nova-compute[98289]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.40.100,3260] successful.
May 27 23:06:38.821596 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:38.838204 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:38.850499 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:38.886937 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.50.100,3260]
May 27 23:06:38.886937 np0000001565 nova-compute[98289]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-dbaed51e-0782-4850-9c80-429a77200302, portal: 192.168.50.100,3260] successful.
May 27 23:06:38.886937 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:38.905829 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:38.906120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:38.906279 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] <== disconnect_volume: return (337ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:38.906475 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:06:38.906790 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Deleting instance files /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f_del
May 27 23:06:38.907440 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Deletion of /opt/stack/data/nova/instances/c6934452-ac0c-4d70-8ab4-c09b80c8829f_del complete
May 27 23:06:39.320973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a1353163-945d-4e1e-8ecb-7d7a3bff8dc3 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Lock "b6529a44-e324-41a7-8db4-fed678008b49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.590s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:39.417641 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Took 1.71 seconds to destroy the instance on the hypervisor.
May 27 23:06:39.417641 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:06:39.417641 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:06:39.417641 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:06:39.417641 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:39.486538 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:39.832520 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:39.833110 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:39.897705 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f7b8c62b-b3b4-400b-b916-635f074410cf req-5fea4176-c4e0-44ec-8c82-48b60b9c35f9 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-vif-deleted-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:39.897917 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-f7b8c62b-b3b4-400b-b916-635f074410cf req-5fea4176-c4e0-44ec-8c82-48b60b9c35f9 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Neutron deleted interface 3d5f116b-acb3-45c5-852a-ba903302ea2e; detaching it from the instance and deleting it from the info cache
May 27 23:06:39.899563 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f7b8c62b-b3b4-400b-b916-635f074410cf req-5fea4176-c4e0-44ec-8c82-48b60b9c35f9 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Detach interface failed, port_id=3d5f116b-acb3-45c5-852a-ba903302ea2e, reason: Instance c6934452-ac0c-4d70-8ab4-c09b80c8829f could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:06:39.962631 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bfbd7e8c-10cc-49b0-922b-cc02abf3063c req-d2d5906a-bd06-4e8f-a23a-e5896f74bea8 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:39.962824 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bfbd7e8c-10cc-49b0-922b-cc02abf3063c req-d2d5906a-bd06-4e8f-a23a-e5896f74bea8 service nova] Acquiring lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:39.964858 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bfbd7e8c-10cc-49b0-922b-cc02abf3063c req-d2d5906a-bd06-4e8f-a23a-e5896f74bea8 service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:39.965159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bfbd7e8c-10cc-49b0-922b-cc02abf3063c req-d2d5906a-bd06-4e8f-a23a-e5896f74bea8 service nova] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:39.965492 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bfbd7e8c-10cc-49b0-922b-cc02abf3063c req-d2d5906a-bd06-4e8f-a23a-e5896f74bea8 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] No waiting events found dispatching network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:39.965627 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bfbd7e8c-10cc-49b0-922b-cc02abf3063c req-d2d5906a-bd06-4e8f-a23a-e5896f74bea8 service nova] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Received event network-vif-unplugged-3d5f116b-acb3-45c5-852a-ba903302ea2e for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:40.334237 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:06:40.344258 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:40.536241 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:40.536926 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:40.845886 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Took 1.43 seconds to deallocate network for instance.
May 27 23:06:40.886243 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:40.886447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:40.890001 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:06:40.890140 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Claim successful on node np0000001565
May 27 23:06:41.040371 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lazy-loading 'flavor' on Instance uuid 225ad6d6-6422-4bab-994c-fcc6c720b0ea {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:41.294632 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:41.413745 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Took 0.57 seconds to detach 1 volumes for instance.
May 27 23:06:41.416578 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Deleting volume: dbaed51e-0782-4850-9c80-429a77200302 {{(pid=98289) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 23:06:41.968260 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:42.045598 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:42.413353 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:06:42.413570 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:06:42.916059 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:06:42.931449 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00039122399994084844 future=<Future at 0x726e58383a40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:42.931449 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Emitting event <LifecycleEvent: 1779923187.9297495, b6529a44-e324-41a7-8db4-fed678008b49 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:42.931653 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:42.931739 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] VM Stopped (Lifecycle Event)
May 27 23:06:42.932464 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.2558866489998763 future=<Future at 0x726e58374710 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:42.932651 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.255756963999829 future=<Future at 0x726e58374710 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:43.184641 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:43.184791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:43.185036 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Attaching volume 05af6240-1c63-435e-9fb4-b10b8dc50b3b to /dev/vdb
May 27 23:06:43.230478 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:43.241324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:06:43.263786 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:43.303559 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:06:43.303945 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:06:43.312328 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:06:43.314215 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe97:5112', 'fe80::8424:a6ff:feb1:da4b', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:fe94:b6ed', 'fe80::906a:e4ff:fe34:5279', 'fe80::fc16:3eff:fe7f:446c', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4', 'fe80::fc16:3eff:fedf:3653'] 
May 27 23:06:43.314370 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:06:43.314534 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:06:43.314809 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:43.315092 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Updating existing volume attachment record: 6718b6b4-326b-430d-982b-6e5e2f3b467d {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:06:43.423267 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.537s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:43.424397 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:06:43.428234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.455s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:43.430459 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.007s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:43.437267 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-570ddfcd-2cb9-440b-a900-98991cadcec6 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: b6529a44-e324-41a7-8db4-fed678008b49] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:43.482496 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Deleted allocations for instance c6934452-ac0c-4d70-8ab4-c09b80c8829f
May 27 23:06:43.561066 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:43.870798 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:06:43.871225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:43.871455 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:43.871984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:43.872759 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:06:43.889562 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:43.890116 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:43.890747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:43.890846 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:06:43.891361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:43.891361 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:06:43.904895 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:06:43.904895 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:43.910068 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:06:43.910068 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:43.916195 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b] added
May 27 23:06:43.916195 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:06:43.916195 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:43.916195 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:43.916195 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:43.916195 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:43.916195 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:43.916938 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:06:43.916938 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:06:43.916938 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:06:43.922500 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b] added
May 27 23:06:43.922500 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:06:43.922500 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:43.922500 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:43.922500 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:43.922500 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:43.922500 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:43.922737 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:06:43.922967 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:06:43.923163 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:06:43.932680 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:06:43.932914 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:06:43.933179 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:43.933463 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:44.005743 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd1c936280234ce2ab39aacb89c5af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475430e1d5044d9b97a65459543a1361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:06:44.439741 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:06:44.465375 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Successfully created port: fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:06:44.493369 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0056963-a9c5-4e96-9b65-3fd680bc9ffe tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "c6934452-ac0c-4d70-8ab4-c09b80c8829f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.297s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:44.919811 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:06:44.925134 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:44.934119 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:44.934119 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:44.943855 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:44.947206 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:44.947206 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:44.952420 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Successfully updated port: fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:06:44.957091 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:44.970166 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:44.977469 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:44.977469 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:44.977469 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:44.977469 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:44.977469 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:44.977469 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:44.977469 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:44.978838 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:44.978838 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:44.978838 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:44.978838 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:44.978838 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:44.978838 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:44.978838 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:44.987423 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:44.987423 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:44.987423 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:44.987423 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:44.987423 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:44.987423 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:44.987423 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:44.987947 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:44.987947 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:44.987947 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:44.987947 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:44.987947 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:44.987947 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:44.987947 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:45.009250 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4c850975-0a93-4e90-9c1f-8aeb8e38b91a req-e85383b6-ebdb-4c26-855c-a181e10f35a6 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-changed-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:45.009601 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4c850975-0a93-4e90-9c1f-8aeb8e38b91a req-e85383b6-ebdb-4c26-855c-a181e10f35a6 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Refreshing instance network info cache due to event network-changed-fcd4468c-2b77-4da0-a875-6375149e0a09. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:06:45.009728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4c850975-0a93-4e90-9c1f-8aeb8e38b91a req-e85383b6-ebdb-4c26-855c-a181e10f35a6 service nova] Acquiring lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:45.009772 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4c850975-0a93-4e90-9c1f-8aeb8e38b91a req-e85383b6-ebdb-4c26-855c-a181e10f35a6 service nova] Acquired lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:45.009901 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4c850975-0a93-4e90-9c1f-8aeb8e38b91a req-e85383b6-ebdb-4c26-855c-a181e10f35a6 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Refreshing network info cache for port fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:06:45.033116 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b, portal: 192.168.50.100,3260]
May 27 23:06:45.033116 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b, portal: 192.168.50.100,3260] successful.
May 27 23:06:45.033116 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:45.047900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:45.047900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b, portal: 192.168.40.100,3260]
May 27 23:06:45.047900 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b, portal: 192.168.40.100,3260] successful.
May 27 23:06:45.047900 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:45.065575 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:45.065575 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:45.065575 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:45.065575 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:45.065575 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:45.065575 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:45.065575 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:45.065575 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:45.065575 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:45.066229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:45.068956 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] HCTL ('11', '-', '-', 0) found on session 62 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:45.068956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:45.087741 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:45.089405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:45.089405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:45.089583 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Searching for a device in session 62 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:45.089894 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:45.091953 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] HCTL ('12', '-', '-', 0) found on session 63 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:45.092138 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:45.106564 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Searching for a device in session 63 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:45.106564 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:45.124830 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:06:45.459062 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:45.512401 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4c850975-0a93-4e90-9c1f-8aeb8e38b91a req-e85383b6-ebdb-4c26-855c-a181e10f35a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:45.572581 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4c850975-0a93-4e90-9c1f-8aeb8e38b91a req-e85383b6-ebdb-4c26-855c-a181e10f35a6 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:06:45.635117 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:45.635117 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:45.635117 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:45.635117 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:06:45.721841 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4c850975-0a93-4e90-9c1f-8aeb8e38b91a req-e85383b6-ebdb-4c26-855c-a181e10f35a6 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:45.891199 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:06:45.952808 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:06:45.953786 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:06:45.954050 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Creating image(s)
May 27 23:06:45.954987 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:45.955224 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:45.955733 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:45.956291 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:45.960553 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:45.961558 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:46.050892 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:46.051467 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:46.052082 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:46.052630 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:46.056821 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:06:46.057295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:46.152025 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:46.152589 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:46.189389 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0009337500000583532 future=<Future at 0x726e58374710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:46.189530 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:46.189739 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.847626954000134 future=<Future at 0x726e387e1160 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:46.189868 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.8474698880004325 future=<Future at 0x726e387e1160 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:46.190700 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Emitting event <LifecycleEvent: 1779923191.1882732, 2b2f5344-3fbe-469b-bd1f-07b603ac1d33 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:46.190918 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] VM Stopped (Lifecycle Event)
May 27 23:06:46.209781 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk 1073741824" returned: 0 in 0.057s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:46.210983 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:46.210983 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:46.227585 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4c850975-0a93-4e90-9c1f-8aeb8e38b91a req-e85383b6-ebdb-4c26-855c-a181e10f35a6 service nova] Releasing lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:46.231914 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquired lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:46.232709 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:06:46.304187 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:46.305841 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:06:46.305841 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:46.415162 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:46.415591 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Cannot resize image /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:06:46.416003 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:06:46.416394 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Ensure instance console log exists: /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:06:46.417212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:46.417212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:46.417212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:46.554785 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:46.554948 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:46.643934 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:46.679711 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:46.700825 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "3eb890c1-c528-489f-8109-4b7870bfcf33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:46.700825 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:46.701273 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:46.701800 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:46.701800 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:46.706179 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 2b2f5344-3fbe-469b-bd1f-07b603ac1d33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:46.709402 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Terminating instance
May 27 23:06:46.774326 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:46.774879 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:46.805693 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:06:46.861729 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:46.862156 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:06:46.865803 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:46.909689 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Found WWN 330000000f4c51a7c for multipath device dm-4 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:06:46.910323 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:46.910597 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000f4c51a7c', 'path': '/dev/dm-4', 'multipath_id': '330000000f4c51a7c'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:46.910820 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f4c51a7c', 'path': '/dev/dm-4', 'multipath_id': '330000000f4c51a7c'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:06:46.915376 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lazy-loading 'flavor' on Instance uuid 225ad6d6-6422-4bab-994c-fcc6c720b0ea {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:46.958514 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:46.959179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:46.992174 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:47.043943 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:47.048504 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:06:47.050395 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:47.065061 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:47.136323 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updating instance_info_cache with network_info: [{"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:47.137563 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:47.137992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:47.216259 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:06:47.219943 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:47.222468 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:47.234154 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:47.256395 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:47.261369 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:47.284030 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:47.319430 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:47.319952 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:47.379352 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a319c1a5-19f4-49bf-8e2e-6c0535d151a5 req-7f9617bd-98ef-49bf-abd5-c32d3567d70d service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Received event network-vif-unplugged-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:47.379694 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a319c1a5-19f4-49bf-8e2e-6c0535d151a5 req-7f9617bd-98ef-49bf-abd5-c32d3567d70d service nova] Acquiring lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:47.379990 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a319c1a5-19f4-49bf-8e2e-6c0535d151a5 req-7f9617bd-98ef-49bf-abd5-c32d3567d70d service nova] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:47.380111 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a319c1a5-19f4-49bf-8e2e-6c0535d151a5 req-7f9617bd-98ef-49bf-abd5-c32d3567d70d service nova] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:47.380277 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a319c1a5-19f4-49bf-8e2e-6c0535d151a5 req-7f9617bd-98ef-49bf-abd5-c32d3567d70d service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] No waiting events found dispatching network-vif-unplugged-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:47.380488 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a319c1a5-19f4-49bf-8e2e-6c0535d151a5 req-7f9617bd-98ef-49bf-abd5-c32d3567d70d service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Received event network-vif-unplugged-a94e67a9-7aeb-4935-b3f6-a13811736551 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:47.405651 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:47.405826 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:06:47.409004 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:47.429194 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Attempting to attach volume 05af6240-1c63-435e-9fb4-b10b8dc50b3b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:06:47.431154 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:06:47.431154 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:47.431154 np0000001565 nova-compute[98289]:   <alias name="ua-05af6240-1c63-435e-9fb4-b10b8dc50b3b"/>
May 27 23:06:47.431154 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-4"/>
May 27 23:06:47.431154 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:06:47.431154 np0000001565 nova-compute[98289]:   <serial>05af6240-1c63-435e-9fb4-b10b8dc50b3b</serial>
May 27 23:06:47.431154 np0000001565 nova-compute[98289]: </disk>
May 27 23:06:47.431154 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:06:47.494362 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:47.494362 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:47.593439 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:47.598095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:47.652969 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Releasing lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:47.653627 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Instance network_info: |[{"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:06:47.656047 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Start _get_guest_xml network_info=[{"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:06:47.662847 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:06:47.664641 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-2055205716', uuid='a58d20c9-5038-4ea3-842e-406b0253f15b'), owner=OwnerMeta(userid='dd1c936280234ce2ab39aacb89c5af22', username='tempest-AttachVolumeShelveTestJSON-876504441-project-member', projectid='475430e1d5044d9b97a65459543a1361', projectname='tempest-AttachVolumeShelveTestJSON-876504441'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923207.6640048) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:06:47.665946 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999593817000004 future=<Future at 0x726e386cdb20 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:47.666895 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:06:47.667287 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:06:47.669568 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:06:47.669980 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:06:47.671221 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:06:47.671644 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:06:47.671805 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:06:47.671914 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:06:47.671970 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:06:47.672100 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:06:47.672157 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:06:47.672464 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:06:47.672464 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:06:47.672607 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:06:47.672607 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:06:47.673364 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:06:47.689704 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Instance destroyed successfully.
May 27 23:06:47.692032 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2055205716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-2055205716',id=34,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlXgwR+mJL4X62uviA59Sg2o4dXlvjOmgIlg6odsB10BjNBoGqu01/G0GMdVvx7UUCkjG6N+PhuPE4wyV5SToTI9u2Z8MdBW6kzcc68Hmu+/strmT6yCpg+Ql8+rNl3eg==',key_name='tempest-keypair-1961618511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-j4dw1ehs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=a58d20c9-5038-4ea3-842e-406b0253f15b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:06:47.692032 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lazy-loading 'resources' on Instance uuid 3eb890c1-c528-489f-8109-4b7870bfcf33 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:47.694876 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:47.694876 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:47.694876 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'pci_devices' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:47.713375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:47.714378 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:47.808980 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:47.809474 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:06:47.813017 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:47.899772 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:47.899772 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:47.978478 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:47.983392 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:48.066541 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:48.067350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:48.087514 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.532s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:48.155393 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:48.155869 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:06:48.159273 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:06:48.160540 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:48.198058 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-577068969',display_name='tempest-ServerActionsTestOtherA-server-577068969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionstestothera-server-577068969',id=15,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDbaj3DPBwSZJeJkSnhSxE7m4eskg4J4EL3Q2BBe+Q8XlC97E7Cxe9kHqz6aAye5+4WemBw1vcR74IA2SLmGxwKECL2TR/u5JVPPAw/fcZ9wwGfIrFs+wKKcahPL14eOA==',key_name='tempest-keypair-729756855',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:02:29Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6f15f51479c4e37ab880af2031170be',ramdisk_id='',reservation_id='r-o9ri1w6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1786604563',owner_user_name='tempest-ServerActionsTestOtherA-1786604563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0d298d70064eac8ffd4fe25b1e203b',uuid=3eb890c1-c528-489f-8109-4b7870bfcf33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:48.198355 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converting VIF {"id": "a94e67a9-7aeb-4935-b3f6-a13811736551", "address": "fa:16:3e:97:51:12", "network": {"id": "5c913d93-02e0-43c9-b9d4-4e001e1e4376", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-872418179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6f15f51479c4e37ab880af2031170be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94e67a9-7a", "ovs_interfaceid": "a94e67a9-7aeb-4935-b3f6-a13811736551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:48.199189 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:51:12,bridge_name='br-int',has_traffic_filtering=True,id=a94e67a9-7aeb-4935-b3f6-a13811736551,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94e67a9-7a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:48.199777 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:51:12,bridge_name='br-int',has_traffic_filtering=True,id=a94e67a9-7aeb-4935-b3f6-a13811736551,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94e67a9-7a') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:48.201489 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:48.202029 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa94e67a9-7a, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:48.205068 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] End _get_guest_xml xml=<domain type="qemu">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <uuid>a58d20c9-5038-4ea3-842e-406b0253f15b</uuid>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <name>instance-00000022</name>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2055205716</nova:name>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:06:47</nova:creationTime>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:user uuid="dd1c936280234ce2ab39aacb89c5af22">tempest-AttachVolumeShelveTestJSON-876504441-project-member</nova:user>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:project uuid="475430e1d5044d9b97a65459543a1361">tempest-AttachVolumeShelveTestJSON-876504441</nova:project>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         <nova:port uuid="fcd4468c-2b77-4da0-a875-6375149e0a09">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <system>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <entry name="serial">a58d20c9-5038-4ea3-842e-406b0253f15b</entry>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <entry name="uuid">a58d20c9-5038-4ea3-842e-406b0253f15b</entry>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     </system>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <os>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   </os>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <features>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   </features>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   <devices>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.config"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     </disk>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:fc:4f:23"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <target dev="tapfcd4468c-2b"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     </interface>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/console.log" append="off"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     </serial>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <video>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     </video>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     </rng>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:   </devices>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]: </domain>
May 27 23:06:48.205068 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:06:48.206959 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Preparing to wait for external event network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:06:48.207220 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:48.207845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:48.209027 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:48.209665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:48.209879 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:48.211117 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:48.211531 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2055205716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-2055205716',id=34,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlXgwR+mJL4X62uviA59Sg2o4dXlvjOmgIlg6odsB10BjNBoGqu01/G0GMdVvx7UUCkjG6N+PhuPE4wyV5SToTI9u2Z8MdBW6kzcc68Hmu+/strmT6yCpg+Ql8+rNl3eg==',key_name='tempest-keypair-1961618511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-j4dw1ehs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=a58d20c9-5038-4ea3-842e-406b0253f15b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:06:48.211848 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:48.212409 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a85029e-3ff5-4460-9785-bb30178bc150) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:48.212928 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=11030MB free_disk=73.92216873168945GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:06:48.213456 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:48.214526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:48.214769 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:06:48.215226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:48.217516 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:48.217516 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:48.217516 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:48.217516 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:06:48.218432 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:48.218630 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '635cde7a-4b4b-555a-9ffc-d61b6d518f16', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:48.220090 np0000001565 nova-compute[98289]: INFO os_vif [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:51:12,bridge_name='br-int',has_traffic_filtering=True,id=a94e67a9-7aeb-4935-b3f6-a13811736551,network=Network(5c913d93-02e0-43c9-b9d4-4e001e1e4376),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94e67a9-7a')
May 27 23:06:48.220283 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:48.221357 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:48.223955 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:48.224389 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Deleting instance files /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33_del
May 27 23:06:48.224607 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcd4468c-2b, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:48.224924 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcd4468c-2b, col_values=(('qos', UUID('ebda74aa-4c39-4b01-b5a0-655721c26ee7')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:48.225098 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcd4468c-2b, col_values=(('external_ids', {'iface-id': 'fcd4468c-2b77-4da0-a875-6375149e0a09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:4f:23', 'vm-uuid': 'a58d20c9-5038-4ea3-842e-406b0253f15b'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:48.226191 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Deletion of /opt/stack/data/nova/instances/3eb890c1-c528-489f-8109-4b7870bfcf33_del complete
May 27 23:06:48.232318 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:48.233262 np0000001565 nova-compute[98289]: INFO os_vif [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b')
May 27 23:06:48.419099 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:48.564660 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:48.734496 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Took 1.52 seconds to destroy the instance on the hypervisor.
May 27 23:06:48.735600 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:06:48.735971 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:06:48.736108 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:06:48.736617 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:48.830891 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:49.132745 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-35f32e4b-1fea-4eeb-a529-b97ee5374915 req-634d5d31-f5b9-47d8-906c-7ab9e67737f9 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Received event network-vif-deleted-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:49.133186 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-35f32e4b-1fea-4eeb-a529-b97ee5374915 req-634d5d31-f5b9-47d8-906c-7ab9e67737f9 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Neutron deleted interface a94e67a9-7aeb-4935-b3f6-a13811736551; detaching it from the instance and deleting it from the info cache
May 27 23:06:49.134715 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-35f32e4b-1fea-4eeb-a529-b97ee5374915 req-634d5d31-f5b9-47d8-906c-7ab9e67737f9 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Detach interface failed, port_id=a94e67a9-7aeb-4935-b3f6-a13811736551, reason: Instance 3eb890c1-c528-489f-8109-4b7870bfcf33 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:06:49.150405 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:49.150498 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:49.150709 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Attaching volume 5779ae85-054b-49e5-83e2-91d2b985c579 to /dev/vdb
May 27 23:06:49.188891 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:49.200318 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:06:49.213810 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:49.213810 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:49.213810 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:49.213810 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No VIF found with MAC fa:16:3e:94:b6:ed, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:06:49.224974 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:49.268159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:06:49.268828 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:06:49.277551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:06:49.278846 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:fe94:b6ed', 'fe80::906a:e4ff:fe34:5279', 'fe80::fc16:3eff:fe7f:446c', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4', 'fe80::fc16:3eff:fedf:3653'] 
May 27 23:06:49.279032 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:06:49.279103 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:06:49.279389 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:49.279612 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Updating existing volume attachment record: f23abb6f-1c8f-4cda-872b-5acc4b82b2e7 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:06:49.313753 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance f47a00cc-da92-40c9-a668-9a160670addd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:06:49.313961 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 3eb890c1-c528-489f-8109-4b7870bfcf33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:06:49.314110 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6a99f05a-6544-4994-9a1a-d98c320d088a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:06:49.314278 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6ab04c1a-7858-471e-95fd-5b04d1da3061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:06:49.314447 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance ad096c70-bfa7-4c5c-88bc-aacf02a9a386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:06:49.314581 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance a7839c43-8fd9-4deb-81c9-f128963f09ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:06:49.314727 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:06:49.314852 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:06:49.314987 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance a6723b2d-e0b1-495c-910d-3ef37d877c05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:06:49.315184 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance a58d20c9-5038-4ea3-842e-406b0253f15b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:06:49.315427 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:06:49.315610 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=2560MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:06:48 up 35 min,  2 users,  load average: 7.44, 6.89, 3.78\n', 'num_instances': '10', 'num_vm_active': '9', 'num_task_None': '8', 'num_os_type_None': '10', 'num_proj_0ec877dc7b2240969ac89c13673f8799': '5', 'io_workload': '1', 'num_task_deleting': '1', 'num_proj_d6f15f51479c4e37ab880af2031170be': '1', 'num_proj_0a9dde83267d415abbd137e795ac45e9': '1', 'num_proj_4d7499fc96c14d4fb66aa37e4a78012f': '1', 'num_proj_8b69ef10bedf41b48b1455ae48aa534e': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_475430e1d5044d9b97a65459543a1361': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:06:49.553090 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3df5e825-28ae-4c3c-bb2c-39b78e53cd09 req-103c9e31-1511-443b-bd56-0b789f15c938 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Received event network-vif-unplugged-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:49.553090 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3df5e825-28ae-4c3c-bb2c-39b78e53cd09 req-103c9e31-1511-443b-bd56-0b789f15c938 service nova] Acquiring lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:49.553243 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3df5e825-28ae-4c3c-bb2c-39b78e53cd09 req-103c9e31-1511-443b-bd56-0b789f15c938 service nova] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:49.553362 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3df5e825-28ae-4c3c-bb2c-39b78e53cd09 req-103c9e31-1511-443b-bd56-0b789f15c938 service nova] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:49.553483 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3df5e825-28ae-4c3c-bb2c-39b78e53cd09 req-103c9e31-1511-443b-bd56-0b789f15c938 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] No waiting events found dispatching network-vif-unplugged-a94e67a9-7aeb-4935-b3f6-a13811736551 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:49.553603 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3df5e825-28ae-4c3c-bb2c-39b78e53cd09 req-103c9e31-1511-443b-bd56-0b789f15c938 service nova] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Received event network-vif-unplugged-a94e67a9-7aeb-4935-b3f6-a13811736551 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:49.588965 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:49.770234 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:49.770441 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:49.770620 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No VIF found with MAC fa:16:3e:fc:4f:23, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:06:49.771246 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Using config drive
May 27 23:06:49.871349 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8e6a355e-e4c7-4d32-9a78-9ce892cd35ef', 'attached_at': '', 'detached_at': '', 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'serial': '5779ae85-054b-49e5-83e2-91d2b985c579'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:06:49.872920 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:06:49.872920 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:49.873055 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:49.873906 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:49.873906 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:06:49.886925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:49.887395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:49.887828 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:49.888008 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:06:49.888359 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:49.888576 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:06:49.902877 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:06:49.902877 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:49.913587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:06:49.913587 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:49.926387 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579] added
May 27 23:06:49.926387 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:06:49.926387 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:49.926387 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:49.926387 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:49.926387 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:49.926387 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:49.926696 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579] added
May 27 23:06:49.926696 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:06:49.926696 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:49.926696 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:49.926696 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:49.926696 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:49.926696 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:49.927270 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:06:49.927509 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:06:49.927674 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:06:49.927851 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0397(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:06:49.927985 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:06:49.928102 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:06:49.970311 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:06:49.970513 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:06:50.056992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:50.057180 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:50.091897 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Took 1.36 seconds to deallocate network for instance.
May 27 23:06:50.276995 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:50.327959 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:50.328173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:50.400099 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Creating config drive at /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.config
May 27 23:06:50.404002 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp58dqf6yl {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:50.469232 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp58dqf6yl" returned: 0 in 0.065s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:06:50.475897 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:06:50.559646 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Detaching volume dad32169-263d-43eb-a14f-f0ffa8abca81
May 27 23:06:50.597990 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:50.609566 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Attempting to driver detach volume dad32169-263d-43eb-a14f-f0ffa8abca81 from mountpoint /dev/vdb
May 27 23:06:50.615159 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found disk vdb by alias ua-dad32169-263d-43eb-a14f-f0ffa8abca81 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:06:50.616549 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found disk vdb by alias ua-dad32169-263d-43eb-a14f-f0ffa8abca81 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:06:50.616697 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Attempting to detach device vdb from instance a7839c43-8fd9-4deb-81c9-f128963f09ec from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:06:50.617005 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:06:50.617005 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:50.617005 np0000001565 nova-compute[98289]:   <alias name="ua-dad32169-263d-43eb-a14f-f0ffa8abca81"/>
May 27 23:06:50.617005 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:06:50.617005 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:06:50.617005 np0000001565 nova-compute[98289]:   <serial>dad32169-263d-43eb-a14f-f0ffa8abca81</serial>
May 27 23:06:50.617005 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:06:50.617005 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:06:50.617005 np0000001565 nova-compute[98289]: </disk>
May 27 23:06:50.617005 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:06:50.622644 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully detached device vdb from instance a7839c43-8fd9-4deb-81c9-f128963f09ec from the persistent domain config.
May 27 23:06:50.622882 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] (1/8): Attempting to detach device vdb with device alias ua-dad32169-263d-43eb-a14f-f0ffa8abca81 from instance a7839c43-8fd9-4deb-81c9-f128963f09ec from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:06:50.623200 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:06:50.623200 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:50.623200 np0000001565 nova-compute[98289]:   <alias name="ua-dad32169-263d-43eb-a14f-f0ffa8abca81"/>
May 27 23:06:50.623200 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:06:50.623200 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:06:50.623200 np0000001565 nova-compute[98289]:   <serial>dad32169-263d-43eb-a14f-f0ffa8abca81</serial>
May 27 23:06:50.623200 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:06:50.623200 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:06:50.623200 np0000001565 nova-compute[98289]: </disk>
May 27 23:06:50.623200 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:06:50.767611 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d44576c0-ccd7-459e-9b28-ad8e962432bb tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.583s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:50.830664 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Detaching volume 7f08da9e-88c8-4697-a761-28fc35c7222c
May 27 23:06:50.912799 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Attempting to driver detach volume 7f08da9e-88c8-4697-a761-28fc35c7222c from mountpoint /dev/vdb
May 27 23:06:50.918550 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Found disk vdb by alias ua-7f08da9e-88c8-4697-a761-28fc35c7222c {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:06:50.920272 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Found disk vdb by alias ua-7f08da9e-88c8-4697-a761-28fc35c7222c {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:06:50.920535 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Attempting to detach device vdb from instance ad096c70-bfa7-4c5c-88bc-aacf02a9a386 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:06:50.920905 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:06:50.920905 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:50.920905 np0000001565 nova-compute[98289]:   <alias name="ua-7f08da9e-88c8-4697-a761-28fc35c7222c"/>
May 27 23:06:50.920905 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-9"/>
May 27 23:06:50.920905 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:06:50.920905 np0000001565 nova-compute[98289]:   <serial>7f08da9e-88c8-4697-a761-28fc35c7222c</serial>
May 27 23:06:50.920905 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:06:50.920905 np0000001565 nova-compute[98289]: </disk>
May 27 23:06:50.920905 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:06:50.928528 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:06:50.929301 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:06:50.934781 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Successfully detached device vdb from instance ad096c70-bfa7-4c5c-88bc-aacf02a9a386 from the persistent domain config.
May 27 23:06:50.935019 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] (1/8): Attempting to detach device vdb with device alias ua-7f08da9e-88c8-4697-a761-28fc35c7222c from instance ad096c70-bfa7-4c5c-88bc-aacf02a9a386 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:06:50.935293 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:06:50.935293 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:50.935293 np0000001565 nova-compute[98289]:   <alias name="ua-7f08da9e-88c8-4697-a761-28fc35c7222c"/>
May 27 23:06:50.935293 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-9"/>
May 27 23:06:50.935293 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:06:50.935293 np0000001565 nova-compute[98289]:   <serial>7f08da9e-88c8-4697-a761-28fc35c7222c</serial>
May 27 23:06:50.935293 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:06:50.935293 np0000001565 nova-compute[98289]: </disk>
May 27 23:06:50.935293 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:50.943556 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:50.943556 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:50.951601 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:50.954747 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:50.954747 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:50.965424 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:50.976666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:50.984002 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:06:50.984239 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.770s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:50.985377 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.387s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:50.986341 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:06:50.994313 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:50.997238 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:50.997238 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:50.997238 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:50.997238 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:50.997238 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:50.997238 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:50.997238 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:50.997238 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:50.997238 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:50.998068 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:50.998068 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:50.998068 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:50.998068 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:50.998068 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:50.998068 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:50.998068 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:50.998068 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:50.998068 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.008222 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:51.035785 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579, portal: 192.168.50.100,3260]
May 27 23:06:51.035785 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579, portal: 192.168.50.100,3260] successful.
May 27 23:06:51.035785 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:51.050625 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:51.059204 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579, portal: 192.168.40.100,3260]
May 27 23:06:51.059204 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579, portal: 192.168.40.100,3260] successful.
May 27 23:06:51.059204 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:51.073369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:51.074753 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.074753 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.074753 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.074753 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.074753 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.074753 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.074753 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.074753 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.074753 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:51.074753 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:51.074753 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:51.075397 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.075397 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.075397 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.075397 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.075397 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.075397 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.075397 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.075397 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.075397 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:51.075397 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:51.075397 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:51.075924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:51.076117 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:51.078016 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('13', '-', '-', 0) found on session 64 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:51.078675 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:51.123998 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:51.123998 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 64 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:51.123998 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:51.128240 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.128240 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.128240 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.128240 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.128240 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.128240 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.128240 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.128240 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.128240 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:51.128240 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:51.128240 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:51.128445 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.128445 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:51.128445 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.128445 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:51.128445 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.128445 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:51.128445 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.128445 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:51.128445 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:51.128445 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:51.128445 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:51.130289 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.241s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:51.130289 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:51.130289 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('14', '-', '-', 0) found on session 65 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:51.130591 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:51.154841 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 65 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:51.156093 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:51.242374 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923211.2420247, a7839c43-8fd9-4deb-81c9-f128963f09ec => ua-dad32169-263d-43eb-a14f-f0ffa8abca81> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:06:51.244319 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-dad32169-263d-43eb-a14f-f0ffa8abca81 for instance a7839c43-8fd9-4deb-81c9-f128963f09ec {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:06:51.251603 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully detached device vdb from instance a7839c43-8fd9-4deb-81c9-f128963f09ec from the live domain config.
May 27 23:06:51.394675 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:51.397793 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:51.409135 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:51.428954 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:51.515998 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b16f420d-43a9-48e4-842c-d62247dd27e5 req-cead937f-f4c9-4c83-9099-2896ac16efd4 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:51.516197 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b16f420d-43a9-48e4-842c-d62247dd27e5 req-cead937f-f4c9-4c83-9099-2896ac16efd4 service nova] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:51.517123 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b16f420d-43a9-48e4-842c-d62247dd27e5 req-cead937f-f4c9-4c83-9099-2896ac16efd4 service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:51.517252 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b16f420d-43a9-48e4-842c-d62247dd27e5 req-cead937f-f4c9-4c83-9099-2896ac16efd4 service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:51.517397 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b16f420d-43a9-48e4-842c-d62247dd27e5 req-cead937f-f4c9-4c83-9099-2896ac16efd4 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Processing event network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:06:51.634357 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923211.6340313, ad096c70-bfa7-4c5c-88bc-aacf02a9a386 => ua-7f08da9e-88c8-4697-a761-28fc35c7222c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:06:51.635582 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7f08da9e-88c8-4697-a761-28fc35c7222c for instance ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:06:51.637574 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Successfully detached device vdb from instance ad096c70-bfa7-4c5c-88bc-aacf02a9a386 from the live domain config.
May 27 23:06:51.638869 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:06:51.640400 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:51.640400 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:51.654497 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:06:51.655008 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:06:51.818689 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Detected multiple connections on this host for volume: dad32169-263d-43eb-a14f-f0ffa8abca81, skipping target disconnect.
May 27 23:06:51.888745 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:06:51.912671 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923211.912022, a58d20c9-5038-4ea3-842e-406b0253f15b => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:51.912934 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] VM Started (Lifecycle Event)
May 27 23:06:51.914121 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:06:51.918369 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:06:51.921564 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Instance spawned successfully.
May 27 23:06:51.922590 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:06:51.989192 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:51.989406 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:52.157586 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:06:52.337310 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:52.405240 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid a7839c43-8fd9-4deb-81c9-f128963f09ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:52.416726 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:52.418639 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:52.430340 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:52.430479 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:52.430929 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:52.431119 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:52.431421 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:52.431688 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:06:52.494555 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lazy-loading 'flavor' on Instance uuid 225ad6d6-6422-4bab-994c-fcc6c720b0ea {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:52.663690 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.678s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:52.717240 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Deleted allocations for instance 3eb890c1-c528-489f-8109-4b7870bfcf33
May 27 23:06:52.906228 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found WWN 33000000010d38765 for multipath device dm-5 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:06:52.906228 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:52.906450 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.267s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:52.906765 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f08da9e-88c8-4697-a761-28fc35c7222c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:06:52.906960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:06:52.915261 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '33000000010d38765', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '33000000010d38765'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:52.915261 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000010d38765', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '33000000010d38765'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:06:52.919427 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:06:52.919427 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:06:52.919427 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:06:52.920133 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:06:52.920960 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923212.9207377, a58d20c9-5038-4ea3-842e-406b0253f15b => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:52.921162 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] VM Paused (Lifecycle Event)
May 27 23:06:52.938287 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Took 6.99 seconds to spawn the instance on the hypervisor.
May 27 23:06:52.938461 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:52.944092 np0000001565 nova-compute[98289]: WARNING os_brick.encryptors.luks [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 23:06:52.948690 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:52.948690 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:52.948690 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:52.948690 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:52.948690 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:52.948690 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:52.948690 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:52.948690 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:52.948690 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:52.948690 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:52.948690 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c (non-flash)
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:52.949115 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', '65')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:06:52.949115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '58')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:52.951281 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:06:52.951281 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:06:52.951281 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:06:52.952957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c', '59')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:52.953577 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x726e698eb4d0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': '8e6a355e-e4c7-4d32-9a78-9ce892cd35ef', 'attached_at': '', 'detached_at': '', 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'serial': '5779ae85-054b-49e5-83e2-91d2b985c579'} {{(pid=98289) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 23:06:52.954032 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] formatting encrypted volume /dev/dm-5 {{(pid=98289) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 27 23:06:52.955224 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e587f32e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c'): ({'sdq'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:06:52.955436 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Removing multipathed devices sdp, sdq {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:06:52.955649 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Flush multipath device 33000000058f57dee {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:06:52.979643 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:06:52.980413 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:06:52.980413 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:06:52.980588 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.14 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:06:52.999699 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:53.038024 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0006231099996512057 future=<Future at 0x726e387e1160 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:53.038616 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Emitting event <LifecycleEvent: 1779923198.0372825, c6934452-ac0c-4d70-8ab4-c09b80c8829f => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:53.038818 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:53.039109 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] VM Stopped (Lifecycle Event)
May 27 23:06:53.040021 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.6255054129997 future=<Future at 0x726e386cdb20 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:53.040325 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.62518771499981 future=<Future at 0x726e386cdb20 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:53.050439 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:53.093924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Checking to see if SCSI volumes sdp, sdq have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:06:53.094139 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] SCSI volumes sdp, sdq have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:06:53.095278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Checking to see if device paths {'sdp', 'sdq'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:06:53.105856 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Device paths {'sdp', 'sdq'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:06:53.106598 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:06:53.116892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:53.123717 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:06:53.124048 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:06:53.124166 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:06:53.124406 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:06:53.148431 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c, portal: 192.168.40.100,3260]
May 27 23:06:53.148431 np0000001565 nova-compute[98289]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c, portal: 192.168.40.100,3260] successful.
May 27 23:06:53.148431 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:53.168145 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:53.179744 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:53.216621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c, portal: 192.168.50.100,3260]
May 27 23:06:53.216621 np0000001565 nova-compute[98289]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-7f08da9e-88c8-4697-a761-28fc35c7222c, portal: 192.168.50.100,3260] successful.
May 27 23:06:53.216621 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:53.226735 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:53.233916 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:53.234106 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:53.234218 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] <== disconnect_volume: return (1594ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:53.234590 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:06:53.274215 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:53.274459 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:53.415407 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5de0e0d2-9b2c-416b-ad2a-ea69d0cf0463 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.358s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:53.423622 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:53.425578 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923213.4253469, a58d20c9-5038-4ea3-842e-406b0253f15b => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:06:53.425722 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] VM Resumed (Lifecycle Event)
May 27 23:06:53.449951 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Took 12.61 seconds to build instance.
May 27 23:06:53.499187 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:53.543523 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: c6934452-ac0c-4d70-8ab4-c09b80c8829f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:53.566461 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:53.608779 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9f919553-4f23-4a6e-bdc1-6d14db4fe018 req-e382b3b0-1978-4655-9e0f-1f1f00fa4ea1 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:53.608779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f919553-4f23-4a6e-bdc1-6d14db4fe018 req-e382b3b0-1978-4655-9e0f-1f1f00fa4ea1 service nova] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:53.609115 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f919553-4f23-4a6e-bdc1-6d14db4fe018 req-e382b3b0-1978-4655-9e0f-1f1f00fa4ea1 service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:53.609223 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f919553-4f23-4a6e-bdc1-6d14db4fe018 req-e382b3b0-1978-4655-9e0f-1f1f00fa4ea1 service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:53.609456 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9f919553-4f23-4a6e-bdc1-6d14db4fe018 req-e382b3b0-1978-4655-9e0f-1f1f00fa4ea1 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] No waiting events found dispatching network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:53.609520 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9f919553-4f23-4a6e-bdc1-6d14db4fe018 req-e382b3b0-1978-4655-9e0f-1f1f00fa4ea1 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received unexpected event network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 for instance with vm_state active and task_state None.
May 27 23:06:53.726700 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6645d021-24db-480e-b969-4d8c96f1703c tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Lock "3eb890c1-c528-489f-8109-4b7870bfcf33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.026s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:53.776786 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Detaching volume dad32169-263d-43eb-a14f-f0ffa8abca81
May 27 23:06:53.796341 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'flavor' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:53.837204 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Attempting to driver detach volume dad32169-263d-43eb-a14f-f0ffa8abca81 from mountpoint /dev/vdb
May 27 23:06:53.841637 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found disk vdb by alias ua-dad32169-263d-43eb-a14f-f0ffa8abca81 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:06:53.843205 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found disk vdb by alias ua-dad32169-263d-43eb-a14f-f0ffa8abca81 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:06:53.843404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Attempting to detach device vdb from instance a6723b2d-e0b1-495c-910d-3ef37d877c05 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:06:53.843707 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:06:53.843707 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:53.843707 np0000001565 nova-compute[98289]:   <alias name="ua-dad32169-263d-43eb-a14f-f0ffa8abca81"/>
May 27 23:06:53.843707 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:06:53.843707 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:06:53.843707 np0000001565 nova-compute[98289]:   <serial>dad32169-263d-43eb-a14f-f0ffa8abca81</serial>
May 27 23:06:53.843707 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:06:53.843707 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:06:53.843707 np0000001565 nova-compute[98289]: </disk>
May 27 23:06:53.843707 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:06:53.851886 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully detached device vdb from instance a6723b2d-e0b1-495c-910d-3ef37d877c05 from the persistent domain config.
May 27 23:06:53.852103 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] (1/8): Attempting to detach device vdb with device alias ua-dad32169-263d-43eb-a14f-f0ffa8abca81 from instance a6723b2d-e0b1-495c-910d-3ef37d877c05 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:06:53.852398 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:06:53.852398 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:53.852398 np0000001565 nova-compute[98289]:   <alias name="ua-dad32169-263d-43eb-a14f-f0ffa8abca81"/>
May 27 23:06:53.852398 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:06:53.852398 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:06:53.852398 np0000001565 nova-compute[98289]:   <serial>dad32169-263d-43eb-a14f-f0ffa8abca81</serial>
May 27 23:06:53.852398 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:06:53.852398 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:06:53.852398 np0000001565 nova-compute[98289]: </disk>
May 27 23:06:53.852398 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:06:53.928262 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:06:53.935630 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:06:53.951171 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c4a65184-7f05-43df-af80-03130e1996db tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.118s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:54.124847 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:06:54.125437 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:06:54.656863 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:54.657384 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:54.657384 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Attaching volume 06e37541-492e-4a23-8cab-1e7eba1867de to /dev/vdc
May 27 23:06:54.714184 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:54.729388 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:06:54.754120 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:06:54.804604 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4dc3d06-352a-432b-a189-23b5e47de96d tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.475s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:54.808224 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:06:54.808928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:06:54.822319 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:06:54.829260 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:fe94:b6ed', 'fe80::906a:e4ff:fe34:5279', 'fe80::fc16:3eff:fe7f:446c', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fe4e:c582', 'fe80::d07f:66ff:fe00:6bf4', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fefc:4f23', 'fe80::f886:b6ff:fe99:9ebe'] 
May 27 23:06:54.831643 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:06:54.831850 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:06:54.832980 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:54.832980 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Updating existing volume attachment record: b14ec245-6012-4553-b365-a0bd5efbbf04 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:06:54.853630 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-30aecaad-83b3-4381-a480-949cd8e16232 req-6fe3888b-33d0-4e3d-bec8-de31dc83ccac service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-changed-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:54.854396 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-30aecaad-83b3-4381-a480-949cd8e16232 req-6fe3888b-33d0-4e3d-bec8-de31dc83ccac service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Refreshing instance network info cache due to event network-changed-fcd4468c-2b77-4da0-a875-6375149e0a09. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:06:54.854745 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-30aecaad-83b3-4381-a480-949cd8e16232 req-6fe3888b-33d0-4e3d-bec8-de31dc83ccac service nova] Acquiring lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:06:54.854976 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-30aecaad-83b3-4381-a480-949cd8e16232 req-6fe3888b-33d0-4e3d-bec8-de31dc83ccac service nova] Acquired lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:06:54.855162 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-30aecaad-83b3-4381-a480-949cd8e16232 req-6fe3888b-33d0-4e3d-bec8-de31dc83ccac service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Refreshing network info cache for port fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:06:54.967360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:55.357722 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-30aecaad-83b3-4381-a480-949cd8e16232 req-6fe3888b-33d0-4e3d-bec8-de31dc83ccac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:55.411602 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:06:55.412022 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06e37541-492e-4a23-8cab-1e7eba1867de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:55.412174 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:55.412645 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:55.412863 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06e37541-492e-4a23-8cab-1e7eba1867de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:06:55.427780 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:55.431256 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:55.432070 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:55.433219 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:06:55.433578 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:55.433871 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:06:55.447588 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:06:55.447588 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:55.452685 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:06:55.452685 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:55.466804 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de] added
May 27 23:06:55.466804 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:06:55.466804 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:55.466804 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:55.466804 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:55.466804 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:55.466804 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:55.468469 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:06:55.468469 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0348(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:06:55.468469 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:06:55.471442 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de] added
May 27 23:06:55.471442 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:06:55.471442 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:55.471442 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:55.471442 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:06:55.471442 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:06:55.471442 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:55.471632 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:06:55.471731 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:06:55.471877 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:06:55.775956 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-30aecaad-83b3-4381-a480-949cd8e16232 req-6fe3888b-33d0-4e3d-bec8-de31dc83ccac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:55.981028 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-30aecaad-83b3-4381-a480-949cd8e16232 req-6fe3888b-33d0-4e3d-bec8-de31dc83ccac service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updated VIF entry in instance network info cache for port fcd4468c-2b77-4da0-a875-6375149e0a09. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:06:55.981198 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-30aecaad-83b3-4381-a480-949cd8e16232 req-6fe3888b-33d0-4e3d-bec8-de31dc83ccac service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updating instance_info_cache with network_info: [{"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:55.983236 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:56.124749 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:06:56.125559 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:06:56.265865 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:56.266155 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:56.269745 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:56.270018 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:56.270226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:56.277616 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Terminating instance
May 27 23:06:56.467877 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:06:56.473219 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:56.481037 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:56.481037 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:56.486354 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-30aecaad-83b3-4381-a480-949cd8e16232 req-6fe3888b-33d0-4e3d-bec8-de31dc83ccac service nova] Releasing lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:06:56.488237 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:06:56.488237 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:56.495244 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:56.501606 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:56.511909 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.511909 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.511909 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.511909 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.511909 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.511909 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.511909 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.511909 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.511909 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:56.512232 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.512232 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.512232 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.512232 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.512232 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.512232 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.512232 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.512232 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.512232 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:56.522735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.522735 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.522735 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.522735 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.522735 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.522735 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.522735 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.522735 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.522735 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:56.523363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.523363 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.523363 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.523363 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.523363 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.523363 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.523363 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.523363 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.523363 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:56.559487 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de, portal: 192.168.40.100,3260]
May 27 23:06:56.559487 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de, portal: 192.168.40.100,3260] successful.
May 27 23:06:56.559487 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:56.571363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de, portal: 192.168.50.100,3260]
May 27 23:06:56.571363 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de, portal: 192.168.50.100,3260] successful.
May 27 23:06:56.571363 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:56.577634 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:56.585419 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:56.596270 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.596270 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.596270 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.596270 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.596270 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.596270 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.596270 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.596270 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.596270 np0000001565 nova-compute[98289]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:56.596270 np0000001565 nova-compute[98289]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:56.596270 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:56.596574 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.596574 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.596574 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.596574 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.596574 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.596574 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.596574 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.596574 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.596574 np0000001565 nova-compute[98289]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:56.596574 np0000001565 nova-compute[98289]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:56.596574 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:56.596945 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:56.597027 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:56.598745 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] HCTL ('15', '-', '-', 0) found on session 66 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:56.598745 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:56.610619 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.610619 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.610619 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.610619 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.610619 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.610619 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.610619 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.610619 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.610619 np0000001565 nova-compute[98289]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:56.610619 np0000001565 nova-compute[98289]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:56.610619 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:56.611782 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.611782 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:56.611782 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.611782 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:56.611782 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.611782 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:56.611782 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.611782 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:56.611782 np0000001565 nova-compute[98289]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:56.611782 np0000001565 nova-compute[98289]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:56.611782 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:56.612197 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:56.612281 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:06:56.613722 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] HCTL ('16', '-', '-', 0) found on session 67 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:06:56.613828 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:06:56.642008 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Searching for a device in session 66 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:56.642008 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06e37541-492e-4a23-8cab-1e7eba1867de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:56.642219 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Searching for a device in session 67 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:06:56.642843 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '06e37541-492e-4a23-8cab-1e7eba1867de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:06:56.783443 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:06:56.816633 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:56.841419 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:56.849363 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:56.881705 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:56.883002 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:57.001227 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b37df00c-f377-4b21-b463-a7f910488d11 req-aff04598-4ee3-42f9-9798-b1d0528adc0a service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:57.002232 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b37df00c-f377-4b21-b463-a7f910488d11 req-aff04598-4ee3-42f9-9798-b1d0528adc0a service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:57.002596 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b37df00c-f377-4b21-b463-a7f910488d11 req-aff04598-4ee3-42f9-9798-b1d0528adc0a service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:57.002767 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b37df00c-f377-4b21-b463-a7f910488d11 req-aff04598-4ee3-42f9-9798-b1d0528adc0a service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:57.003006 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b37df00c-f377-4b21-b463-a7f910488d11 req-aff04598-4ee3-42f9-9798-b1d0528adc0a service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] No waiting events found dispatching network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:57.003258 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b37df00c-f377-4b21-b463-a7f910488d11 req-aff04598-4ee3-42f9-9798-b1d0528adc0a service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:57.009096 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 23:06:57.009096 np0000001565 nova-compute[98289]:   <usage type="volume">
May 27 23:06:57.009096 np0000001565 nova-compute[98289]:     <volume>5779ae85-054b-49e5-83e2-91d2b985c579</volume>
May 27 23:06:57.009096 np0000001565 nova-compute[98289]:   </usage>
May 27 23:06:57.009096 np0000001565 nova-compute[98289]: </secret>
May 27 23:06:57.009096 np0000001565 nova-compute[98289]:  {{(pid=98289) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 23:06:57.029689 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:57.132728 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99965092399998 future=<Future at 0x726e602d0f50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:06:57.139564 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Instance destroyed successfully.
May 27 23:06:57.139975 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lazy-loading 'resources' on Instance uuid ad096c70-bfa7-4c5c-88bc-aacf02a9a386 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:57.357252 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923217.356809, a6723b2d-e0b1-495c-910d-3ef37d877c05 => ua-dad32169-263d-43eb-a14f-f0ffa8abca81> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:06:57.357611 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-dad32169-263d-43eb-a14f-f0ffa8abca81 for instance a6723b2d-e0b1-495c-910d-3ef37d877c05 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:06:57.363960 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully detached device vdb from instance a6723b2d-e0b1-495c-910d-3ef37d877c05 from the live domain config.
May 27 23:06:57.406603 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:06:57.406933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:06:57.407115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:06:57.431776 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:06:57.532951 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Attempting to attach volume 5779ae85-054b-49e5-83e2-91d2b985c579 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:06:57.534143 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:06:57.534143 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:57.534143 np0000001565 nova-compute[98289]:   <alias name="ua-5779ae85-054b-49e5-83e2-91d2b985c579"/>
May 27 23:06:57.534143 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 27 23:06:57.534143 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:06:57.534143 np0000001565 nova-compute[98289]:   <serial>5779ae85-054b-49e5-83e2-91d2b985c579</serial>
May 27 23:06:57.534143 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:06:57.534143 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="646438e6-22b1-41b5-991b-58f8f61a6f47"/>
May 27 23:06:57.534143 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:06:57.534143 np0000001565 nova-compute[98289]: </disk>
May 27 23:06:57.534143 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:06:57.642487 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:04:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1943859222',display_name='tempest-ServerStableDeviceRescueTest-server-1943859222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serverstabledevicerescuetest-server-1943859222',id=29,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4U9ViTrCULeRb7mQ/X1fO1QgXgc1LqIgnb6WCOaeMGhLLzqC0QHpKJ1Bbctl4NVcIQtYWdUqUMmwvYfkC1eR3iPLLrQTNmpQGvAlfRR6KOUaB1y+iwgjbjpPeOqqREDQ==',key_name='tempest-keypair-1511877382',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:06:11Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a9dde83267d415abbd137e795ac45e9',ramdisk_id='',reservation_id='r-ereta0ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1802307985',owner_user_name='tempest-ServerStableDeviceRescueTest-1802307985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:06:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='079fa79ceda94eba85570c510d7e8b24',uuid=ad096c70-bfa7-4c5c-88bc-aacf02a9a386,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:06:57.642726 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Converting VIF {"id": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "address": "fa:16:3e:4e:c5:82", "network": {"id": "72b5d6af-fd17-4011-9ac7-d7d70cf9f85f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-49419580-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0a9dde83267d415abbd137e795ac45e9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa298890f-00", "ovs_interfaceid": "a298890f-00ec-4f5b-9f68-df34a845fd8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:06:57.643593 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:c5:82,bridge_name='br-int',has_traffic_filtering=True,id=a298890f-00ec-4f5b-9f68-df34a845fd8f,network=Network(72b5d6af-fd17-4011-9ac7-d7d70cf9f85f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa298890f-00') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:06:57.643971 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:c5:82,bridge_name='br-int',has_traffic_filtering=True,id=a298890f-00ec-4f5b-9f68-df34a845fd8f,network=Network(72b5d6af-fd17-4011-9ac7-d7d70cf9f85f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa298890f-00') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:06:57.645398 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:57.645664 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa298890f-00, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:57.648465 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:57.649142 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:57.649317 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d22cc19d-362e-4648-951f-ea7a4b8b7f5d) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:06:57.650006 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:57.650960 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:06:57.651179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:57.653269 np0000001565 nova-compute[98289]: INFO os_vif [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:c5:82,bridge_name='br-int',has_traffic_filtering=True,id=a298890f-00ec-4f5b-9f68-df34a845fd8f,network=Network(72b5d6af-fd17-4011-9ac7-d7d70cf9f85f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa298890f-00')
May 27 23:06:57.653669 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Deleting instance files /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386_del
May 27 23:06:57.654411 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Deletion of /opt/stack/data/nova/instances/ad096c70-bfa7-4c5c-88bc-aacf02a9a386_del complete
May 27 23:06:58.160454 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 23:06:58.161490 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:06:58.161716 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:06:58.161776 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:06:58.162089 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:58.281710 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:06:58.451157 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Found WWN 3300000000c0920c8 for multipath device dm-6 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:06:58.451157 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:58.452127 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000000c0920c8', 'path': '/dev/dm-6', 'multipath_id': '3300000000c0920c8'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:58.452127 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000c0920c8', 'path': '/dev/dm-6', 'multipath_id': '3300000000c0920c8'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:06:58.452127 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.045s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:06:58.452127 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dad32169-263d-43eb-a14f-f0ffa8abca81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:06:58.452363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:06:58.460663 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lazy-loading 'flavor' on Instance uuid 225ad6d6-6422-4bab-994c-fcc6c720b0ea {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:58.495121 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:58.495121 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:58.495121 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:58.495121 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:58.495121 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:58.495121 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:58.495121 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:58.495121 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:58.495121 np0000001565 nova-compute[98289]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:58.495121 np0000001565 nova-compute[98289]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:58.495121 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:06:58.495401 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:58.495401 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:06:58.495401 np0000001565 nova-compute[98289]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:58.495401 np0000001565 nova-compute[98289]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81 (non-flash)
May 27 23:06:58.495401 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:58.495401 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:06:58.495401 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:58.495401 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:06:58.495401 np0000001565 nova-compute[98289]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:58.495401 np0000001565 nova-compute[98289]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:06:58.495401 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:06:58.495567 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', '67')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:06:58.495567 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '45')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:58.496588 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81', '44')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:06:58.497470 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58136700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'): ({'sdb'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:06:58.497702 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:06:58.497930 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flush multipath device 3300000004f18c080 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:06:58.539473 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:58.567889 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:06:58.583185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:06:58.641706 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:06:58.641706 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:06:58.643093 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:06:58.658975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:06:58.658975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:06:58.673016 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:58.713944 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81, portal: 192.168.40.100,3260]
May 27 23:06:58.713944 np0000001565 nova-compute[98289]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81, portal: 192.168.40.100,3260] successful.
May 27 23:06:58.713944 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:58.730670 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:58.741644 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:58.779494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81, portal: 192.168.50.100,3260]
May 27 23:06:58.779494 np0000001565 nova-compute[98289]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-dad32169-263d-43eb-a14f-f0ffa8abca81, portal: 192.168.50.100,3260] successful.
May 27 23:06:58.779494 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:58.801480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:06:58.801732 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:06:58.801873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== disconnect_volume: return (1395ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:06:58.801995 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:06:58.960770 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Attempting to attach volume 06e37541-492e-4a23-8cab-1e7eba1867de with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:06:58.962028 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:06:58.962028 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:06:58.962028 np0000001565 nova-compute[98289]:   <alias name="ua-06e37541-492e-4a23-8cab-1e7eba1867de"/>
May 27 23:06:58.962028 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-6"/>
May 27 23:06:58.962028 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:06:58.962028 np0000001565 nova-compute[98289]:   <serial>06e37541-492e-4a23-8cab-1e7eba1867de</serial>
May 27 23:06:58.962028 np0000001565 nova-compute[98289]: </disk>
May 27 23:06:58.962028 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:06:59.057884 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6cfc11bf-5b5e-4ef7-9e5b-ad58fa8bb352 req-e304ca25-633f-4141-8912-dbf1ea8320ec service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:59.058620 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6cfc11bf-5b5e-4ef7-9e5b-ad58fa8bb352 req-e304ca25-633f-4141-8912-dbf1ea8320ec service nova] Acquiring lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:59.059114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6cfc11bf-5b5e-4ef7-9e5b-ad58fa8bb352 req-e304ca25-633f-4141-8912-dbf1ea8320ec service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:59.059287 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6cfc11bf-5b5e-4ef7-9e5b-ad58fa8bb352 req-e304ca25-633f-4141-8912-dbf1ea8320ec service nova] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:06:59.059478 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6cfc11bf-5b5e-4ef7-9e5b-ad58fa8bb352 req-e304ca25-633f-4141-8912-dbf1ea8320ec service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] No waiting events found dispatching network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:06:59.059935 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6cfc11bf-5b5e-4ef7-9e5b-ad58fa8bb352 req-e304ca25-633f-4141-8912-dbf1ea8320ec service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-unplugged-a298890f-00ec-4f5b-9f68-df34a845fd8f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:06:59.060111 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6cfc11bf-5b5e-4ef7-9e5b-ad58fa8bb352 req-e304ca25-633f-4141-8912-dbf1ea8320ec service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Received event network-vif-deleted-a298890f-00ec-4f5b-9f68-df34a845fd8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:06:59.060273 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-6cfc11bf-5b5e-4ef7-9e5b-ad58fa8bb352 req-e304ca25-633f-4141-8912-dbf1ea8320ec service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Neutron deleted interface a298890f-00ec-4f5b-9f68-df34a845fd8f; detaching it from the instance and deleting it from the info cache
May 27 23:06:59.062907 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6cfc11bf-5b5e-4ef7-9e5b-ad58fa8bb352 req-e304ca25-633f-4141-8912-dbf1ea8320ec service nova] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Detach interface failed, port_id=a298890f-00ec-4f5b-9f68-df34a845fd8f, reason: Instance ad096c70-bfa7-4c5c-88bc-aacf02a9a386 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:06:59.201955 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:06:59.350724 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'flavor' on Instance uuid a6723b2d-e0b1-495c-910d-3ef37d877c05 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:06:59.704500 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Took 1.54 seconds to deallocate network for instance.
May 27 23:06:59.838167 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:06:59.838347 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:06:59.973457 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:59.973638 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:59.973761 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:06:59.973868 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No VIF found with MAC fa:16:3e:7f:44:6c, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:07:00.211848 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:00.212269 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:00.340132 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:07:00.355576 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3b450d9e-bc65-4d73-a703-9909ac1f449e tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.081s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:00.608312 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:00.608509 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:00.608576 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:00.608642 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:00.608743 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] No VIF found with MAC fa:16:3e:94:b6:ed, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:07:00.754043 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:00.754443 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:00.892205 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:01.257052 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:01.550344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4bd27a6c-dc2f-4168-afcc-914441e3d92f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.400s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:01.764434 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.552s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:01.766605 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.874s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:01.771918 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:07:01.772096 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Claim successful on node np0000001565
May 27 23:07:01.862676 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Deleted allocations for instance ad096c70-bfa7-4c5c-88bc-aacf02a9a386
May 27 23:07:02.160360 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8b1cabb8-69bf-468e-9c41-cc50864a5cc1 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.503s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:02.284888 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:02.285248 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:02.552887 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:02.553128 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:02.668772 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00048093700024764985 future=<Future at 0x726e386cdb20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:02.668772 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Emitting event <LifecycleEvent: 1779923207.6654065, 3eb890c1-c528-489f-8109-4b7870bfcf33 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:02.668772 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:02.668772 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] VM Stopped (Lifecycle Event)
May 27 23:07:02.668772 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.464133052000307 future=<Future at 0x726e602d0f50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:02.668772 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.463941932000125 future=<Future at 0x726e602d0f50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:02.670245 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:02.789040 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Detaching volume 5779ae85-054b-49e5-83e2-91d2b985c579
May 27 23:07:02.839780 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Attempting to driver detach volume 5779ae85-054b-49e5-83e2-91d2b985c579 from mountpoint /dev/vdb
May 27 23:07:02.870998 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1cd740ef-763a-49d3-b5ed-1829df3f7c11 tempest-ServerStableDeviceRescueTest-1802307985 tempest-ServerStableDeviceRescueTest-1802307985-project-member] Lock "ad096c70-bfa7-4c5c-88bc-aacf02a9a386" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.605s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:02.873570 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': '8e6a355e-e4c7-4d32-9a78-9ce892cd35ef', 'attached_at': '', 'detached_at': '', 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'serial': '5779ae85-054b-49e5-83e2-91d2b985c579'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:07:02.877641 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found disk vdb by alias ua-5779ae85-054b-49e5-83e2-91d2b985c579 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:07:02.878966 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found disk vdb by alias ua-5779ae85-054b-49e5-83e2-91d2b985c579 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:07:02.879130 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Attempting to detach device vdb from instance 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:07:02.879449 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:07:02.879449 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:07:02.879449 np0000001565 nova-compute[98289]:   <alias name="ua-5779ae85-054b-49e5-83e2-91d2b985c579"/>
May 27 23:07:02.879449 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 27 23:07:02.879449 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:07:02.879449 np0000001565 nova-compute[98289]:   <serial>5779ae85-054b-49e5-83e2-91d2b985c579</serial>
May 27 23:07:02.879449 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:07:02.879449 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:07:02.879449 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="646438e6-22b1-41b5-991b-58f8f61a6f47"/>
May 27 23:07:02.879449 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:07:02.879449 np0000001565 nova-compute[98289]: </disk>
May 27 23:07:02.879449 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:07:02.889180 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully detached device vdb from instance 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef from the persistent domain config.
May 27 23:07:02.889368 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] (1/8): Attempting to detach device vdb with device alias ua-5779ae85-054b-49e5-83e2-91d2b985c579 from instance 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:07:02.889743 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:07:02.889743 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:07:02.889743 np0000001565 nova-compute[98289]:   <alias name="ua-5779ae85-054b-49e5-83e2-91d2b985c579"/>
May 27 23:07:02.889743 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 27 23:07:02.889743 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:07:02.889743 np0000001565 nova-compute[98289]:   <serial>5779ae85-054b-49e5-83e2-91d2b985c579</serial>
May 27 23:07:02.889743 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:07:02.889743 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:07:02.889743 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="646438e6-22b1-41b5-991b-58f8f61a6f47"/>
May 27 23:07:02.889743 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:07:02.889743 np0000001565 nova-compute[98289]: </disk>
May 27 23:07:02.889743 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:07:03.056192 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Detaching volume 06e37541-492e-4a23-8cab-1e7eba1867de
May 27 23:07:03.105807 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "225950be-cc72-44aa-8ec2-54a94cb5efdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:03.107827 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Attempting to driver detach volume 06e37541-492e-4a23-8cab-1e7eba1867de from mountpoint /dev/vdc
May 27 23:07:03.108440 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:03.116536 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Found disk vdc by alias ua-06e37541-492e-4a23-8cab-1e7eba1867de {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:07:03.118836 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Found disk vdc by alias ua-06e37541-492e-4a23-8cab-1e7eba1867de {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:07:03.119028 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Attempting to detach device vdc from instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:07:03.119292 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:07:03.119292 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:07:03.119292 np0000001565 nova-compute[98289]:   <alias name="ua-06e37541-492e-4a23-8cab-1e7eba1867de"/>
May 27 23:07:03.119292 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-6"/>
May 27 23:07:03.119292 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:07:03.119292 np0000001565 nova-compute[98289]:   <serial>06e37541-492e-4a23-8cab-1e7eba1867de</serial>
May 27 23:07:03.119292 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 23:07:03.119292 np0000001565 nova-compute[98289]: </disk>
May 27 23:07:03.119292 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:07:03.128878 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Successfully detached device vdc from instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea from the persistent domain config.
May 27 23:07:03.129375 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] (1/8): Attempting to detach device vdc with device alias ua-06e37541-492e-4a23-8cab-1e7eba1867de from instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:07:03.129470 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:07:03.129470 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:07:03.129470 np0000001565 nova-compute[98289]:   <alias name="ua-06e37541-492e-4a23-8cab-1e7eba1867de"/>
May 27 23:07:03.129470 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-6"/>
May 27 23:07:03.129470 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:07:03.129470 np0000001565 nova-compute[98289]:   <serial>06e37541-492e-4a23-8cab-1e7eba1867de</serial>
May 27 23:07:03.129470 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 23:07:03.129470 np0000001565 nova-compute[98289]: </disk>
May 27 23:07:03.129470 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:07:03.170745 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-037c3aab-26f5-4675-9dd4-f1e0c4bb173b tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 3eb890c1-c528-489f-8109-4b7870bfcf33] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:03.363621 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:03.364064 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:03.464543 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923223.4641225, 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef => ua-5779ae85-054b-49e5-83e2-91d2b985c579> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:07:03.465718 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5779ae85-054b-49e5-83e2-91d2b985c579 for instance 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:07:03.467560 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully detached device vdb from instance 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef from the live domain config.
May 27 23:07:03.469523 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:07:03.469792 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:03.469947 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:03.470278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:03.470598 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5779ae85-054b-49e5-83e2-91d2b985c579', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:07:03.470759 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:07:03.496031 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:03.496031 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:03.496031 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:03.496031 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:03.496031 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:07:03.496031 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:07:03.496031 np0000001565 nova-compute[98289]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:07:03.496031 np0000001565 nova-compute[98289]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:07:03.496031 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:03.496299 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:03.496299 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:03.496299 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:03.496299 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:03.496299 np0000001565 nova-compute[98289]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:07:03.496299 np0000001565 nova-compute[98289]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579 (non-flash)
May 27 23:07:03.496299 np0000001565 nova-compute[98289]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:07:03.496299 np0000001565 nova-compute[98289]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:07:03.496299 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:03.496299 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', '67')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:07:03.496553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', '65')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:03.497240 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579', '64')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:03.498043 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58134400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579'): ({'sdh'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:07:03.498254 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Removing multipathed devices sdi, sdh {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:07:03.498494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flush multipath device 33000000010d38765 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:07:03.535950 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:07:03.570480 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:03.572349 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:07:03.613075 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:07:03.620690 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:07:03.622735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:07:03.623717 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:07:03.628949 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923223.628601, 225ad6d6-6422-4bab-994c-fcc6c720b0ea => ua-06e37541-492e-4a23-8cab-1e7eba1867de> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:07:03.631773 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-06e37541-492e-4a23-8cab-1e7eba1867de for instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:07:03.634145 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Successfully detached device vdc from instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea from the live domain config.
May 27 23:07:03.635087 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:07:03.635341 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06e37541-492e-4a23-8cab-1e7eba1867de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:03.635482 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:03.637439 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:07:03.637604 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:07:03.649526 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:03.676108 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579, portal: 192.168.40.100,3260]
May 27 23:07:03.676108 np0000001565 nova-compute[98289]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579, portal: 192.168.40.100,3260] successful.
May 27 23:07:03.676108 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:03.695220 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:03.705951 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:03.738065 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579, portal: 192.168.50.100,3260]
May 27 23:07:03.738065 np0000001565 nova-compute[98289]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-5779ae85-054b-49e5-83e2-91d2b985c579, portal: 192.168.50.100,3260] successful.
May 27 23:07:03.738065 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:03.755633 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:03.759147 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:03.759267 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== disconnect_volume: return (289ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:03.759421 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:07:03.761074 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.125s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:03.761518 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06e37541-492e-4a23-8cab-1e7eba1867de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:07:03.761702 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:07:03.788199 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:03.788199 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:03.788199 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:03.788199 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:03.788199 np0000001565 nova-compute[98289]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:07:03.788199 np0000001565 nova-compute[98289]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:07:03.788199 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:03.788382 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:03.788382 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:03.788382 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:03.788382 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:03.788382 np0000001565 nova-compute[98289]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:07:03.788382 np0000001565 nova-compute[98289]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de (non-flash)
May 27 23:07:03.788382 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:03.788528 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', '67')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:07:03.788585 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', '66')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:03.789288 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de', '67')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:03.790602 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3879c2c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de'): ({'sdk'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:07:03.790772 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Removing multipathed devices sdj, sdk {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:07:03.790984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Flush multipath device 3300000000c0920c8 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:07:03.831892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:07:03.869924 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:03.878480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:07:03.920561 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:07:03.920702 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:07:03.921617 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:07:03.931441 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:07:03.931598 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:07:03.941572 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:03.970046 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de, portal: 192.168.40.100,3260]
May 27 23:07:03.970046 np0000001565 nova-compute[98289]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de, portal: 192.168.40.100,3260] successful.
May 27 23:07:03.970046 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:03.985024 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:03.995006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:04.022140 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de, portal: 192.168.50.100,3260]
May 27 23:07:04.022140 np0000001565 nova-compute[98289]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-06e37541-492e-4a23-8cab-1e7eba1867de, portal: 192.168.50.100,3260] successful.
May 27 23:07:04.022140 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:04.035616 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:04.035799 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:04.035908 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] <== disconnect_volume: return (400ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:04.036031 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:07:04.161381 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:04.309187 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:04.380469 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.614s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:04.381248 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.220s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:04.381503 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:07:04.387742 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:07:04.387901 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Claim successful on node np0000001565
May 27 23:07:04.595756 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lazy-loading 'flavor' on Instance uuid 225ad6d6-6422-4bab-994c-fcc6c720b0ea {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:04.888978 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:07:04.889218 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:07:04.890518 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:04.890782 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:04.982986 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4451943f43444436bf50809c8ab7f0d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '932825702de943b48bbcada3b5763dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:07:05.315409 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-38f632cb-2413-4643-bd32-b5cc50adca19 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.030s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:05.383638 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Successfully created port: 61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:07:05.402812 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:07:05.584439 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:05.586043 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:05.586043 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:05.586043 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:05.586043 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:05.587568 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Terminating instance
May 27 23:07:05.601821 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f61e9a1a-f91f-4855-8647-5444e1f7aff5 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.049s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:05.907358 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Successfully updated port: 61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:07:05.909473 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:07:05.950109 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:05.950311 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:05.956618 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:05.956855 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:05.980979 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8feab173-f8c5-41af-ae27-352eabda229c req-6cd8917e-67a4-4314-9f25-4da92cc84f05 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-changed-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:05.981486 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8feab173-f8c5-41af-ae27-352eabda229c req-6cd8917e-67a4-4314-9f25-4da92cc84f05 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Refreshing instance network info cache due to event network-changed-61237f5f-3261-4c4e-83c3-7f4a5db90b8f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:07:05.981662 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8feab173-f8c5-41af-ae27-352eabda229c req-6cd8917e-67a4-4314-9f25-4da92cc84f05 service nova] Acquiring lock "refresh_cache-77ce6750-3568-4e9b-b99e-c1a7964536d0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:05.981768 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8feab173-f8c5-41af-ae27-352eabda229c req-6cd8917e-67a4-4314-9f25-4da92cc84f05 service nova] Acquired lock "refresh_cache-77ce6750-3568-4e9b-b99e-c1a7964536d0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:05.982483 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8feab173-f8c5-41af-ae27-352eabda229c req-6cd8917e-67a4-4314-9f25-4da92cc84f05 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Refreshing network info cache for port 61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:07:06.089726 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:07:06.115340 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.130518 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.145613 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.221397 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.238958 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.259979 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.277922 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bdee9201-ec1f-4092-92e5-a4c79d3fd0a0 req-3206fae8-c31d-4785-99e6-2382478b8ced service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Received event network-vif-unplugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:06.278171 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bdee9201-ec1f-4092-92e5-a4c79d3fd0a0 req-3206fae8-c31d-4785-99e6-2382478b8ced service nova] Acquiring lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:06.278353 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bdee9201-ec1f-4092-92e5-a4c79d3fd0a0 req-3206fae8-c31d-4785-99e6-2382478b8ced service nova] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:06.278476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bdee9201-ec1f-4092-92e5-a4c79d3fd0a0 req-3206fae8-c31d-4785-99e6-2382478b8ced service nova] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:06.278655 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bdee9201-ec1f-4092-92e5-a4c79d3fd0a0 req-3206fae8-c31d-4785-99e6-2382478b8ced service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] No waiting events found dispatching network-vif-unplugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:06.278702 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bdee9201-ec1f-4092-92e5-a4c79d3fd0a0 req-3206fae8-c31d-4785-99e6-2382478b8ced service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Received event network-vif-unplugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:07:06.279097 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.411523 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.416373 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Booting with volume f0db4932-f904-4a76-b63e-0c23a6cb2dc2 at /dev/vda
May 27 23:07:06.419874 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "refresh_cache-77ce6750-3568-4e9b-b99e-c1a7964536d0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:06.420700 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.443874 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999740602999736 future=<Future at 0x726e5817d8b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:06.448873 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Instance destroyed successfully.
May 27 23:07:06.449380 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'resources' on Instance uuid 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:06.458998 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:06.464853 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Detaching volume 05af6240-1c63-435e-9fb4-b10b8dc50b3b
May 27 23:07:06.473582 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:06.486179 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8feab173-f8c5-41af-ae27-352eabda229c req-6cd8917e-67a4-4314-9f25-4da92cc84f05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:06.494563 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:07:06.521550 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:06.542194 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Attempting to driver detach volume 05af6240-1c63-435e-9fb4-b10b8dc50b3b from mountpoint /dev/vdb
May 27 23:07:06.556813 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Found disk vdb by alias ua-05af6240-1c63-435e-9fb4-b10b8dc50b3b {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:07:06.558041 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Found disk vdb by alias ua-05af6240-1c63-435e-9fb4-b10b8dc50b3b {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:07:06.558180 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Attempting to detach device vdb from instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:07:06.558528 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:07:06.558528 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:07:06.558528 np0000001565 nova-compute[98289]:   <alias name="ua-05af6240-1c63-435e-9fb4-b10b8dc50b3b"/>
May 27 23:07:06.558528 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-4"/>
May 27 23:07:06.558528 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:07:06.558528 np0000001565 nova-compute[98289]:   <serial>05af6240-1c63-435e-9fb4-b10b8dc50b3b</serial>
May 27 23:07:06.558528 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:07:06.558528 np0000001565 nova-compute[98289]: </disk>
May 27 23:07:06.558528 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:07:06.567048 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:07:06.567383 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:07:06.568503 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Successfully detached device vdb from instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea from the persistent domain config.
May 27 23:07:06.568660 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] (1/8): Attempting to detach device vdb with device alias ua-05af6240-1c63-435e-9fb4-b10b8dc50b3b from instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:07:06.568918 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:07:06.568918 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:07:06.568918 np0000001565 nova-compute[98289]:   <alias name="ua-05af6240-1c63-435e-9fb4-b10b8dc50b3b"/>
May 27 23:07:06.568918 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-4"/>
May 27 23:07:06.568918 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:07:06.568918 np0000001565 nova-compute[98289]:   <serial>05af6240-1c63-435e-9fb4-b10b8dc50b3b</serial>
May 27 23:07:06.568918 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:07:06.568918 np0000001565 nova-compute[98289]: </disk>
May 27 23:07:06.568918 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:07:06.576348 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:07:06.578874 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:fe94:b6ed', 'fe80::906a:e4ff:fe34:5279', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fefc:4f23', 'fe80::f886:b6ff:fe99:9ebe'] 
May 27 23:07:06.578874 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:07:06.578874 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:07:06.578874 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:06.578874 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Updating existing volume attachment record: c8051746-7f32-4371-9727-8e12dbc7916a {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:07:06.609553 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8feab173-f8c5-41af-ae27-352eabda229c req-6cd8917e-67a4-4314-9f25-4da92cc84f05 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:07:06.767174 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8feab173-f8c5-41af-ae27-352eabda229c req-6cd8917e-67a4-4314-9f25-4da92cc84f05 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:06.952482 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1506449161',display_name='tempest-TestEncryptedCinderVolumes-server-1506449161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1506449161',id=33,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgzwmMHRUJg1sZJ/hmk8m1xSi+BBD6J7xKwl6HGLuPEe+QDPuvTW/oi2EK3vsV/j+lTrKWLG76DbPz8HRJ70nQ96ZNyy2dZunvB2MgpS0x+pmG60Zlp192auWB2y7TRug==',key_name='tempest-keypair-1061378884',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:06:07Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-7jjhl631',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=8e6a355e-e4c7-4d32-9a78-9ce892cd35ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:07:06.952680 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "address": "fa:16:3e:7f:44:6c", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e938e2-06", "ovs_interfaceid": "08e938e2-06e5-4e01-ba76-5db7c55efa5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:06.953320 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=08e938e2-06e5-4e01-ba76-5db7c55efa5a,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08e938e2-06') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:06.956068 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=08e938e2-06e5-4e01-ba76-5db7c55efa5a,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08e938e2-06') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:07:06.957337 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.957746 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08e938e2-06, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:06.958901 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.960248 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:06.960977 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.961170 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecc51d38-20e5-408b-9c60-76c4aebff4b3) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:06.961598 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.961997 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:06.962271 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:06.963812 np0000001565 nova-compute[98289]: INFO os_vif [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=08e938e2-06e5-4e01-ba76-5db7c55efa5a,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08e938e2-06')
May 27 23:07:06.964092 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Deleting instance files /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef_del
May 27 23:07:06.964793 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Deletion of /opt/stack/data/nova/instances/8e6a355e-e4c7-4d32-9a78-9ce892cd35ef_del complete
May 27 23:07:06.968784 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.588s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:06.969123 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:07:07.055760 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923227.0553243, 225ad6d6-6422-4bab-994c-fcc6c720b0ea => ua-05af6240-1c63-435e-9fb4-b10b8dc50b3b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:07:07.057723 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-05af6240-1c63-435e-9fb4-b10b8dc50b3b for instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:07:07.060474 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Successfully detached device vdb from instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea from the live domain config.
May 27 23:07:07.061521 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:07:07.061910 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:07.062074 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:07.062571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:07.062987 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '05af6240-1c63-435e-9fb4-b10b8dc50b3b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:07:07.064577 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:07:07.090019 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:07.090019 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:07.090019 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:07.090019 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:07.090019 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:07.090264 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:07.090264 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:07.090264 np0000001565 nova-compute[98289]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:07.090264 np0000001565 nova-compute[98289]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b (non-flash)
May 27 23:07:07.090264 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:07.090697 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '63')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:07:07.090697 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '63')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:07.091758 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b', '62')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:07.092929 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e581376a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b'): ({'sdf'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:07:07.093185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:07:07.093512 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Flush multipath device 330000000f4c51a7c {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:07:07.122827 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:07:07.177508 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:07:07.218342 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:07:07.218562 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:07:07.220807 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:07:07.235181 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:07:07.235639 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:07:07.248209 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:07.269424 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8feab173-f8c5-41af-ae27-352eabda229c req-6cd8917e-67a4-4314-9f25-4da92cc84f05 service nova] Releasing lock "refresh_cache-77ce6750-3568-4e9b-b99e-c1a7964536d0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:07.270040 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquired lock "refresh_cache-77ce6750-3568-4e9b-b99e-c1a7964536d0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:07.270246 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:07:07.282852 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b, portal: 192.168.40.100,3260]
May 27 23:07:07.282852 np0000001565 nova-compute[98289]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b, portal: 192.168.40.100,3260] successful.
May 27 23:07:07.282852 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:07.299157 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:07.317673 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:07.347056 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b, portal: 192.168.50.100,3260]
May 27 23:07:07.347056 np0000001565 nova-compute[98289]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-05af6240-1c63-435e-9fb4-b10b8dc50b3b, portal: 192.168.50.100,3260] successful.
May 27 23:07:07.347056 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:07.365471 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:07.365660 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:07.365771 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] <== disconnect_volume: return (304ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:07.365891 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:07:07.470586 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 23:07:07.471414 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:07:07.471764 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:07:07.471903 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:07:07.472280 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:07.479016 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:07:07.479174 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:07:07.479410 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:07.479612 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:07.567886 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c6d94c1e6da4237aa5dd517c31e03d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec877dc7b2240969ac89c13673f8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:07:07.587868 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:07.935824 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lazy-loading 'flavor' on Instance uuid 225ad6d6-6422-4bab-994c-fcc6c720b0ea {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:07.982109 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:07:08.015411 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Successfully created port: cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:07:08.080032 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:07:08.295226 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:08.360945 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-def8e1f3-4c36-4adb-ad3f-c9f7fd3b2313 req-28d1f3ae-a17b-43d8-bf7e-ea28cdf78a06 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Received event network-vif-unplugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:08.361199 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-def8e1f3-4c36-4adb-ad3f-c9f7fd3b2313 req-28d1f3ae-a17b-43d8-bf7e-ea28cdf78a06 service nova] Acquiring lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:08.361642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-def8e1f3-4c36-4adb-ad3f-c9f7fd3b2313 req-28d1f3ae-a17b-43d8-bf7e-ea28cdf78a06 service nova] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:08.361782 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-def8e1f3-4c36-4adb-ad3f-c9f7fd3b2313 req-28d1f3ae-a17b-43d8-bf7e-ea28cdf78a06 service nova] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:08.361905 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-def8e1f3-4c36-4adb-ad3f-c9f7fd3b2313 req-28d1f3ae-a17b-43d8-bf7e-ea28cdf78a06 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] No waiting events found dispatching network-vif-unplugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:08.362033 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-def8e1f3-4c36-4adb-ad3f-c9f7fd3b2313 req-28d1f3ae-a17b-43d8-bf7e-ea28cdf78a06 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Received event network-vif-unplugged-08e938e2-06e5-4e01-ba76-5db7c55efa5a for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:07:08.362170 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-def8e1f3-4c36-4adb-ad3f-c9f7fd3b2313 req-28d1f3ae-a17b-43d8-bf7e-ea28cdf78a06 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Received event network-vif-deleted-08e938e2-06e5-4e01-ba76-5db7c55efa5a {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:08.362240 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-def8e1f3-4c36-4adb-ad3f-c9f7fd3b2313 req-28d1f3ae-a17b-43d8-bf7e-ea28cdf78a06 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Neutron deleted interface 08e938e2-06e5-4e01-ba76-5db7c55efa5a; detaching it from the instance and deleting it from the info cache
May 27 23:07:08.364931 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-def8e1f3-4c36-4adb-ad3f-c9f7fd3b2313 req-28d1f3ae-a17b-43d8-bf7e-ea28cdf78a06 service nova] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Detach interface failed, port_id=08e938e2-06e5-4e01-ba76-5db7c55efa5a, reason: Instance 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:07:08.436520 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Updating instance_info_cache with network_info: [{"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:08.488169 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:07:08.542153 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:08.581773 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:08.634278 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Successfully updated port: cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:07:08.681912 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:07:08.683156 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:07:08.683682 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Creating image(s)
May 27 23:07:08.684235 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:07:08.684431 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Ensure instance console log exists: /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:07:08.684707 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:08.684910 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:08.685081 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:08.938457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Releasing lock "refresh_cache-77ce6750-3568-4e9b-b99e-c1a7964536d0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:08.938753 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Instance network_info: |[{"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:07:08.939827 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Start _get_guest_xml network_info=[{"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c8051746-7f32-4371-9727-8e12dbc7916a', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '77ce6750-3568-4e9b-b99e-c1a7964536d0', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'serial': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:07:08.941281 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f44bbf27-e3d7-4419-94ec-7e16e90fc322 tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.985s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:08.943222 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:07:08.944813 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-440667466', uuid='77ce6750-3568-4e9b-b99e-c1a7964536d0'), owner=OwnerMeta(userid='4451943f43444436bf50809c8ab7f0d3', username='tempest-ServerActionsV293TestJSON-984365273-project-member', projectid='932825702de943b48bbcada3b5763dac', projectname='tempest-ServerActionsV293TestJSON-984365273'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923228.9443164) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:07:08.946038 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:07:08.946516 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:07:08.947537 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:07:08.947773 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:07:08.949167 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:07:08.949566 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:07:08.949806 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:07:08.949909 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:07:08.950098 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:07:08.950222 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:07:08.950385 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:07:08.950601 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:07:08.950746 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:07:08.950900 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:07:08.951047 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:07:08.951220 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:07:08.968633 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:07:08.969181 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:08.969401 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:08.969729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:08.969958 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:07:08.982600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:08.983191 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:08.983644 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:08.983835 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:07:08.984153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:08.984317 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:07:08.994617 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Booting with volume dcb561c7-ec7f-4962-be59-c006aae726cf at /dev/vda
May 27 23:07:08.999785 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:07:08.999785 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:09.006751 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:07:09.006751 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:09.015420 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2] added
May 27 23:07:09.015420 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:07:09.015420 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:09.015420 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:09.015420 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:09.015420 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:09.015420 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:09.015602 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:07:09.015813 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:07:09.016004 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:07:09.018123 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2] added
May 27 23:07:09.018123 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:07:09.018123 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:09.018123 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:09.018123 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:09.018123 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:09.018123 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:09.018274 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:07:09.018554 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:07:09.018554 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:07:09.041501 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:09.045694 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Took 1.57 seconds to deallocate network for instance.
May 27 23:07:09.058783 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:07:09.080728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:09.125994 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:07:09.127030 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:07:09.138578 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:07:09.140131 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:fe94:b6ed', 'fe80::906a:e4ff:fe34:5279', 'fe80::fc16:3eff:fedf:3653', 'fe80::fc16:3eff:fefc:4f23', 'fe80::f886:b6ff:fe99:9ebe'] 
May 27 23:07:09.141173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "refresh_cache-225950be-cc72-44aa-8ec2-54a94cb5efdd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:09.141378 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:07:09.141551 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquired lock "refresh_cache-225950be-cc72-44aa-8ec2-54a94cb5efdd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:09.142377 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:07:09.142377 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:07:09.143223 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:09.143436 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Updating existing volume attachment record: 74105ccc-c5f4-4606-9981-530d60161831 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:07:09.315147 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:09.315361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:09.315592 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:09.315760 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:09.315894 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:09.318586 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Terminating instance
May 27 23:07:09.560908 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:09.561318 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:09.722492 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:07:09.821267 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:07:09.858615 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:09.864935 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:09.887240 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:09.897722 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:09.919970 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:09.924560 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:10.016819 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:07:10.018913 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:07:10.026942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:07:10.032659 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:07:10.032659 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:07:10.036649 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:07:10.036649 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:10.046884 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:10.055317 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:10.061793 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.061793 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.061793 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:10.061981 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.061981 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.061981 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:10.070621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.070621 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.070621 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:10.070779 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.070779 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.070779 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:10.088263 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.50.100,3260]
May 27 23:07:10.088263 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.50.100,3260] successful.
May 27 23:07:10.088263 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:10.107359 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:10.112387 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.40.100,3260]
May 27 23:07:10.112387 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.40.100,3260] successful.
May 27 23:07:10.112387 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:10.125683 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:10.126702 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.126702 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.126702 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:10.126702 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:10.126702 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:10.126901 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.126901 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.126901 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:10.126901 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:10.126901 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:10.127292 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:10.127552 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:07:10.128353 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] HCTL ('7', '-', '-', 0) found on session 68 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:07:10.128537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:07:10.141732 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.141732 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.141732 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:10.141732 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:10.141732 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:10.142021 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.142021 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:10.142021 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:10.142021 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:10.142021 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:10.142212 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:10.142308 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:07:10.142877 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] HCTL ('8', '-', '-', 0) found on session 69 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:07:10.142955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:07:10.153739 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Searching for a device in session 68 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:07:10.153739 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:07:10.163907 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Searching for a device in session 69 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:07:10.163907 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:07:10.166788 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Updating instance_info_cache with network_info: [{"id": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "address": "fa:16:3e:bf:ef:a9", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba38e25-b2", "ovs_interfaceid": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:10.176186 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999679407999793 future=<Future at 0x726e6014a300 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:10.178690 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:10.179123 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:10.180899 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Instance destroyed successfully.
May 27 23:07:10.181740 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lazy-loading 'resources' on Instance uuid 225ad6d6-6422-4bab-994c-fcc6c720b0ea {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:10.452044 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Received event network-changed-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:10.452044 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Refreshing instance network info cache due to event network-changed-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:07:10.452044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] Acquiring lock "refresh_cache-225950be-cc72-44aa-8ec2-54a94cb5efdd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:10.671233 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Releasing lock "refresh_cache-225950be-cc72-44aa-8ec2-54a94cb5efdd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:10.671595 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Instance network_info: |[{"id": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "address": "fa:16:3e:bf:ef:a9", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba38e25-b2", "ovs_interfaceid": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:07:10.671928 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] Acquired lock "refresh_cache-225950be-cc72-44aa-8ec2-54a94cb5efdd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:10.672105 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Refreshing network info cache for port cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:07:10.683945 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:10.689756 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1904737129',display_name='tempest-TestServerVolumeAttachmentScenario-server-1904737129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testservervolumeattachmentscenario-server-1904737129',id=32,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB13SwsiBOAlMVT+VIsGjYXmE64ey9TquoOH13ukkDBHlieqsEQnVLo8RPdyJ2lj4GyKJ3ozNNBMWYEKioNU/unRpN+YoTY4RtHSexXuspbT98NJQjJFmQBvmEdtR+LOMA==',key_name='tempest-keypair-1577371764',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:06:02Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d7499fc96c14d4fb66aa37e4a78012f',ramdisk_id='',reservation_id='r-k03kq343',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1351084007',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1351084007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:06:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6981493505a48ddb709a72af53b32e2',uuid=225ad6d6-6422-4bab-994c-fcc6c720b0ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a402bfd-33f6-497c-98f2-fa3d90821848", "address": "fa:16:3e:94:b6:ed", "network": {"id": "8735eb81-21d5-4f21-a6eb-53a9644b4eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1470727070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d7499fc96c14d4fb66aa37e4a78012f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a402bfd-33", "ovs_interfaceid": "0a402bfd-33f6-497c-98f2-fa3d90821848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:07:10.689974 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Converting VIF {"id": "0a402bfd-33f6-497c-98f2-fa3d90821848", "address": "fa:16:3e:94:b6:ed", "network": {"id": "8735eb81-21d5-4f21-a6eb-53a9644b4eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1470727070-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d7499fc96c14d4fb66aa37e4a78012f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a402bfd-33", "ovs_interfaceid": "0a402bfd-33f6-497c-98f2-fa3d90821848", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:10.690790 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:b6:ed,bridge_name='br-int',has_traffic_filtering=True,id=0a402bfd-33f6-497c-98f2-fa3d90821848,network=Network(8735eb81-21d5-4f21-a6eb-53a9644b4eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a402bfd-33') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:10.690961 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:b6:ed,bridge_name='br-int',has_traffic_filtering=True,id=0a402bfd-33f6-497c-98f2-fa3d90821848,network=Network(8735eb81-21d5-4f21-a6eb-53a9644b4eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a402bfd-33') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:07:10.692234 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:10.692454 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a402bfd-33, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:10.693416 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:10.694234 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:10.694721 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:10.695346 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:10.695475 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d2ec9dc-0d8d-4208-a531-e0752e974ed4) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:10.696699 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:10.697396 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:10.697800 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:10.699698 np0000001565 nova-compute[98289]: INFO os_vif [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:b6:ed,bridge_name='br-int',has_traffic_filtering=True,id=0a402bfd-33f6-497c-98f2-fa3d90821848,network=Network(8735eb81-21d5-4f21-a6eb-53a9644b4eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a402bfd-33')
May 27 23:07:10.700158 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Deleting instance files /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea_del
May 27 23:07:10.700747 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Deletion of /opt/stack/data/nova/instances/225ad6d6-6422-4bab-994c-fcc6c720b0ea_del complete
May 27 23:07:10.985600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:07:11.173989 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:11.192819 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.632s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:11.208246 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 23:07:11.209015 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:07:11.209675 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:07:11.209675 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:07:11.209935 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:11.253769 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:07:11.257872 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deleted allocations for instance 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef
May 27 23:07:11.260005 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:07:11.260988 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Creating image(s)
May 27 23:07:11.265133 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:07:11.265310 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Ensure instance console log exists: /opt/stack/data/nova/instances/225950be-cc72-44aa-8ec2-54a94cb5efdd/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:07:11.265621 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:11.265883 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:11.266107 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:11.266741 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Start _get_guest_xml network_info=[{"id": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "address": "fa:16:3e:bf:ef:a9", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba38e25-b2", "ovs_interfaceid": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '74105ccc-c5f4-4606-9981-530d60161831', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcb561c7-ec7f-4962-be59-c006aae726cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '225950be-cc72-44aa-8ec2-54a94cb5efdd', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcb561c7-ec7f-4962-be59-c006aae726cf', 'serial': 'dcb561c7-ec7f-4962-be59-c006aae726cf', 'multiattach': True}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:07:11.269851 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:07:11.271316 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1511234911', uuid='225950be-cc72-44aa-8ec2-54a94cb5efdd'), owner=OwnerMeta(userid='2c6d94c1e6da4237aa5dd517c31e03d7', username='tempest-AttachVolumeMultiAttachTest-781715127-project-member', projectid='0ec877dc7b2240969ac89c13673f8799', projectname='tempest-AttachVolumeMultiAttachTest-781715127'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "address": "fa:16:3e:bf:ef:a9", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba38e25-b2", "ovs_interfaceid": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923231.2709308) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:07:11.272458 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:07:11.272829 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:07:11.273798 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:07:11.274286 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:07:11.275362 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:07:11.275756 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:07:11.275959 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:07:11.276115 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:07:11.276301 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:07:11.276459 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:07:11.276604 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:07:11.276842 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:07:11.276996 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:07:11.277178 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:07:11.277337 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:07:11.277502 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:07:11.292784 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:07:11.293145 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcb561c7-ec7f-4962-be59-c006aae726cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:11.293295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:11.319432 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:11.601163 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:11.609238 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:11.837437 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Updated VIF entry in instance network info cache for port cba38e25-b2fa-40fc-bf31-f34bb4e3b29e. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:07:11.837437 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Updating instance_info_cache with network_info: [{"id": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "address": "fa:16:3e:bf:ef:a9", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba38e25-b2", "ovs_interfaceid": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:12.005088 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Found WWN 330000000c66bbb07 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:07:12.005694 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:12.005942 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000c66bbb07', 'path': '/dev/dm-0', 'multipath_id': '330000000c66bbb07'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:12.006070 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c66bbb07', 'path': '/dev/dm-0', 'multipath_id': '330000000c66bbb07'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:07:12.006500 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.713s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:12.006697 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcb561c7-ec7f-4962-be59-c006aae726cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:07:12.020513 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:12.021261 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:12.022464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:12.022674 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:07:12.023641 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:12.023819 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:07:12.033527 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:07:12.033527 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:12.040755 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:07:12.040755 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:12.046887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf] added
May 27 23:07:12.046887 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:07:12.046887 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:12.046887 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:12.046887 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:12.046887 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:12.046887 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:12.047216 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:07:12.047363 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:07:12.047562 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:07:12.049824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf] added
May 27 23:07:12.049824 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:07:12.049824 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:12.049824 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:12.049824 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:12.049824 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:12.049824 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:12.050152 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:07:12.050214 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:07:12.050380 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:07:12.132722 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003479379997770593 future=<Future at 0x726e602d0f50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:12.132862 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:12.132999 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.310611815999891 future=<Future at 0x726e5817d8b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:12.133114 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.310491400000046 future=<Future at 0x726e5817d8b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:12.133605 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Emitting event <LifecycleEvent: 1779923217.1322675, ad096c70-bfa7-4c5c-88bc-aacf02a9a386 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:12.133756 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] VM Stopped (Lifecycle Event)
May 27 23:07:12.213756 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:12.266925 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c3739c0-3d3f-422b-9533-7ed1d23628a5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "8e6a355e-e4c7-4d32-9a78-9ce892cd35ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.682s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:12.338633 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] Releasing lock "refresh_cache-225950be-cc72-44aa-8ec2-54a94cb5efdd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:12.338802 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Received event network-vif-unplugged-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:12.338964 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:12.339098 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:12.339228 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:12.339351 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] No waiting events found dispatching network-vif-unplugged-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:12.339469 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Received event network-vif-unplugged-0a402bfd-33f6-497c-98f2-fa3d90821848 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:07:12.339565 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Received event network-vif-unplugged-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:12.339669 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] Acquiring lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:12.339776 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:12.339868 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:12.339959 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] No waiting events found dispatching network-vif-unplugged-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:12.340050 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-703bd0ea-f6e3-4432-9872-ffeaf43bf940 req-cfc05ba1-d10f-4a4e-93be-f5b35f1cfcd8 service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Received event network-vif-unplugged-0a402bfd-33f6-497c-98f2-fa3d90821848 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:07:12.511362 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-440667466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionsv293testjson-server-440667466',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFF3ms/ZqADOPwQwgUDiksAV+TViqkb1xsZUeFJ9fXMFHAkOuFmlFD+buNkeEJSOa3xWsXInFjzmeNVuvHjuUmcUVOW9fKpVE4pVSKRmEFjcniprzLTbopfmOVDNzn6w==',key_name='tempest-keypair-482168530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='932825702de943b48bbcada3b5763dac',ramdisk_id='',reservation_id='r-z6zy7sr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-984365273',owner_user_name='tempest-ServerActionsV293TestJSON-984365273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4451943f43444436bf50809c8ab7f0d3',uuid=77ce6750-3568-4e9b-b99e-c1a7964536d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:07:12.511563 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converting VIF {"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:12.512014 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:12.513395 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lazy-loading 'pci_devices' on Instance uuid 77ce6750-3568-4e9b-b99e-c1a7964536d0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:12.516263 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d7a8f1f7-7eb9-445e-8c55-06bf8d730059 req-506d1581-169b-4364-b052-0f363a87d2d7 service nova] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Received event network-vif-deleted-0a402bfd-33f6-497c-98f2-fa3d90821848 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:12.637158 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: ad096c70-bfa7-4c5c-88bc-aacf02a9a386] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:12.716215 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Took 1.51 seconds to deallocate network for instance.
May 27 23:07:13.016023 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] End _get_guest_xml xml=<domain type="qemu">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <uuid>77ce6750-3568-4e9b-b99e-c1a7964536d0</uuid>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <name>instance-00000023</name>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerActionsV293TestJSON-server-440667466</nova:name>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:07:08</nova:creationTime>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:user uuid="4451943f43444436bf50809c8ab7f0d3">tempest-ServerActionsV293TestJSON-984365273-project-member</nova:user>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:project uuid="932825702de943b48bbcada3b5763dac">tempest-ServerActionsV293TestJSON-984365273</nova:project>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         <nova:port uuid="61237f5f-3261-4c4e-83c3-7f4a5db90b8f">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <system>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <entry name="serial">77ce6750-3568-4e9b-b99e-c1a7964536d0</entry>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <entry name="uuid">77ce6750-3568-4e9b-b99e-c1a7964536d0</entry>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     </system>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <os>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   </os>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <features>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   </features>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   <devices>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/disk.config"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <alias name="ua-f0db4932-f904-4a76-b63e-0c23a6cb2dc2"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <serial>f0db4932-f904-4a76-b63e-0c23a6cb2dc2</serial>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ae:d8:ed"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <target dev="tap61237f5f-32"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     </interface>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/console.log" append="off"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     </serial>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <video>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     </video>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     </rng>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:   </devices>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]: </domain>
May 27 23:07:13.016023 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:07:13.018698 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Preparing to wait for external event network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:07:13.018698 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:13.018698 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:13.018698 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:13.018698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-440667466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionsv293testjson-server-440667466',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFF3ms/ZqADOPwQwgUDiksAV+TViqkb1xsZUeFJ9fXMFHAkOuFmlFD+buNkeEJSOa3xWsXInFjzmeNVuvHjuUmcUVOW9fKpVE4pVSKRmEFjcniprzLTbopfmOVDNzn6w==',key_name='tempest-keypair-482168530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='932825702de943b48bbcada3b5763dac',ramdisk_id='',reservation_id='r-z6zy7sr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-984365273',owner_user_name='tempest-ServerActionsV293TestJSON-984365273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4451943f43444436bf50809c8ab7f0d3',uuid=77ce6750-3568-4e9b-b99e-c1a7964536d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:07:13.018698 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converting VIF {"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:13.018698 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:13.018698 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:07:13.018698 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:13.019053 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:13.019053 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:07:13.019745 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:13.019884 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c010fe6-bc3c-586a-8907-6164dd8bf878', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:13.020495 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:13.021241 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:13.021559 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:13.023446 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:13.023649 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61237f5f-32, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:13.023818 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61237f5f-32, col_values=(('qos', UUID('a14f78fb-abae-43ee-90a9-e434d2622d35')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:13.023957 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61237f5f-32, col_values=(('external_ids', {'iface-id': '61237f5f-3261-4c4e-83c3-7f4a5db90b8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:d8:ed', 'vm-uuid': '77ce6750-3568-4e9b-b99e-c1a7964536d0'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:13.024602 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:13.025754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:13.029593 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:13.030797 np0000001565 nova-compute[98289]: INFO os_vif [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32')
May 27 23:07:13.047958 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:07:13.050713 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:07:13.059438 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:07:13.059438 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:07:13.064553 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:07:13.064553 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:13.071228 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:13.076185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:13.082671 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.082671 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.082671 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.082671 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.082671 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:13.082885 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.082885 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.082885 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.082885 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.082885 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:13.088861 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.088861 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.088861 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.088861 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.088861 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:13.089065 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.089065 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.089065 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.089065 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.089065 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:13.113834 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf, portal: 192.168.50.100,3260]
May 27 23:07:13.113834 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf, portal: 192.168.50.100,3260] successful.
May 27 23:07:13.113834 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:13.126988 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:13.137532 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf, portal: 192.168.40.100,3260]
May 27 23:07:13.137532 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf, portal: 192.168.40.100,3260] successful.
May 27 23:07:13.137532 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:13.142371 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:13.142371 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:13.142797 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:07:13.143167 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('11', '-', '-', 0) found on session 70 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:07:13.143269 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:07:13.148132 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:13.156769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 70 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:07:13.156769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dcb561c7-ec7f-4962-be59-c006aae726cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:07:13.162227 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.162227 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.162227 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.162227 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.162227 np0000001565 nova-compute[98289]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:13.162227 np0000001565 nova-compute[98289]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:13.162227 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:13.162517 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.162517 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:13.162517 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.162517 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:13.162517 np0000001565 nova-compute[98289]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:13.162517 np0000001565 nova-compute[98289]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:13.162517 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:13.162704 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:13.162704 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:07:13.163280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] HCTL ('12', '-', '-', 0) found on session 71 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:07:13.163399 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:07:13.176850 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Searching for a device in session 71 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:07:13.177083 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcb561c7-ec7f-4962-be59-c006aae726cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:07:13.221749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:13.221937 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:13.596172 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:13.701099 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:13.702253 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:14.022052 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:07:14.150930 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:14.151153 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:14.203781 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:14.545172 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:14.545307 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:14.545425 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] No VIF found with MAC fa:16:3e:ae:d8:ed, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:07:14.545777 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Using config drive
May 27 23:07:14.652747 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:07:14.709735 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.488s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:14.763803 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Deleted allocations for instance 225ad6d6-6422-4bab-994c-fcc6c720b0ea
May 27 23:07:15.036942 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Found WWN 330000000d3b78188 for multipath device dm-6 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:07:15.037391 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:15.037391 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== connect_volume: return (3743ms) {'type': 'block', 'scsi_wwn': '330000000d3b78188', 'path': '/dev/dm-6', 'multipath_id': '330000000d3b78188'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:15.037391 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d3b78188', 'path': '/dev/dm-6', 'multipath_id': '330000000d3b78188'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:07:15.050770 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:15.160800 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Creating config drive at /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/disk.config
May 27 23:07:15.166985 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp22wy5a_p {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:15.214177 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp22wy5a_p" returned: 0 in 0.047s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:15.220258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:15.220624 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:15.226095 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:07:15.226095 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Claim successful on node np0000001565
May 27 23:07:15.542898 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1511234911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumemultiattachtest-server-1511234911',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-palw9ecu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:09Z,user_data=None,user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=225950be-cc72-44aa-8ec2-54a94cb5efdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "address": "fa:16:3e:bf:ef:a9", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba38e25-b2", "ovs_interfaceid": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:07:15.543128 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "address": "fa:16:3e:bf:ef:a9", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba38e25-b2", "ovs_interfaceid": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:15.543939 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ef:a9,bridge_name='br-int',has_traffic_filtering=True,id=cba38e25-b2fa-40fc-bf31-f34bb4e3b29e,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba38e25-b2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:15.544941 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'pci_devices' on Instance uuid 225950be-cc72-44aa-8ec2-54a94cb5efdd {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:15.608079 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:15.633553 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:15.636621 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:15.742390 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:15.776361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-06c7b87f-2872-4825-aabb-b44d8bb3e60b tempest-TestServerVolumeAttachmentScenario-1351084007 tempest-TestServerVolumeAttachmentScenario-1351084007-project-member] Lock "225ad6d6-6422-4bab-994c-fcc6c720b0ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.461s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:15.870303 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b57cc4a0-8758-450b-8598-7af88c83a3ca req-3fb6698c-14aa-41c5-859b-e7701c683826 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:15.870602 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b57cc4a0-8758-450b-8598-7af88c83a3ca req-3fb6698c-14aa-41c5-859b-e7701c683826 service nova] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:15.870886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b57cc4a0-8758-450b-8598-7af88c83a3ca req-3fb6698c-14aa-41c5-859b-e7701c683826 service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:15.871173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b57cc4a0-8758-450b-8598-7af88c83a3ca req-3fb6698c-14aa-41c5-859b-e7701c683826 service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:15.871345 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b57cc4a0-8758-450b-8598-7af88c83a3ca req-3fb6698c-14aa-41c5-859b-e7701c683826 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Processing event network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:07:16.006592 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:16.010445 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:16.014063 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:16.042574 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:16.050177 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] End _get_guest_xml xml=<domain type="qemu">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <uuid>225950be-cc72-44aa-8ec2-54a94cb5efdd</uuid>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <name>instance-00000024</name>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1511234911</nova:name>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:07:11</nova:creationTime>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:user uuid="2c6d94c1e6da4237aa5dd517c31e03d7">tempest-AttachVolumeMultiAttachTest-781715127-project-member</nova:user>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:project uuid="0ec877dc7b2240969ac89c13673f8799">tempest-AttachVolumeMultiAttachTest-781715127</nova:project>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         <nova:port uuid="cba38e25-b2fa-40fc-bf31-f34bb4e3b29e">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <system>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <entry name="serial">225950be-cc72-44aa-8ec2-54a94cb5efdd</entry>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <entry name="uuid">225950be-cc72-44aa-8ec2-54a94cb5efdd</entry>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     </system>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <os>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   </os>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <features>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   </features>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   <devices>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/225950be-cc72-44aa-8ec2-54a94cb5efdd/disk.config"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <alias name="ua-dcb561c7-ec7f-4962-be59-c006aae726cf"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-6"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <serial>dcb561c7-ec7f-4962-be59-c006aae726cf</serial>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <shareable/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:bf:ef:a9"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <target dev="tapcba38e25-b2"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     </interface>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/225950be-cc72-44aa-8ec2-54a94cb5efdd/console.log" append="off"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     </serial>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <video>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     </video>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     </rng>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:   </devices>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]: </domain>
May 27 23:07:16.050177 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:07:16.050177 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Preparing to wait for external event network-vif-plugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:07:16.053728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:16.053728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:16.053728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:16.053728 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1511234911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumemultiattachtest-server-1511234911',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-palw9ecu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:09Z,user_data=None,user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=225950be-cc72-44aa-8ec2-54a94cb5efdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "address": "fa:16:3e:bf:ef:a9", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba38e25-b2", "ovs_interfaceid": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:07:16.053728 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "address": "fa:16:3e:bf:ef:a9", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba38e25-b2", "ovs_interfaceid": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:16.053728 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ef:a9,bridge_name='br-int',has_traffic_filtering=True,id=cba38e25-b2fa-40fc-bf31-f34bb4e3b29e,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba38e25-b2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:16.054106 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ef:a9,bridge_name='br-int',has_traffic_filtering=True,id=cba38e25-b2fa-40fc-bf31-f34bb4e3b29e,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba38e25-b2') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:07:16.054106 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:16.055053 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:16.055053 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:07:16.057209 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:16.057843 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04c4b752-e81c-56a2-9dd5-501a94bb2a77', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:16.059734 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:16.062421 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:16.066127 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:16.066367 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcba38e25-b2, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:16.066736 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcba38e25-b2, col_values=(('qos', UUID('1d1b54f0-15ea-43b3-b46a-a9432339fb2b')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:16.066951 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcba38e25-b2, col_values=(('external_ids', {'iface-id': 'cba38e25-b2fa-40fc-bf31-f34bb4e3b29e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:ef:a9', 'vm-uuid': '225950be-cc72-44aa-8ec2-54a94cb5efdd'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:16.067930 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:16.070105 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:16.074908 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:16.076508 np0000001565 nova-compute[98289]: INFO os_vif [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ef:a9,bridge_name='br-int',has_traffic_filtering=True,id=cba38e25-b2fa-40fc-bf31-f34bb4e3b29e,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba38e25-b2')
May 27 23:07:16.463357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:16.463357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:16.514229 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:07:16.516840 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923236.5152493, 77ce6750-3568-4e9b-b99e-c1a7964536d0 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:16.517083 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] VM Started (Lifecycle Event)
May 27 23:07:16.518483 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:07:16.521569 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Instance spawned successfully.
May 27 23:07:16.521933 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:07:16.765689 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:16.765930 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:16.963257 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:07:17.021022 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:17.028849 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:07:17.034397 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:17.034572 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:17.034883 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:17.035410 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:17.035679 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:17.035895 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:17.268705 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:17.516715 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:17.531669 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:07:17.531883 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923237.5317233, 77ce6750-3568-4e9b-b99e-c1a7964536d0 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:17.531992 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] VM Paused (Lifecycle Event)
May 27 23:07:17.540789 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Took 8.86 seconds to spawn the instance on the hypervisor.
May 27 23:07:17.541114 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:17.603433 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:17.603547 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:17.603692 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] No VIF found with MAC fa:16:3e:bf:ef:a9, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:07:17.604104 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Using config drive
May 27 23:07:17.776590 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.556s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:17.777304 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.261s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:17.777541 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:07:17.782273 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:07:17.782416 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Claim successful on node np0000001565
May 27 23:07:17.940301 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b053cab2-53be-499b-8b45-be5c04dc002e req-4e9bad55-d201-45ec-a864-c80c1c31f686 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:17.940550 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b053cab2-53be-499b-8b45-be5c04dc002e req-4e9bad55-d201-45ec-a864-c80c1c31f686 service nova] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:17.940697 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b053cab2-53be-499b-8b45-be5c04dc002e req-4e9bad55-d201-45ec-a864-c80c1c31f686 service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:17.940807 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b053cab2-53be-499b-8b45-be5c04dc002e req-4e9bad55-d201-45ec-a864-c80c1c31f686 service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:17.940979 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b053cab2-53be-499b-8b45-be5c04dc002e req-4e9bad55-d201-45ec-a864-c80c1c31f686 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] No waiting events found dispatching network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:17.941117 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-b053cab2-53be-499b-8b45-be5c04dc002e req-4e9bad55-d201-45ec-a864-c80c1c31f686 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received unexpected event network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f for instance with vm_state active and task_state None.
May 27 23:07:18.035355 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:18.037239 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923238.0370202, 77ce6750-3568-4e9b-b99e-c1a7964536d0 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:18.037945 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] VM Resumed (Lifecycle Event)
May 27 23:07:18.048928 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Took 17.20 seconds to build instance.
May 27 23:07:18.108644 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:18.228777 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Creating config drive at /opt/stack/data/nova/instances/225950be-cc72-44aa-8ec2-54a94cb5efdd/disk.config
May 27 23:07:18.231657 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/225950be-cc72-44aa-8ec2-54a94cb5efdd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8m75o5q2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:18.285052 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:07:18.285422 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:07:18.285715 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:18.285979 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:18.293011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/225950be-cc72-44aa-8ec2-54a94cb5efdd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8m75o5q2" returned: 0 in 0.061s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:18.365954 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '946d9258fd0841dca06d0184677f7376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f2d92ddf941fab9c407482cbb534e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:07:18.539928 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:18.543292 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:07:18.550673 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.712s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:18.599882 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:18.703759 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:18.727218 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:18.729579 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:18.794795 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:07:18.860257 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:18.901120 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:18.901817 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:18.910899 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Successfully created port: da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:07:19.018053 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d79bdd97-b3c5-48c8-ab3c-18cc93252075 req-0570adb8-18c4-4766-8512-a7191f4ac263 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Received event network-vif-plugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:19.018694 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d79bdd97-b3c5-48c8-ab3c-18cc93252075 req-0570adb8-18c4-4766-8512-a7191f4ac263 service nova] Acquiring lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:19.018902 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d79bdd97-b3c5-48c8-ab3c-18cc93252075 req-0570adb8-18c4-4766-8512-a7191f4ac263 service nova] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:19.019140 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d79bdd97-b3c5-48c8-ab3c-18cc93252075 req-0570adb8-18c4-4766-8512-a7191f4ac263 service nova] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:19.019140 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d79bdd97-b3c5-48c8-ab3c-18cc93252075 req-0570adb8-18c4-4766-8512-a7191f4ac263 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Processing event network-vif-plugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:07:19.305079 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:07:19.452814 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:19.453029 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:19.629243 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923239.6288543, 225950be-cc72-44aa-8ec2-54a94cb5efdd => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:19.629458 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] VM Started (Lifecycle Event)
May 27 23:07:19.632228 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:07:19.635439 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:07:19.637860 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Instance spawned successfully.
May 27 23:07:19.638102 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:07:19.709095 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f5cb7fc0-f01c-4c80-acfc-308fbc98d225 req-07576d1f-3c1e-445f-8000-16c894879b63 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-changed-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:19.709095 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f5cb7fc0-f01c-4c80-acfc-308fbc98d225 req-07576d1f-3c1e-445f-8000-16c894879b63 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Refreshing instance network info cache due to event network-changed-61237f5f-3261-4c4e-83c3-7f4a5db90b8f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:07:19.709095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f5cb7fc0-f01c-4c80-acfc-308fbc98d225 req-07576d1f-3c1e-445f-8000-16c894879b63 service nova] Acquiring lock "refresh_cache-77ce6750-3568-4e9b-b99e-c1a7964536d0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:19.709095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f5cb7fc0-f01c-4c80-acfc-308fbc98d225 req-07576d1f-3c1e-445f-8000-16c894879b63 service nova] Acquired lock "refresh_cache-77ce6750-3568-4e9b-b99e-c1a7964536d0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:19.709095 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f5cb7fc0-f01c-4c80-acfc-308fbc98d225 req-07576d1f-3c1e-445f-8000-16c894879b63 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Refreshing network info cache for port 61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:07:19.869997 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Successfully updated port: da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:07:19.956952 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:20.133562 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:20.137706 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:07:20.146057 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:20.146315 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:20.146474 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:20.146662 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:20.146931 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:20.147486 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:20.210439 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f5cb7fc0-f01c-4c80-acfc-308fbc98d225 req-07576d1f-3c1e-445f-8000-16c894879b63 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:20.324512 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:07:20.328588 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:07:20.328588 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Creating image(s)
May 27 23:07:20.328588 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:20.328588 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:20.330145 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:20.330145 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:20.333030 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:20.334418 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:20.373940 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:20.374108 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquired lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:20.374431 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:07:20.453425 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.119s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:20.453736 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:20.454266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:20.454848 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:20.459150 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:20.459806 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:20.480107 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.702s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:20.481075 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:07:20.584654 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.125s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:20.585090 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:20.639628 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:07:20.640059 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923240.6398163, 225950be-cc72-44aa-8ec2-54a94cb5efdd => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:20.640323 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] VM Paused (Lifecycle Event)
May 27 23:07:20.654770 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Took 9.40 seconds to spawn the instance on the hypervisor.
May 27 23:07:20.654770 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:20.655832 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk 1073741824" returned: 0 in 0.070s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:20.655925 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:20.656184 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:20.681089 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f5cb7fc0-f01c-4c80-acfc-308fbc98d225 req-07576d1f-3c1e-445f-8000-16c894879b63 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:20.726652 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:20.757182 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.100s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:20.758827 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:07:20.759362 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:20.877515 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:20.878602 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Cannot resize image /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:07:20.878602 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:07:20.878602 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Ensure instance console log exists: /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:07:20.878798 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:20.878858 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:20.880456 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:20.901529 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f5cb7fc0-f01c-4c80-acfc-308fbc98d225 req-07576d1f-3c1e-445f-8000-16c894879b63 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Updated VIF entry in instance network info cache for port 61237f5f-3261-4c4e-83c3-7f4a5db90b8f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:07:20.902695 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f5cb7fc0-f01c-4c80-acfc-308fbc98d225 req-07576d1f-3c1e-445f-8000-16c894879b63 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Updating instance_info_cache with network_info: [{"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:20.949864 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:07:21.024373 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:07:21.024597 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:07:21.025480 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:21.026358 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:21.069818 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:21.137557 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e15e4b45c874974b28db7f3448a3945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b69ef10bedf41b48b1455ae48aa534e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:07:21.144318 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:21.153618 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923241.1520734, 225950be-cc72-44aa-8ec2-54a94cb5efdd => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:21.153813 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] VM Resumed (Lifecycle Event)
May 27 23:07:21.176471 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:21.201997 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Took 17.09 seconds to build instance.
May 27 23:07:21.405511 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f5cb7fc0-f01c-4c80-acfc-308fbc98d225 req-07576d1f-3c1e-445f-8000-16c894879b63 service nova] Releasing lock "refresh_cache-77ce6750-3568-4e9b-b99e-c1a7964536d0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:21.444848 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0011974890003330074 future=<Future at 0x726e5817d8b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:21.445179 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:21.445368 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.7305041519998667 future=<Future at 0x726e6014a300 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:21.445497 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.730337189999773 future=<Future at 0x726e6014a300 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:21.446917 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Emitting event <LifecycleEvent: 1779923226.4435394, 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:21.448106 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] VM Stopped (Lifecycle Event)
May 27 23:07:21.499036 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-85751fcb-6147-40d5-aac8-8cbf8c673a79 req-8721e4bd-a178-4842-9236-a753deb6bd4f service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Received event network-vif-plugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:21.501734 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-85751fcb-6147-40d5-aac8-8cbf8c673a79 req-8721e4bd-a178-4842-9236-a753deb6bd4f service nova] Acquiring lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:21.501930 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-85751fcb-6147-40d5-aac8-8cbf8c673a79 req-8721e4bd-a178-4842-9236-a753deb6bd4f service nova] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:21.502054 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-85751fcb-6147-40d5-aac8-8cbf8c673a79 req-8721e4bd-a178-4842-9236-a753deb6bd4f service nova] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:21.504180 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-85751fcb-6147-40d5-aac8-8cbf8c673a79 req-8721e4bd-a178-4842-9236-a753deb6bd4f service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] No waiting events found dispatching network-vif-plugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:21.504180 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-85751fcb-6147-40d5-aac8-8cbf8c673a79 req-8721e4bd-a178-4842-9236-a753deb6bd4f service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Received unexpected event network-vif-plugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e for instance with vm_state active and task_state None.
May 27 23:07:21.515287 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Updating instance_info_cache with network_info: [{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:21.527202 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:07:21.660747 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:21.663149 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:07:21.667217 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Successfully created port: b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:07:21.703903 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f45cd698-e581-4f8c-bc5d-d274f201d6a7 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.596s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:21.792482 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3719a0f0-9a20-4223-8cf7-7957d48d153a req-a10bc42c-9142-4b33-bf86-6600ebb48611 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-changed-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:21.794040 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3719a0f0-9a20-4223-8cf7-7957d48d153a req-a10bc42c-9142-4b33-bf86-6600ebb48611 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Refreshing instance network info cache due to event network-changed-da08a446-879f-4bdd-9ac4-5d3d736fc30b. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:07:21.794205 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3719a0f0-9a20-4223-8cf7-7957d48d153a req-a10bc42c-9142-4b33-bf86-6600ebb48611 service nova] Acquiring lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:21.949607 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 8e6a355e-e4c7-4d32-9a78-9ce892cd35ef] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:22.020277 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Releasing lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:22.020277 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance network_info: |[{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:07:22.020772 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Start _get_guest_xml network_info=[{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:07:22.021813 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3719a0f0-9a20-4223-8cf7-7957d48d153a req-a10bc42c-9142-4b33-bf86-6600ebb48611 service nova] Acquired lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:22.021813 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3719a0f0-9a20-4223-8cf7-7957d48d153a req-a10bc42c-9142-4b33-bf86-6600ebb48611 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Refreshing network info cache for port da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:07:22.030045 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:07:22.031694 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-238721078', uuid='4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6'), owner=OwnerMeta(userid='946d9258fd0841dca06d0184677f7376', username='tempest-AttachVolumeTestJSON-849627440-project-member', projectid='996f2d92ddf941fab9c407482cbb534e', projectname='tempest-AttachVolumeTestJSON-849627440'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923242.030887) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:07:22.032409 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:07:22.037040 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:07:22.038231 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:07:22.040681 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:07:22.040681 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:07:22.043142 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:07:22.043142 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:07:22.043142 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:07:22.043985 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:07:22.043985 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:07:22.043985 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:07:22.043985 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:07:22.044273 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:07:22.044414 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:07:22.044604 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:07:22.044851 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:07:22.044851 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:07:22.060120 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-238721078',display_name='tempest-AttachVolumeTestJSON-server-238721078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-238721078',id=37,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Qq0763SlHFA9VpZwsMi86ZEUPb6ApCeF8QACBJQZv1Rp1P7LElgDkrzQ2GQCg/z1bU9PMQyrWIL6JBPLYXYJUrkv+/pKYLhHsqJZtKFBBSXjOqDTK9LJJtTBA4xSw+w==',key_name='tempest-keypair-2072419759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-rnai6jvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:07:22.060299 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:22.060968 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:22.061466 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:22.178510 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Successfully updated port: b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:07:22.528199 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3719a0f0-9a20-4223-8cf7-7957d48d153a req-a10bc42c-9142-4b33-bf86-6600ebb48611 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:22.564395 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] End _get_guest_xml xml=<domain type="qemu">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <uuid>4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6</uuid>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <name>instance-00000025</name>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeTestJSON-server-238721078</nova:name>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:07:22</nova:creationTime>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:user uuid="946d9258fd0841dca06d0184677f7376">tempest-AttachVolumeTestJSON-849627440-project-member</nova:user>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:project uuid="996f2d92ddf941fab9c407482cbb534e">tempest-AttachVolumeTestJSON-849627440</nova:project>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         <nova:port uuid="da08a446-879f-4bdd-9ac4-5d3d736fc30b">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <system>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <entry name="serial">4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6</entry>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <entry name="uuid">4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6</entry>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     </system>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <os>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   </os>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <features>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   </features>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   <devices>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.config"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:8a:26:c4"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <target dev="tapda08a446-87"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     </interface>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/console.log" append="off"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     </serial>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <video>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     </video>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     </rng>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:   </devices>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]: </domain>
May 27 23:07:22.564395 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:07:22.564395 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Preparing to wait for external event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:07:22.569098 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:22.569098 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:22.569098 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:22.569098 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-238721078',display_name='tempest-AttachVolumeTestJSON-server-238721078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-238721078',id=37,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Qq0763SlHFA9VpZwsMi86ZEUPb6ApCeF8QACBJQZv1Rp1P7LElgDkrzQ2GQCg/z1bU9PMQyrWIL6JBPLYXYJUrkv+/pKYLhHsqJZtKFBBSXjOqDTK9LJJtTBA4xSw+w==',key_name='tempest-keypair-2072419759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-rnai6jvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:07:22.569098 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:22.569098 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:22.572959 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:07:22.572959 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:22.572959 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:22.572959 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:07:22.575037 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:22.575852 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f18cdd6d-3c89-597d-a891-9147c3ade8c8', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:22.582254 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:22.584094 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:22.584094 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda08a446-87, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:22.584519 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda08a446-87, col_values=(('qos', UUID('5fadbf96-222d-4f75-b92f-538b89affdce')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:22.584743 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda08a446-87, col_values=(('external_ids', {'iface-id': 'da08a446-879f-4bdd-9ac4-5d3d736fc30b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:26:c4', 'vm-uuid': '4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:22.586786 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:22.590503 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:22.596563 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:22.597471 np0000001565 nova-compute[98289]: INFO os_vif [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87')
May 27 23:07:22.681838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "refresh_cache-52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:22.681838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquired lock "refresh_cache-52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:22.681838 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:07:22.843775 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3719a0f0-9a20-4223-8cf7-7957d48d153a req-a10bc42c-9142-4b33-bf86-6600ebb48611 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:22.861317 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:23.013665 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3719a0f0-9a20-4223-8cf7-7957d48d153a req-a10bc42c-9142-4b33-bf86-6600ebb48611 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Updated VIF entry in instance network info cache for port da08a446-879f-4bdd-9ac4-5d3d736fc30b. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:07:23.013902 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3719a0f0-9a20-4223-8cf7-7957d48d153a req-a10bc42c-9142-4b33-bf86-6600ebb48611 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Updating instance_info_cache with network_info: [{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:23.045978 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:07:23.047290 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:07:23.047768 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Creating image(s)
May 27 23:07:23.048314 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "/opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:23.048687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:23.049305 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:23.049807 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:23.052394 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:23.054433 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:23.152633 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:23.153232 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:23.153859 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:23.154225 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:23.158211 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:23.158746 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:23.250241 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:07:23.252991 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:23.256197 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:23.335600 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk 1073741824" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:23.336305 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:23.336940 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:23.428830 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:23.429289 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:07:23.429849 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:23.499826 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:23.516027 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3719a0f0-9a20-4223-8cf7-7957d48d153a req-a10bc42c-9142-4b33-bf86-6600ebb48611 service nova] Releasing lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:23.550042 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:23.550522 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Cannot resize image /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:07:23.550690 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:07:23.550896 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Ensure instance console log exists: /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:07:23.551215 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:23.551537 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:23.551767 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:23.588294 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7aa5bb5c-4cf7-4d76-8fa0-7305a72b09d1 req-faec34da-f230-4593-b72a-0120e3891e31 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Received event network-changed-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:23.594100 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7aa5bb5c-4cf7-4d76-8fa0-7305a72b09d1 req-faec34da-f230-4593-b72a-0120e3891e31 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Refreshing instance network info cache due to event network-changed-b0d3ed57-0a73-4f63-9330-eb4626f68f3d. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:07:23.594472 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7aa5bb5c-4cf7-4d76-8fa0-7305a72b09d1 req-faec34da-f230-4593-b72a-0120e3891e31 service nova] Acquiring lock "refresh_cache-52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:23.599706 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:23.669862 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Updating instance_info_cache with network_info: [{"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:24.123619 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:24.123769 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:24.123900 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No VIF found with MAC fa:16:3e:8a:26:c4, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:07:24.124506 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Using config drive
May 27 23:07:24.171504 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Releasing lock "refresh_cache-52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:24.171740 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Instance network_info: |[{"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:07:24.172169 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7aa5bb5c-4cf7-4d76-8fa0-7305a72b09d1 req-faec34da-f230-4593-b72a-0120e3891e31 service nova] Acquired lock "refresh_cache-52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:24.173720 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7aa5bb5c-4cf7-4d76-8fa0-7305a72b09d1 req-faec34da-f230-4593-b72a-0120e3891e31 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Refreshing network info cache for port b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:07:24.174811 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Start _get_guest_xml network_info=[{"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:07:24.177185 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:07:24.178312 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1453941894', uuid='52410d9c-d2b3-4a6f-85f4-ca4f26fe660f'), owner=OwnerMeta(userid='1e15e4b45c874974b28db7f3448a3945', username='tempest-TestEncryptedCinderVolumes-762189049-project-member', projectid='8b69ef10bedf41b48b1455ae48aa534e', projectname='tempest-TestEncryptedCinderVolumes-762189049'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923244.1779935) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:07:24.179234 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:07:24.179547 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:07:24.180172 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:07:24.180342 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:07:24.181277 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:07:24.181576 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:07:24.181713 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:07:24.181793 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:07:24.181911 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:07:24.181972 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:07:24.182064 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:07:24.182184 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:07:24.182288 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:07:24.182419 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:07:24.182515 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:07:24.182623 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:07:24.198789 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1453941894',display_name='tempest-TestEncryptedCinderVolumes-server-1453941894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1453941894',id=38,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFWvH87oABsV3uPFPgYowmUUoUVRr/GvAtWFdPOg1d3C/UpqJiVaIb1ibllY84bdi+0xGc8nekizLJ4RH7M0wx/xu6EJhieQdJe2mNFy7blK69XA7d9Kkt2ox9C1M39+g==',key_name='tempest-keypair-625197076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-hdknahey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=52410d9c-d2b3-4a6f-85f4-ca4f26fe660f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:07:24.199003 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:24.199729 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=b0d3ed57-0a73-4f63-9330-eb4626f68f3d,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d3ed57-0a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:24.200606 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'pci_devices' on Instance uuid 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:24.633151 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:24.676599 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7aa5bb5c-4cf7-4d76-8fa0-7305a72b09d1 req-faec34da-f230-4593-b72a-0120e3891e31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:24.704302 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] End _get_guest_xml xml=<domain type="qemu">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <uuid>52410d9c-d2b3-4a6f-85f4-ca4f26fe660f</uuid>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <name>instance-00000026</name>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1453941894</nova:name>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:07:24</nova:creationTime>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:user uuid="1e15e4b45c874974b28db7f3448a3945">tempest-TestEncryptedCinderVolumes-762189049-project-member</nova:user>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:project uuid="8b69ef10bedf41b48b1455ae48aa534e">tempest-TestEncryptedCinderVolumes-762189049</nova:project>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         <nova:port uuid="b0d3ed57-0a73-4f63-9330-eb4626f68f3d">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <system>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <entry name="serial">52410d9c-d2b3-4a6f-85f4-ca4f26fe660f</entry>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <entry name="uuid">52410d9c-d2b3-4a6f-85f4-ca4f26fe660f</entry>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     </system>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <os>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   </os>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <features>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   </features>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   <devices>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk.config"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:2a:b7:2e"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <target dev="tapb0d3ed57-0a"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     </interface>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/console.log" append="off"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     </serial>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <video>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     </video>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     </rng>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:   </devices>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]: </domain>
May 27 23:07:24.704302 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:07:24.707173 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Preparing to wait for external event network-vif-plugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:07:24.707173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:24.707173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:24.707173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:24.707173 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1453941894',display_name='tempest-TestEncryptedCinderVolumes-server-1453941894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1453941894',id=38,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFWvH87oABsV3uPFPgYowmUUoUVRr/GvAtWFdPOg1d3C/UpqJiVaIb1ibllY84bdi+0xGc8nekizLJ4RH7M0wx/xu6EJhieQdJe2mNFy7blK69XA7d9Kkt2ox9C1M39+g==',key_name='tempest-keypair-625197076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-hdknahey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=52410d9c-d2b3-4a6f-85f4-ca4f26fe660f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:07:24.707173 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:24.707173 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=b0d3ed57-0a73-4f63-9330-eb4626f68f3d,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d3ed57-0a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:24.707173 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=b0d3ed57-0a73-4f63-9330-eb4626f68f3d,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d3ed57-0a') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:07:24.710716 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:24.710996 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:24.711254 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:07:24.713015 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:24.713220 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee9794ef-fa7a-5e6b-b096-07e8f578ad53', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:24.726852 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:24.729466 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:24.734082 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:24.737204 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:24.737204 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0d3ed57-0a, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:24.737415 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0d3ed57-0a, col_values=(('qos', UUID('96ee9ab8-921a-4da6-a332-3f5d781902f3')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:24.737589 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0d3ed57-0a, col_values=(('external_ids', {'iface-id': 'b0d3ed57-0a73-4f63-9330-eb4626f68f3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:b7:2e', 'vm-uuid': '52410d9c-d2b3-4a6f-85f4-ca4f26fe660f'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:24.738402 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:24.739839 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:24.754759 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:24.756345 np0000001565 nova-compute[98289]: INFO os_vif [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=b0d3ed57-0a73-4f63-9330-eb4626f68f3d,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d3ed57-0a')
May 27 23:07:24.785696 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Creating config drive at /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.config
May 27 23:07:24.791060 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1hbckgjm {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:24.851361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1hbckgjm" returned: 0 in 0.060s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:25.024350 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7aa5bb5c-4cf7-4d76-8fa0-7305a72b09d1 req-faec34da-f230-4593-b72a-0120e3891e31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:25.170866 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7aa5bb5c-4cf7-4d76-8fa0-7305a72b09d1 req-faec34da-f230-4593-b72a-0120e3891e31 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Updated VIF entry in instance network info cache for port b0d3ed57-0a73-4f63-9330-eb4626f68f3d. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:07:25.171452 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7aa5bb5c-4cf7-4d76-8fa0-7305a72b09d1 req-faec34da-f230-4593-b72a-0120e3891e31 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Updating instance_info_cache with network_info: [{"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:25.176388 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0005018830001972674 future=<Future at 0x726e6014a300 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:25.176501 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:25.178868 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] Emitting event <LifecycleEvent: 1779923230.1757655, 225ad6d6-6422-4bab-994c-fcc6c720b0ea => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:25.179058 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] VM Stopped (Lifecycle Event)
May 27 23:07:25.332294 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:25.366577 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:25.456083 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:25.571075 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2aaa0995-6866-41ca-a938-3c51cbe7f4e8 req-5c9272c0-9bf6-4985-b902-64240a4125ab service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:25.571075 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2aaa0995-6866-41ca-a938-3c51cbe7f4e8 req-5c9272c0-9bf6-4985-b902-64240a4125ab service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:25.571075 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2aaa0995-6866-41ca-a938-3c51cbe7f4e8 req-5c9272c0-9bf6-4985-b902-64240a4125ab service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:25.571075 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2aaa0995-6866-41ca-a938-3c51cbe7f4e8 req-5c9272c0-9bf6-4985-b902-64240a4125ab service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:25.571694 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2aaa0995-6866-41ca-a938-3c51cbe7f4e8 req-5c9272c0-9bf6-4985-b902-64240a4125ab service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Processing event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:07:25.674409 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7aa5bb5c-4cf7-4d76-8fa0-7305a72b09d1 req-faec34da-f230-4593-b72a-0120e3891e31 service nova] Releasing lock "refresh_cache-52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:25.682358 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5cc6a3ee-5b3b-4c10-a40f-a8a814e44db4 tempest-ServerActionsTestOtherA-1786604563 tempest-ServerActionsTestOtherA-1786604563-project-member] [instance: 225ad6d6-6422-4bab-994c-fcc6c720b0ea] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:25.747622 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:25.761986 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:25.766300 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:25.791146 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:26.278885 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:07:26.280962 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923246.2799213, 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:26.280962 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] VM Started (Lifecycle Event)
May 27 23:07:26.282319 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:07:26.285246 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:26.286233 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance spawned successfully.
May 27 23:07:26.286808 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:26.288217 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No VIF found with MAC fa:16:3e:2a:b7:2e, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:07:26.288217 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:07:26.289115 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Using config drive
May 27 23:07:26.558295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "225950be-cc72-44aa-8ec2-54a94cb5efdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:26.558465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:26.558633 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:26.558761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:26.558921 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:26.560919 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Terminating instance
May 27 23:07:26.788048 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:26.790841 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:07:26.797838 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:26.804365 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:26.804365 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:26.807404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:26.807404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:26.807404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:26.807404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:26.935671 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Creating config drive at /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk.config
May 27 23:07:26.940269 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmryh2yj3 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:27.004645 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmryh2yj3" returned: 0 in 0.064s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:27.064847 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:07:27.103159 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.106588 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.134555 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.284214 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.292201 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.300651 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:07:27.302120 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923247.3008382, 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:27.302120 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] VM Paused (Lifecycle Event)
May 27 23:07:27.315600 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Took 6.99 seconds to spawn the instance on the hypervisor.
May 27 23:07:27.315837 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:27.389145 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-44828ff8-1beb-453a-8c5d-bc7148ea5dd6 req-2e5d05e7-f378-4d76-979a-823dfc26e6c7 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Received event network-vif-unplugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:27.389455 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-44828ff8-1beb-453a-8c5d-bc7148ea5dd6 req-2e5d05e7-f378-4d76-979a-823dfc26e6c7 service nova] Acquiring lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:27.389696 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-44828ff8-1beb-453a-8c5d-bc7148ea5dd6 req-2e5d05e7-f378-4d76-979a-823dfc26e6c7 service nova] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:27.389878 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-44828ff8-1beb-453a-8c5d-bc7148ea5dd6 req-2e5d05e7-f378-4d76-979a-823dfc26e6c7 service nova] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:27.390062 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-44828ff8-1beb-453a-8c5d-bc7148ea5dd6 req-2e5d05e7-f378-4d76-979a-823dfc26e6c7 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] No waiting events found dispatching network-vif-unplugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:27.390549 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-44828ff8-1beb-453a-8c5d-bc7148ea5dd6 req-2e5d05e7-f378-4d76-979a-823dfc26e6c7 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Received event network-vif-unplugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:07:27.460054 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.581007 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Instance destroyed successfully.
May 27 23:07:27.582116 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'resources' on Instance uuid 225950be-cc72-44aa-8ec2-54a94cb5efdd {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:27.602790 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.635923 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.636978 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.677961 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7f578434-ae21-48be-a20d-05523ed47538 req-a66b9048-1cdd-4677-845b-cd572e9e10c9 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:27.678188 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7f578434-ae21-48be-a20d-05523ed47538 req-a66b9048-1cdd-4677-845b-cd572e9e10c9 service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:27.678434 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7f578434-ae21-48be-a20d-05523ed47538 req-a66b9048-1cdd-4677-845b-cd572e9e10c9 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:27.678604 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7f578434-ae21-48be-a20d-05523ed47538 req-a66b9048-1cdd-4677-845b-cd572e9e10c9 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:27.678773 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7f578434-ae21-48be-a20d-05523ed47538 req-a66b9048-1cdd-4677-845b-cd572e9e10c9 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] No waiting events found dispatching network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:27.679208 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-7f578434-ae21-48be-a20d-05523ed47538 req-a66b9048-1cdd-4677-845b-cd572e9e10c9 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received unexpected event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b for instance with vm_state active and task_state None.
May 27 23:07:27.724682 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.751536 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.805374 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:27.809008 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923247.8087683, 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:27.809172 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] VM Resumed (Lifecycle Event)
May 27 23:07:27.829254 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Took 12.67 seconds to build instance.
May 27 23:07:27.960689 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.971278 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.975270 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:27.998344 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:28.085754 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1511234911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumemultiattachtest-server-1511234911',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:20Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-palw9ecu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:07:21Z,user_data=None,user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=225950be-cc72-44aa-8ec2-54a94cb5efdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "address": "fa:16:3e:bf:ef:a9", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba38e25-b2", "ovs_interfaceid": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:07:28.085754 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "address": "fa:16:3e:bf:ef:a9", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba38e25-b2", "ovs_interfaceid": "cba38e25-b2fa-40fc-bf31-f34bb4e3b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:28.086083 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ef:a9,bridge_name='br-int',has_traffic_filtering=True,id=cba38e25-b2fa-40fc-bf31-f34bb4e3b29e,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba38e25-b2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:28.086349 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ef:a9,bridge_name='br-int',has_traffic_filtering=True,id=cba38e25-b2fa-40fc-bf31-f34bb4e3b29e,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba38e25-b2') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:07:28.088538 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:28.088538 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcba38e25-b2, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:28.091138 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:28.091138 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:28.091138 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:28.091491 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:28.091491 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d1b54f0-15ea-43b3-b46a-a9432339fb2b) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:28.095091 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:28.095091 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:28.095091 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:28.097917 np0000001565 nova-compute[98289]: INFO os_vif [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:ef:a9,bridge_name='br-int',has_traffic_filtering=True,id=cba38e25-b2fa-40fc-bf31-f34bb4e3b29e,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba38e25-b2')
May 27 23:07:28.144545 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:07:28.144954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcb561c7-ec7f-4962-be59-c006aae726cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:28.145102 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:28.145485 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:28.145778 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcb561c7-ec7f-4962-be59-c006aae726cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:07:28.145934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:07:28.181135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:28.181135 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:28.181135 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:28.181135 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:28.181135 np0000001565 nova-compute[98289]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:28.181135 np0000001565 nova-compute[98289]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:28.181135 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:28.181470 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:28.181470 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:28.181470 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:28.181470 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:28.181470 np0000001565 nova-compute[98289]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:28.181470 np0000001565 nova-compute[98289]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf (non-flash)
May 27 23:07:28.181470 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:28.181666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', '71')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:07:28.181666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', '71')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:28.182649 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf', '70')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:28.183452 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e587dd080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf'): ({'sdf'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:07:28.183673 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:07:28.184466 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flush multipath device 330000000d3b78188 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:07:28.249901 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:07:28.298010 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:07:28.316870 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:28.323364 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:07:28.330840 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.180s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:28.343068 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:07:28.343384 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:07:28.344769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:07:28.359523 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:07:28.359738 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:07:28.374172 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:28.414220 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf, portal: 192.168.40.100,3260]
May 27 23:07:28.414220 np0000001565 nova-compute[98289]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf, portal: 192.168.40.100,3260] successful.
May 27 23:07:28.414220 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:28.430440 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:28.443128 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:28.472355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf, portal: 192.168.50.100,3260]
May 27 23:07:28.472355 np0000001565 nova-compute[98289]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-dcb561c7-ec7f-4962-be59-c006aae726cf, portal: 192.168.50.100,3260] successful.
May 27 23:07:28.472355 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:28.490667 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:28.490900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:28.491031 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== disconnect_volume: return (346ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:28.491157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:07:28.491413 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Deleting instance files /opt/stack/data/nova/instances/225950be-cc72-44aa-8ec2-54a94cb5efdd_del
May 27 23:07:28.491852 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Deletion of /opt/stack/data/nova/instances/225950be-cc72-44aa-8ec2-54a94cb5efdd_del complete
May 27 23:07:28.606588 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:28.826839 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99963619800019 future=<Future at 0x726e6056b950 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:28.827255 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99923826300028 future=<Future at 0x726e6056b950 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:28.827324 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999036024000361 future=<Future at 0x726e6056b950 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:28.827685 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923248.8274517, 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:28.827853 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] VM Started (Lifecycle Event)
May 27 23:07:29.005907 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Took 1.94 seconds to destroy the instance on the hypervisor.
May 27 23:07:29.006737 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:07:29.007096 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:07:29.007213 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:07:29.007491 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:29.066594 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:29.303297 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:29.331102 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:29.338896 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923249.338608, 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:29.338979 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] VM Paused (Lifecycle Event)
May 27 23:07:29.450367 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Received event network-vif-unplugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:29.450552 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] Acquiring lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:29.450715 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:29.450855 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:29.450971 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] No waiting events found dispatching network-vif-unplugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:29.451076 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Received event network-vif-unplugged-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:07:29.451174 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-changed-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:29.451282 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Refreshing instance network info cache due to event network-changed-da08a446-879f-4bdd-9ac4-5d3d736fc30b. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:07:29.451435 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] Acquiring lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:29.451656 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] Acquired lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:29.451656 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Refreshing network info cache for port da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:07:29.758162 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-28f80fbd-c8e8-4442-b61d-7dc6ef12f973 req-c8915b7f-042d-4d11-9c2f-c788e080b809 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Received event network-vif-deleted-cba38e25-b2fa-40fc-bf31-f34bb4e3b29e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:29.758464 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-28f80fbd-c8e8-4442-b61d-7dc6ef12f973 req-c8915b7f-042d-4d11-9c2f-c788e080b809 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Neutron deleted interface cba38e25-b2fa-40fc-bf31-f34bb4e3b29e; detaching it from the instance and deleting it from the info cache
May 27 23:07:29.759814 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-28f80fbd-c8e8-4442-b61d-7dc6ef12f973 req-c8915b7f-042d-4d11-9c2f-c788e080b809 service nova] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Detach interface failed, port_id=cba38e25-b2fa-40fc-bf31-f34bb4e3b29e, reason: Instance 225950be-cc72-44aa-8ec2-54a94cb5efdd could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:07:29.842088 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:29.845084 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:29.849566 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:07:29.955197 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:30.259651 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:30.345053 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Took 1.34 seconds to deallocate network for instance.
May 27 23:07:30.352059 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:07:30.392232 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Updated VIF entry in instance network info cache for port da08a446-879f-4bdd-9ac4-5d3d736fc30b. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:07:30.392537 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Updating instance_info_cache with network_info: [{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:30.894244 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8b7a014c-626a-43c8-a888-54e408cfa258 req-d87442ad-dfb3-49b6-b730-14dd4d849f5d service nova] Releasing lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:30.900111 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Took 0.55 seconds to detach 1 volumes for instance.
May 27 23:07:31.411489 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:31.411748 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:31.847291 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0e2bee59-38f9-4c1d-85f8-95c62b591224 req-cb8631f7-4b5c-4bd5-a54f-5531855d2c17 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Received event network-vif-plugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:31.849268 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0e2bee59-38f9-4c1d-85f8-95c62b591224 req-cb8631f7-4b5c-4bd5-a54f-5531855d2c17 service nova] Acquiring lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:31.849268 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0e2bee59-38f9-4c1d-85f8-95c62b591224 req-cb8631f7-4b5c-4bd5-a54f-5531855d2c17 service nova] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:31.849268 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0e2bee59-38f9-4c1d-85f8-95c62b591224 req-cb8631f7-4b5c-4bd5-a54f-5531855d2c17 service nova] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:31.849268 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0e2bee59-38f9-4c1d-85f8-95c62b591224 req-cb8631f7-4b5c-4bd5-a54f-5531855d2c17 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Processing event network-vif-plugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:07:31.849268 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0e2bee59-38f9-4c1d-85f8-95c62b591224 req-cb8631f7-4b5c-4bd5-a54f-5531855d2c17 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Received event network-vif-plugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:31.849268 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0e2bee59-38f9-4c1d-85f8-95c62b591224 req-cb8631f7-4b5c-4bd5-a54f-5531855d2c17 service nova] Acquiring lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:31.849268 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0e2bee59-38f9-4c1d-85f8-95c62b591224 req-cb8631f7-4b5c-4bd5-a54f-5531855d2c17 service nova] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:31.849268 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0e2bee59-38f9-4c1d-85f8-95c62b591224 req-cb8631f7-4b5c-4bd5-a54f-5531855d2c17 service nova] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:31.849268 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0e2bee59-38f9-4c1d-85f8-95c62b591224 req-cb8631f7-4b5c-4bd5-a54f-5531855d2c17 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] No waiting events found dispatching network-vif-plugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:31.849268 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-0e2bee59-38f9-4c1d-85f8-95c62b591224 req-cb8631f7-4b5c-4bd5-a54f-5531855d2c17 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Received unexpected event network-vif-plugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d for instance with vm_state building and task_state spawning.
May 27 23:07:31.849708 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:07:31.852162 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923251.851795, 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:31.852830 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] VM Resumed (Lifecycle Event)
May 27 23:07:31.854707 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:07:31.863491 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Instance spawned successfully.
May 27 23:07:31.863921 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:07:31.991685 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:31.992032 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:32.360723 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:32.363837 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:07:32.373307 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:32.373307 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:32.373547 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:32.373772 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:32.373998 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:32.376377 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:32.496500 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:32.644461 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:32.868319 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:07:32.881012 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Took 9.84 seconds to spawn the instance on the hypervisor.
May 27 23:07:32.881152 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:33.007514 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.596s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:33.068824 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Deleted allocations for instance 225950be-cc72-44aa-8ec2-54a94cb5efdd
May 27 23:07:33.094482 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:33.395071 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Took 15.93 seconds to build instance.
May 27 23:07:33.605273 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:33.612516 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:33.612724 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:33.612827 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Shelving
May 27 23:07:33.896427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.435s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:34.083838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-37a7f7a2-7bcd-4971-972d-f4a0d979ae45 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "225950be-cc72-44aa-8ec2-54a94cb5efdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.525s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:34.649492 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:34.653751 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:34.670555 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:34.680662 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:34.697325 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:34.703042 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999763326999982 future=<Future at 0x726e38684320 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Instance destroyed successfully.
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'numa_topology' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2098e462-9597-4790-b2fc-d6ec20363e43 req-dd8a7d08-7334-4f1a-885c-edd2f371a7fe service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Received event network-changed-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2098e462-9597-4790-b2fc-d6ec20363e43 req-dd8a7d08-7334-4f1a-885c-edd2f371a7fe service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Refreshing instance network info cache due to event network-changed-b0d3ed57-0a73-4f63-9330-eb4626f68f3d. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2098e462-9597-4790-b2fc-d6ec20363e43 req-dd8a7d08-7334-4f1a-885c-edd2f371a7fe service nova] Acquiring lock "refresh_cache-52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2098e462-9597-4790-b2fc-d6ec20363e43 req-dd8a7d08-7334-4f1a-885c-edd2f371a7fe service nova] Acquired lock "refresh_cache-52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2098e462-9597-4790-b2fc-d6ec20363e43 req-dd8a7d08-7334-4f1a-885c-edd2f371a7fe service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Refreshing network info cache for port b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Beginning cold snapshot process
May 27 23:07:35.779179 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2098e462-9597-4790-b2fc-d6ec20363e43 req-dd8a7d08-7334-4f1a-885c-edd2f371a7fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:36.137078 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2098e462-9597-4790-b2fc-d6ec20363e43 req-dd8a7d08-7334-4f1a-885c-edd2f371a7fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:36.266077 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2098e462-9597-4790-b2fc-d6ec20363e43 req-dd8a7d08-7334-4f1a-885c-edd2f371a7fe service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Updated VIF entry in instance network info cache for port b0d3ed57-0a73-4f63-9330-eb4626f68f3d. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:07:36.266356 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2098e462-9597-4790-b2fc-d6ec20363e43 req-dd8a7d08-7334-4f1a-885c-edd2f371a7fe service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Updating instance_info_cache with network_info: [{"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:36.342592 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c3ca921-a4d0-426f-bca5-d0784d49f56b req-32d75587-1444-48e4-90c3-fe0247dcb78c service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:36.343938 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c3ca921-a4d0-426f-bca5-d0784d49f56b req-32d75587-1444-48e4-90c3-fe0247dcb78c service nova] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:36.345134 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c3ca921-a4d0-426f-bca5-d0784d49f56b req-32d75587-1444-48e4-90c3-fe0247dcb78c service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:36.345134 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c3ca921-a4d0-426f-bca5-d0784d49f56b req-32d75587-1444-48e4-90c3-fe0247dcb78c service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:36.345134 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c3ca921-a4d0-426f-bca5-d0784d49f56b req-32d75587-1444-48e4-90c3-fe0247dcb78c service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] No waiting events found dispatching network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:36.345134 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-0c3ca921-a4d0-426f-bca5-d0784d49f56b req-32d75587-1444-48e4-90c3-fe0247dcb78c service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received unexpected event network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 for instance with vm_state active and task_state shelving_image_uploading.
May 27 23:07:36.768210 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2098e462-9597-4790-b2fc-d6ec20363e43 req-dd8a7d08-7334-4f1a-885c-edd2f371a7fe service nova] Releasing lock "refresh_cache-52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:37.110215 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:07:37.110590 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk /opt/stack/data/nova/instances/snapshots/tmp686dh3j7/011da47ade804a76ae26fa60aa8bf7ec {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:37.318192 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk /opt/stack/data/nova/instances/snapshots/tmp686dh3j7/011da47ade804a76ae26fa60aa8bf7ec" returned: 0 in 0.207s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:37.318681 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Snapshot extracted, beginning image upload
May 27 23:07:38.031778 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:38.032486 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:38.032818 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:38.032965 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:38.033096 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:38.035297 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Terminating instance
May 27 23:07:38.096558 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:38.407793 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5b07da20-8aa0-496b-9f1e-802d3633543d req-792b839f-3421-445f-86d4-93dd16bc0197 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:38.408295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5b07da20-8aa0-496b-9f1e-802d3633543d req-792b839f-3421-445f-86d4-93dd16bc0197 service nova] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:38.408517 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5b07da20-8aa0-496b-9f1e-802d3633543d req-792b839f-3421-445f-86d4-93dd16bc0197 service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:38.408641 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5b07da20-8aa0-496b-9f1e-802d3633543d req-792b839f-3421-445f-86d4-93dd16bc0197 service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:38.408758 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5b07da20-8aa0-496b-9f1e-802d3633543d req-792b839f-3421-445f-86d4-93dd16bc0197 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] No waiting events found dispatching network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:38.408934 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5b07da20-8aa0-496b-9f1e-802d3633543d req-792b839f-3421-445f-86d4-93dd16bc0197 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received unexpected event network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 for instance with vm_state active and task_state shelving_image_uploading.
May 27 23:07:38.540815 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:07:38.579201 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:38.589184 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:38.606045 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:38.762836 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:38.772240 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:38.860879 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99971172100004 future=<Future at 0x726e38704980 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:38.862922 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Instance destroyed successfully.
May 27 23:07:38.863519 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'resources' on Instance uuid a6723b2d-e0b1-495c-910d-3ef37d877c05 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:39.366049 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='multiattach-server-1',id=27,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:06:19Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-iujlpdk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a6723b2d-e0b1-495c-910d-3ef37d877c05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:07:39.366584 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "address": "fa:16:3e:df:36:53", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap112f36c6-7f", "ovs_interfaceid": "112f36c6-7fa0-4a72-9edf-c9421eccd857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:39.366879 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:39.367133 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:07:39.371316 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:39.371316 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap112f36c6-7f, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:39.373693 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:39.381707 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:39.383842 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:39.383910 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f224576a-7fec-4096-a5db-42b58bdce0f4) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:39.385311 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:39.385452 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:39.391488 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:39.394518 np0000001565 nova-compute[98289]: INFO os_vif [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:36:53,bridge_name='br-int',has_traffic_filtering=True,id=112f36c6-7fa0-4a72-9edf-c9421eccd857,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112f36c6-7f')
May 27 23:07:39.394518 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Deleting instance files /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05_del
May 27 23:07:39.407241 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Deletion of /opt/stack/data/nova/instances/a6723b2d-e0b1-495c-910d-3ef37d877c05_del complete
May 27 23:07:39.880551 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Snapshot image upload complete
May 27 23:07:39.881048 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:39.915441 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Took 1.37 seconds to destroy the instance on the hypervisor.
May 27 23:07:39.916107 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:07:39.916410 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:07:39.916569 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:07:39.916825 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:39.982795 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:40.183891 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:40.184231 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:40.387271 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Shelve offloading
May 27 23:07:40.449599 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-94b70c01-a208-4ef3-8509-753cae298e0a req-80f8028f-c0ef-4de7-915d-93fc655f244f service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Received event network-vif-deleted-112f36c6-7fa0-4a72-9edf-c9421eccd857 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:40.449982 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-94b70c01-a208-4ef3-8509-753cae298e0a req-80f8028f-c0ef-4de7-915d-93fc655f244f service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Neutron deleted interface 112f36c6-7fa0-4a72-9edf-c9421eccd857; detaching it from the instance and deleting it from the info cache
May 27 23:07:40.451519 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-94b70c01-a208-4ef3-8509-753cae298e0a req-80f8028f-c0ef-4de7-915d-93fc655f244f service nova] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Detach interface failed, port_id=112f36c6-7fa0-4a72-9edf-c9421eccd857, reason: Instance a6723b2d-e0b1-495c-910d-3ef37d877c05 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:07:40.685626 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:07:40.893974 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Instance destroyed successfully.
May 27 23:07:40.894488 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:40.895871 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:40.896028 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquired lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:40.896212 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:07:40.903701 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:41.231134 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:41.231310 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:41.233916 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:07:41.234052 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Claim successful on node np0000001565
May 27 23:07:41.398629 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:41.405653 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Took 1.49 seconds to deallocate network for instance.
May 27 23:07:41.680465 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:41.812545 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updating instance_info_cache with network_info: [{"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:41.921128 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:42.315485 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Releasing lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:42.315758 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:42.315933 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:42.739284 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:42.739590 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:42.784610 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Instance destroyed successfully.
May 27 23:07:42.785060 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'resources' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:42.835023 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fa7dfbc5-f016-4e08-b3d3-7e2777be3a20 req-eddfe8e7-8fe5-410c-83f7-927472b560e6 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-changed-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:42.835577 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fa7dfbc5-f016-4e08-b3d3-7e2777be3a20 req-eddfe8e7-8fe5-410c-83f7-927472b560e6 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Refreshing instance network info cache due to event network-changed-fcd4468c-2b77-4da0-a875-6375149e0a09. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:07:42.835919 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fa7dfbc5-f016-4e08-b3d3-7e2777be3a20 req-eddfe8e7-8fe5-410c-83f7-927472b560e6 service nova] Acquiring lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:42.836116 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fa7dfbc5-f016-4e08-b3d3-7e2777be3a20 req-eddfe8e7-8fe5-410c-83f7-927472b560e6 service nova] Acquired lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:42.836394 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fa7dfbc5-f016-4e08-b3d3-7e2777be3a20 req-eddfe8e7-8fe5-410c-83f7-927472b560e6 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Refreshing network info cache for port fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:07:43.243362 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:43.286843 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<a58d20c9-5038-4ea3-842e-406b0253f15b> lazy-loaded attributes: numa_topology,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:07:43.287553 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2055205716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-2055205716',id=34,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlXgwR+mJL4X62uviA59Sg2o4dXlvjOmgIlg6odsB10BjNBoGqu01/G0GMdVvx7UUCkjG6N+PhuPE4wyV5SToTI9u2Z8MdBW6kzcc68Hmu+/strmT6yCpg+Ql8+rNl3eg==',key_name='tempest-keypair-1961618511',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:06:52Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-j4dw1ehs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member',shelved_at='2026-05-27T23:07:39.880608',shelved_host='np0000001565',shelved_image_id='7b680bab-7ed7-4861-8133-c3f90c2ad838'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:07:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=a58d20c9-5038-4ea3-842e-406b0253f15b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:07:43.287836 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:43.288417 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:43.288568 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:07:43.289574 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:43.289818 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcd4468c-2b, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:43.292041 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:43.292041 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:43.293468 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:43.294223 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:43.294381 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebda74aa-4c39-4b01-b5a0-655721c26ee7) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:43.296434 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:43.296434 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:43.296434 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:43.297830 np0000001565 nova-compute[98289]: INFO os_vif [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b')
May 27 23:07:43.298133 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Deleting instance files /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b_del
May 27 23:07:43.303832 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Deletion of /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b_del complete
May 27 23:07:43.339023 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-fa7dfbc5-f016-4e08-b3d3-7e2777be3a20 req-eddfe8e7-8fe5-410c-83f7-927472b560e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:43.608108 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:43.670993 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-fa7dfbc5-f016-4e08-b3d3-7e2777be3a20 req-eddfe8e7-8fe5-410c-83f7-927472b560e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:43.750371 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.519s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:43.751205 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.831s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:43.751400 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:07:43.827693 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0013253939996502595 future=<Future at 0x726e6056b950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:43.827814 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:43.827939 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.136947209000027 future=<Future at 0x726e38684320 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:43.828031 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.136839767999845 future=<Future at 0x726e38684320 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:43.828404 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] Emitting event <LifecycleEvent: 1779923248.82627, 225950be-cc72-44aa-8ec2-54a94cb5efdd => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:43.828862 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] VM Stopped (Lifecycle Event)
May 27 23:07:43.834145 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fa7dfbc5-f016-4e08-b3d3-7e2777be3a20 req-eddfe8e7-8fe5-410c-83f7-927472b560e6 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updated VIF entry in instance network info cache for port fcd4468c-2b77-4da0-a875-6375149e0a09. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:07:43.834466 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fa7dfbc5-f016-4e08-b3d3-7e2777be3a20 req-eddfe8e7-8fe5-410c-83f7-927472b560e6 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updating instance_info_cache with network_info: [{"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:43.870950 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Deleted allocations for instance a58d20c9-5038-4ea3-842e-406b0253f15b
May 27 23:07:44.261393 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:07:44.261393 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:07:44.261393 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:44.261929 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:44.270476 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:44.270662 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:44.331961 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5f6ddc9-8fa7-4bd2-93fc-eb2bbd16da3e tempest-TaggedBootDevicesTest-439981373 tempest-TaggedBootDevicesTest-439981373-project-member] [instance: 225950be-cc72-44aa-8ec2-54a94cb5efdd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:44.336303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fa7dfbc5-f016-4e08-b3d3-7e2777be3a20 req-eddfe8e7-8fe5-410c-83f7-927472b560e6 service nova] Releasing lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:44.355059 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e16486bc9a2b451788f9c61df0c20472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5d1153ffbc42b5863df7b2db23eaec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:07:44.376869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:44.764294 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:07:44.773275 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:44.917343 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Successfully created port: 0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:07:45.123816 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:45.267633 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:07:45.281918 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.531s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:45.284046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.905s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:45.392013 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Deleted allocations for instance a6723b2d-e0b1-495c-910d-3ef37d877c05
May 27 23:07:45.495424 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Successfully updated port: 0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:07:45.569758 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-700eed52-3c00-409b-8aae-74510127e1ca req-671feb38-3bfb-4b79-9d4e-1af36c99d6e5 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-changed-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:45.570125 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-700eed52-3c00-409b-8aae-74510127e1ca req-671feb38-3bfb-4b79-9d4e-1af36c99d6e5 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Refreshing instance network info cache due to event network-changed-0ec6133d-baba-415d-82ec-9cbe8dfb935f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:07:45.570616 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-700eed52-3c00-409b-8aae-74510127e1ca req-671feb38-3bfb-4b79-9d4e-1af36c99d6e5 service nova] Acquiring lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:45.570926 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-700eed52-3c00-409b-8aae-74510127e1ca req-671feb38-3bfb-4b79-9d4e-1af36c99d6e5 service nova] Acquired lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:45.571085 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-700eed52-3c00-409b-8aae-74510127e1ca req-671feb38-3bfb-4b79-9d4e-1af36c99d6e5 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Refreshing network info cache for port 0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:07:45.632542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:45.773055 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Booting with volume cc739915-bed4-402d-afff-e7278e2139c6 at /dev/vda
May 27 23:07:45.839931 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:45.841026 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:45.841243 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:45.857538 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:07:45.883575 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:45.925731 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:07:45.925731 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:07:45.935416 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:07:45.937895 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe62:f3f7', 'fe80::fc16:3eff:fe4e:50c', 'fe80::fc16:3eff:feae:d8ed', 'fe80::4835:1aff:fe2f:6c9d', 'fe80::fc16:3eff:fe8a:26c4', 'fe80::70b0:20ff:fe1f:52b3', 'fe80::fc16:3eff:fe2a:b72e', 'fe80::4cb6:a6ff:feaf:184a'] 
May 27 23:07:45.938042 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:07:45.938176 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:07:45.938444 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:45.938661 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating existing volume attachment record: fc908591-6fca-44b5-b41d-c78eb8b4cb5d {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:07:45.998200 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:46.075178 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-700eed52-3c00-409b-8aae-74510127e1ca req-671feb38-3bfb-4b79-9d4e-1af36c99d6e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:46.147418 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-700eed52-3c00-409b-8aae-74510127e1ca req-671feb38-3bfb-4b79-9d4e-1af36c99d6e5 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:07:46.315563 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-700eed52-3c00-409b-8aae-74510127e1ca req-671feb38-3bfb-4b79-9d4e-1af36c99d6e5 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:46.349919 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:46.410488 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb325df3-3750-4886-8240-1af2654e7369 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a6723b2d-e0b1-495c-910d-3ef37d877c05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.378s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:46.817444 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-700eed52-3c00-409b-8aae-74510127e1ca req-671feb38-3bfb-4b79-9d4e-1af36c99d6e5 service nova] Releasing lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:46.819284 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquired lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:46.819517 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:07:46.861311 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.579s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:46.872561 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.229s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:46.872923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:46.873189 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.011s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:46.873681 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:07:47.377104 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-66b0cdfb-b43c-4cc8-8586-46e2b4ebe771 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.764s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:47.378255 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.507s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:47.378494 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Unshelving
May 27 23:07:47.391050 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:07:47.546601 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:47.634688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:47.634688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:47.634688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:47.634688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:47.634688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:47.635486 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Terminating instance
May 27 23:07:47.641458 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Rebuilding instance
May 27 23:07:47.695518 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating instance_info_cache with network_info: [{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:47.794451 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:47.911128 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:07:47.911128 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:47.996381 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:47.996987 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:48.088677 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:07:48.091419 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:07:48.091756 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Creating image(s)
May 27 23:07:48.092286 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:07:48.092472 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Ensure instance console log exists: /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:07:48.092955 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:48.093258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:48.093876 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:48.094038 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:48.096439 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:48.140628 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:07:48.164180 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.166863 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.194255 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.196804 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Releasing lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:48.197385 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Instance network_info: |[{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:07:48.198600 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Start _get_guest_xml network_info=[{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fc908591-6fca-44b5-b41d-c78eb8b4cb5d', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd099633e-fe8f-425b-b486-3f325ce97d12', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'serial': 'cc739915-bed4-402d-afff-e7278e2139c6'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:07:48.206917 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:07:48.208621 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1892961998', uuid='d099633e-fe8f-425b-b486-3f325ce97d12'), owner=OwnerMeta(userid='e16486bc9a2b451788f9c61df0c20472', username='tempest-TestShelveInstance-1900497856-project-member', projectid='ce5d1153ffbc42b5863df7b2db23eaec', projectname='tempest-TestShelveInstance-1900497856'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923268.2080815) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:07:48.212354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:07:48.212354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:07:48.212354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:07:48.212354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:07:48.213674 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:07:48.214056 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:07:48.214239 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:07:48.214405 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:07:48.214644 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:07:48.218789 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:07:48.218845 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:07:48.219090 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:07:48.219224 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:07:48.219521 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:07:48.219664 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:07:48.219828 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:07:48.239140 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:48.239640 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:48.241426 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:07:48.244989 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:48.244989 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:48.244989 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:48.244989 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:07:48.265472 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:48.265639 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:48.266409 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:48.266796 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:07:48.267632 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:48.267850 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:07:48.286349 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:07:48.286349 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:48.300045 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.305198 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6] added
May 27 23:07:48.305198 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:07:48.305198 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:48.305198 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:48.305198 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:48.305198 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:48.305198 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:48.305198 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:07:48.305554 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0388(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:07:48.305704 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:07:48.307341 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:07:48.307341 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:48.322020 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6] added
May 27 23:07:48.322020 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:07:48.322020 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:48.322020 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:48.322020 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:07:48.322020 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:07:48.322020 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:48.322231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:07:48.322486 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0546(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:07:48.322695 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:07:48.357498 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:48.361749 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1496b264-b1d7-42d2-b80b-e186c6d33db2 req-a8734d64-4f9e-4ee5-b843-6ff4fa417636 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:48.364192 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:48.364429 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1496b264-b1d7-42d2-b80b-e186c6d33db2 req-a8734d64-4f9e-4ee5-b843-6ff4fa417636 service nova] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:48.364651 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1496b264-b1d7-42d2-b80b-e186c6d33db2 req-a8734d64-4f9e-4ee5-b843-6ff4fa417636 service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:48.365059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1496b264-b1d7-42d2-b80b-e186c6d33db2 req-a8734d64-4f9e-4ee5-b843-6ff4fa417636 service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:48.365203 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1496b264-b1d7-42d2-b80b-e186c6d33db2 req-a8734d64-4f9e-4ee5-b843-6ff4fa417636 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] No waiting events found dispatching network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:48.365365 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1496b264-b1d7-42d2-b80b-e186c6d33db2 req-a8734d64-4f9e-4ee5-b843-6ff4fa417636 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:07:48.380502 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.385072 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.457115 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:48.457448 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:48.464046 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'pci_requests' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:48.466374 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:48.466854 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:48.488851 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998922686999776 future=<Future at 0x726e583832c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:48.495283 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Instance destroyed successfully.
May 27 23:07:48.496170 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'resources' on Instance uuid a7839c43-8fd9-4deb-81c9-f128963f09ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:48.555095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:48.557575 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:48.625666 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.646852 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:48.647345 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:48.728966 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:48.733245 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:48.818960 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:48.819561 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:48.830548 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.849461 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.855048 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.876611 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.885989 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:48.903431 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:48.969133 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'numa_topology' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:48.977564 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-203e8da6-8a72-44bb-8b56-0409bc3be800 req-a2ab0f13-52cb-4400-b1cf-6e696424888a service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:48.977564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-203e8da6-8a72-44bb-8b56-0409bc3be800 req-a2ab0f13-52cb-4400-b1cf-6e696424888a service nova] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:48.977804 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-203e8da6-8a72-44bb-8b56-0409bc3be800 req-a2ab0f13-52cb-4400-b1cf-6e696424888a service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:48.977957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-203e8da6-8a72-44bb-8b56-0409bc3be800 req-a2ab0f13-52cb-4400-b1cf-6e696424888a service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:48.978322 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-203e8da6-8a72-44bb-8b56-0409bc3be800 req-a2ab0f13-52cb-4400-b1cf-6e696424888a service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] No waiting events found dispatching network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:48.979039 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-203e8da6-8a72-44bb-8b56-0409bc3be800 req-a2ab0f13-52cb-4400-b1cf-6e696424888a service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received unexpected event network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f for instance with vm_state active and task_state rebuilding.
May 27 23:07:48.999962 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001565',hostname='multiattach-server-0',id=25,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:05:21Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-wa242kn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:05:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=a7839c43-8fd9-4deb-81c9-f128963f09ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:07:48.999962 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "e837edcc-48f7-475e-ab37-e584deffe1c5", "address": "fa:16:3e:4e:05:0c", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape837edcc-48", "ovs_interfaceid": "e837edcc-48f7-475e-ab37-e584deffe1c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:49.000540 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:49.000754 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:07:49.002392 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.002895 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape837edcc-48, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:49.004256 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.005354 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:49.011027 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.012542 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.012768 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04db655f-4701-4065-90e3-a78c5fc5b782) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:49.013633 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.014087 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:49.019513 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:07:49.021415 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.022933 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:07:49.023879 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:49.038925 np0000001565 nova-compute[98289]: INFO os_vif [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:05:0c,bridge_name='br-int',has_traffic_filtering=True,id=e837edcc-48f7-475e-ab37-e584deffe1c5,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape837edcc-48')
May 27 23:07:49.040718 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Deleting instance files /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec_del
May 27 23:07:49.048571 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Deletion of /opt/stack/data/nova/instances/a7839c43-8fd9-4deb-81c9-f128963f09ec_del complete
May 27 23:07:49.067159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:49.067584 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=11627MB free_disk=73.96522521972656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:07:49.067786 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:49.102612 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.108727 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.124738 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99971658100003 future=<Future at 0x726e605975f0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:49.126071 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Instance destroyed successfully.
May 27 23:07:49.129991 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Instance destroyed successfully.
May 27 23:07:49.131159 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1596944221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionsv293testjson-server-440667466',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFF3ms/ZqADOPwQwgUDiksAV+TViqkb1xsZUeFJ9fXMFHAkOuFmlFD+buNkeEJSOa3xWsXInFjzmeNVuvHjuUmcUVOW9fKpVE4pVSKRmEFjcniprzLTbopfmOVDNzn6w==',key_name='tempest-keypair-482168530',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:17Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='932825702de943b48bbcada3b5763dac',ramdisk_id='',reservation_id='r-z6zy7sr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-984365273',owner_user_name='tempest-ServerActionsV293TestJSON-984365273-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4451943f43444436bf50809c8ab7f0d3',uuid=77ce6750-3568-4e9b-b99e-c1a7964536d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:07:49.131628 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converting VIF {"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:49.132287 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:49.132548 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:07:49.133894 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.134147 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61237f5f-32, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:49.136082 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.136878 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:49.137131 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.137849 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.137982 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a14f78fb-abae-43ee-90a9-e434d2622d35) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:49.138514 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.138918 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:49.139241 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:49.141038 np0000001565 nova-compute[98289]: INFO os_vif [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32')
May 27 23:07:49.142306 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:07:49.142703 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:49.142841 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:49.306233 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:07:49.317828 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:07:49.317828 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:49.323282 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:07:49.328121 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:07:49.334941 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:07:49.334941 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:49.342836 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.342836 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.342836 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.342836 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.342836 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:49.343018 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.343018 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.343018 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.343018 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.343018 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:49.347529 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:49.362025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.362025 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.362025 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.362025 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.362025 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:49.362025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.362025 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.362025 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.362025 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.362025 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:49.377391 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.40.100,3260]
May 27 23:07:49.377391 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.40.100,3260] successful.
May 27 23:07:49.377391 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:49.389128 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:49.406051 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.50.100,3260]
May 27 23:07:49.406051 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.50.100,3260] successful.
May 27 23:07:49.406051 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:49.408058 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.408058 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.408058 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.408058 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.408058 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:49.408058 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:49.408058 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:49.408238 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.408238 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.408238 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.408238 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.408238 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:49.408238 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:49.408238 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:49.408788 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:49.408959 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:07:49.410088 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] HCTL ('11', '-', '-', 0) found on session 72 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:07:49.410244 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:07:49.421099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:49.432165 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Searching for a device in session 72 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:07:49.432165 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:07:49.438268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.438268 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.438268 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.438268 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.438268 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:49.438268 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:49.438268 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:49.438546 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.438546 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:49.438546 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.438546 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:49.438546 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:49.438546 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:49.438546 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:49.438887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:49.438887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:07:49.439512 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] HCTL ('12', '-', '-', 0) found on session 73 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:07:49.439620 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:07:49.454587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Searching for a device in session 73 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:07:49.454587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:07:49.475295 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:07:49.475568 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Claim successful on node np0000001565
May 27 23:07:49.557912 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Took 1.42 seconds to destroy the instance on the hypervisor.
May 27 23:07:49.558035 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:07:49.558675 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:07:49.558675 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:07:49.558812 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:49.633526 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:49.897325 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bf5a70a6-25f5-441a-9aac-0062aeb49bf6 req-7d144dcc-929d-4615-bf2e-abbbced55510 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-vif-deleted-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:49.897564 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-bf5a70a6-25f5-441a-9aac-0062aeb49bf6 req-7d144dcc-929d-4615-bf2e-abbbced55510 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Neutron deleted interface e837edcc-48f7-475e-ab37-e584deffe1c5; detaching it from the instance and deleting it from the info cache
May 27 23:07:49.899945 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bf5a70a6-25f5-441a-9aac-0062aeb49bf6 req-7d144dcc-929d-4615-bf2e-abbbced55510 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Detach interface failed, port_id=e837edcc-48f7-475e-ab37-e584deffe1c5, reason: Instance a7839c43-8fd9-4deb-81c9-f128963f09ec could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:07:49.965281 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003689209997901344 future=<Future at 0x726e38684320 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:49.965850 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Emitting event <LifecycleEvent: 1779923254.9648316, a58d20c9-5038-4ea3-842e-406b0253f15b => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:49.966073 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:49.966197 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] VM Stopped (Lifecycle Event)
May 27 23:07:49.967394 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.8932136809999065 future=<Future at 0x726e38704980 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:49.967542 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.893067136999889 future=<Future at 0x726e38704980 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:50.267109 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:07:50.346778 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:50.442988 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a01d3ec3-ce82-4d0f-910a-8c42fbf1c4d9 req-68ca6792-d622-423e-975a-1ccd8f7b46f2 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:50.443748 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a01d3ec3-ce82-4d0f-910a-8c42fbf1c4d9 req-68ca6792-d622-423e-975a-1ccd8f7b46f2 service nova] Acquiring lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:50.444110 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a01d3ec3-ce82-4d0f-910a-8c42fbf1c4d9 req-68ca6792-d622-423e-975a-1ccd8f7b46f2 service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:50.444324 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a01d3ec3-ce82-4d0f-910a-8c42fbf1c4d9 req-68ca6792-d622-423e-975a-1ccd8f7b46f2 service nova] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:50.444594 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a01d3ec3-ce82-4d0f-910a-8c42fbf1c4d9 req-68ca6792-d622-423e-975a-1ccd8f7b46f2 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] No waiting events found dispatching network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:50.444813 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a01d3ec3-ce82-4d0f-910a-8c42fbf1c4d9 req-68ca6792-d622-423e-975a-1ccd8f7b46f2 service nova] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Received event network-vif-unplugged-e837edcc-48f7-475e-ab37-e584deffe1c5 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:07:50.468649 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:50.848898 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Took 1.29 seconds to deallocate network for instance.
May 27 23:07:50.995775 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:50.996045 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:51.055968 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-02ceac8d-7e0e-45b1-9fe4-4d250516e577 req-fbb6fec7-4710-4e53-8b8e-c9f7eb6819fc service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:51.056230 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-02ceac8d-7e0e-45b1-9fe4-4d250516e577 req-fbb6fec7-4710-4e53-8b8e-c9f7eb6819fc service nova] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:51.056400 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-02ceac8d-7e0e-45b1-9fe4-4d250516e577 req-fbb6fec7-4710-4e53-8b8e-c9f7eb6819fc service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:51.056506 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-02ceac8d-7e0e-45b1-9fe4-4d250516e577 req-fbb6fec7-4710-4e53-8b8e-c9f7eb6819fc service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:51.056589 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-02ceac8d-7e0e-45b1-9fe4-4d250516e577 req-fbb6fec7-4710-4e53-8b8e-c9f7eb6819fc service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] No waiting events found dispatching network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:51.057006 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-02ceac8d-7e0e-45b1-9fe4-4d250516e577 req-fbb6fec7-4710-4e53-8b8e-c9f7eb6819fc service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received unexpected event network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f for instance with vm_state active and task_state rebuilding.
May 27 23:07:51.284471 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Found WWN 33000000053a926ad for multipath device dm-6 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:07:51.284837 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:51.285056 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '33000000053a926ad', 'path': '/dev/dm-6', 'multipath_id': '33000000053a926ad'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:51.285214 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000053a926ad', 'path': '/dev/dm-6', 'multipath_id': '33000000053a926ad'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:07:51.285890 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.143s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:51.286342 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:07:51.286597 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:07:51.315857 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:51.315857 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:51.315857 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:51.315857 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:51.315857 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:51.315857 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:51.315857 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:51.316112 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:51.316112 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:51.316112 np0000001565 nova-compute[98289]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:51.316112 np0000001565 nova-compute[98289]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:07:51.316112 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:51.316112 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:51.316112 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:51.316255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '73')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:07:51.316441 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '69')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:51.317936 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '68')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:51.318849 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e587f3560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'): ({'sdb'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:07:51.319069 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:07:51.319320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Flush multipath device 330000000c66bbb07 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:07:51.355314 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:51.373967 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:07:51.429865 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:07:51.485937 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:07:51.486267 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:07:51.487045 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:07:51.499020 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:51.504891 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:07:51.509353 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:07:51.522360 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:51.551575 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.40.100,3260]
May 27 23:07:51.551575 np0000001565 nova-compute[98289]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.40.100,3260] successful.
May 27 23:07:51.551575 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:51.567048 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:51.578220 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:51.608062 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.50.100,3260]
May 27 23:07:51.608062 np0000001565 nova-compute[98289]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.50.100,3260] successful.
May 27 23:07:51.608062 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:51.624666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:07:51.624907 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:51.625084 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] <== disconnect_volume: return (2482ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:51.625254 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:07:51.625549 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Deleting instance files /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0_del
May 27 23:07:51.626097 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Deletion of /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0_del complete
May 27 23:07:51.794581 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1892961998',display_name='tempest-TestShelveInstance-server-1892961998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testshelveinstance-server-1892961998',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWCU6efaHvzG5loviLci2EWhflUFzxorLb2dKK8/e4l6LBfmbsuAMiPeTHSpUAakWRl1Yt9Cuh7F6B+3kDbokEdnyEqt/j2SLnkbohJPY+gKSpX+1QSNNHsYyNbdnkWNw==',key_name='tempest-TestShelveInstance-1672332914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce5d1153ffbc42b5863df7b2db23eaec',ramdisk_id='',reservation_id='r-dl8ft992',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1900497856',owner_user_name='tempest-TestShelveInstance-1900497856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:45Z,user_data=None,user_id='e16486bc9a2b451788f9c61df0c20472',uuid=d099633e-fe8f-425b-b486-3f325ce97d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:07:51.794817 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converting VIF {"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:51.795342 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:51.796098 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lazy-loading 'pci_devices' on Instance uuid d099633e-fe8f-425b-b486-3f325ce97d12 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:52.011505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.553s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:52.011505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.943s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:52.012410 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:52.074853 np0000001565 nova-compute[98289]: INFO nova.network.neutron [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updating port fcd4468c-2b77-4da0-a875-6375149e0a09 with attributes {'binding:host_id': 'np0000001565', 'device_owner': 'compute:nova'}
May 27 23:07:52.204265 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 77ce6750-3568-4e9b-b99e-c1a7964536d0 could not be found.
May 27 23:07:52.205626 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:07:52.206084 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:07:52.206413 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:07:52.206830 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:07:52.207203 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:07:52.207467 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:52.237395 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:07:52.237395 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '73')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, 0): [] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2') {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, 0): [] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2') {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58178a40>, {}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Disconnecting from: [] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] <== disconnect_volume: return (29ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:07:52.237395 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:07:52.299844 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] End _get_guest_xml xml=<domain type="qemu">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <uuid>d099633e-fe8f-425b-b486-3f325ce97d12</uuid>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <name>instance-00000027</name>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestShelveInstance-server-1892961998</nova:name>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:07:48</nova:creationTime>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:user uuid="e16486bc9a2b451788f9c61df0c20472">tempest-TestShelveInstance-1900497856-project-member</nova:user>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:project uuid="ce5d1153ffbc42b5863df7b2db23eaec">tempest-TestShelveInstance-1900497856</nova:project>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         <nova:port uuid="0ec6133d-baba-415d-82ec-9cbe8dfb935f">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <system>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <entry name="serial">d099633e-fe8f-425b-b486-3f325ce97d12</entry>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <entry name="uuid">d099633e-fe8f-425b-b486-3f325ce97d12</entry>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     </system>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <os>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   </os>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <features>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   </features>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   <devices>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/disk.config"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <alias name="ua-cc739915-bed4-402d-afff-e7278e2139c6"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-6"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <serial>cc739915-bed4-402d-afff-e7278e2139c6</serial>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ce:1a:11"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <target dev="tap0ec6133d-ba"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     </interface>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/console.log" append="off"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     </serial>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <video>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     </video>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     </rng>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:   </devices>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]: </domain>
May 27 23:07:52.299844 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:07:52.302452 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Preparing to wait for external event network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:07:52.302452 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:52.302452 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:52.302452 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:52.304749 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1892961998',display_name='tempest-TestShelveInstance-server-1892961998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testshelveinstance-server-1892961998',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWCU6efaHvzG5loviLci2EWhflUFzxorLb2dKK8/e4l6LBfmbsuAMiPeTHSpUAakWRl1Yt9Cuh7F6B+3kDbokEdnyEqt/j2SLnkbohJPY+gKSpX+1QSNNHsYyNbdnkWNw==',key_name='tempest-TestShelveInstance-1672332914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce5d1153ffbc42b5863df7b2db23eaec',ramdisk_id='',reservation_id='r-dl8ft992',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1900497856',owner_user_name='tempest-TestShelveInstance-1900497856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:45Z,user_data=None,user_id='e16486bc9a2b451788f9c61df0c20472',uuid=d099633e-fe8f-425b-b486-3f325ce97d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:07:52.304918 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converting VIF {"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:52.305384 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:52.305663 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:07:52.306052 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:52.306369 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:52.306643 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:07:52.309019 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:52.309398 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab913ddb-104d-59c3-8a98-07a8c57e49d0', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:52.312593 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:52.312593 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:52.314418 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:52.314572 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ec6133d-ba, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:52.314918 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ec6133d-ba, col_values=(('qos', UUID('745e3424-af94-41e3-a0bb-d62f8be8c8c0')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:52.315083 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ec6133d-ba, col_values=(('external_ids', {'iface-id': '0ec6133d-baba-415d-82ec-9cbe8dfb935f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:1a:11', 'vm-uuid': 'd099633e-fe8f-425b-b486-3f325ce97d12'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:52.316145 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:52.318187 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:52.322366 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:52.323279 np0000001565 nova-compute[98289]: INFO os_vif [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba')
May 27 23:07:52.645780 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:52.646154 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquired lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:52.646264 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:07:52.699453 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8a0567bd-5621-48f4-abc6-8c48b21e0b5b req-fb3c692e-1c18-4dc8-8545-0f5b2bf8b313 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-changed-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:52.700405 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8a0567bd-5621-48f4-abc6-8c48b21e0b5b req-fb3c692e-1c18-4dc8-8545-0f5b2bf8b313 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Refreshing instance network info cache due to event network-changed-fcd4468c-2b77-4da0-a875-6375149e0a09. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:07:52.700405 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8a0567bd-5621-48f4-abc6-8c48b21e0b5b req-fb3c692e-1c18-4dc8-8545-0f5b2bf8b313 service nova] Acquiring lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:53.082606 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance f47a00cc-da92-40c9-a668-9a160670addd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:07:53.082728 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6a99f05a-6544-4994-9a1a-d98c320d088a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:07:53.082824 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6ab04c1a-7858-471e-95fd-5b04d1da3061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:07:53.082946 np0000001565 nova-compute[98289]: WARNING nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance a7839c43-8fd9-4deb-81c9-f128963f09ec is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 27 23:07:53.083036 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 77ce6750-3568-4e9b-b99e-c1a7964536d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:07:53.083125 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:07:53.083203 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:07:53.083283 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance d099633e-fe8f-425b-b486-3f325ce97d12 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:07:53.085009 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance a58d20c9-5038-4ea3-842e-406b0253f15b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:07:53.085198 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:07:53.085346 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:07:49 up 36 min,  2 users,  load average: 7.41, 6.94, 4.01\n', 'num_instances': '8', 'num_vm_active': '6', 'num_task_None': '5', 'num_os_type_None': '8', 'num_proj_0ec877dc7b2240969ac89c13673f8799': '3', 'io_workload': '2', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '2', 'num_proj_475430e1d5044d9b97a65459543a1361': '1', 'num_task_rebuilding': '1', 'num_proj_932825702de943b48bbcada3b5763dac': '1', 'num_proj_996f2d92ddf941fab9c407482cbb534e': '1', 'num_proj_8b69ef10bedf41b48b1455ae48aa534e': '1', 'num_vm_building': '1', 'num_proj_ce5d1153ffbc42b5863df7b2db23eaec': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:07:53.149084 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:53.414204 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Preparing to wait for external event volume-reimaged-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:07:53.414418 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:53.414624 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:53.414825 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:53.507345 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:53.580142 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:07:53.580302 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:07:53.627638 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:53.643738 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updating instance_info_cache with network_info: [{"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:53.840130 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:53.840657 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:07:53.840657 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] No VIF found with MAC fa:16:3e:ce:1a:11, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:07:53.840977 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Using config drive
May 27 23:07:53.861128 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003442339998400712 future=<Future at 0x726e38704980 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:53.862776 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:53.862776 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.625001697999778 future=<Future at 0x726e583832c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:53.862776 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.62491245199999 future=<Future at 0x726e583832c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:53.863986 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Emitting event <LifecycleEvent: 1779923258.860485, a6723b2d-e0b1-495c-910d-3ef37d877c05 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:53.863986 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] VM Stopped (Lifecycle Event)
May 27 23:07:54.084809 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:07:54.145611 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Releasing lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:54.149029 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8a0567bd-5621-48f4-abc6-8c48b21e0b5b req-fb3c692e-1c18-4dc8-8545-0f5b2bf8b313 service nova] Acquired lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:54.149029 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8a0567bd-5621-48f4-abc6-8c48b21e0b5b req-fb3c692e-1c18-4dc8-8545-0f5b2bf8b313 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Refreshing network info cache for port fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:07:54.149029 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:07:54.149029 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Creating image(s)
May 27 23:07:54.149397 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:54.149813 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:54.150739 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:54.150996 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'trusted_certs' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:54.347863 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:54.366071 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-77b44922-2026-4d02-813e-548b55cabef6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: a6723b2d-e0b1-495c-910d-3ef37d877c05] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:54.483057 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Creating config drive at /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/disk.config
May 27 23:07:54.486386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvivwuf7v {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:54.548113 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvivwuf7v" returned: 0 in 0.061s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:54.592369 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:07:54.592369 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.581s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:54.592734 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.237s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:54.593441 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:54.593441 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 27 23:07:54.597307 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.005s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:54.653428 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8a0567bd-5621-48f4-abc6-8c48b21e0b5b req-fb3c692e-1c18-4dc8-8545-0f5b2bf8b313 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:54.655445 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<a58d20c9-5038-4ea3-842e-406b0253f15b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:07:54.657527 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "f1f7bbd25d30adc4e4c433385f1ffe6ee1899823" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:54.658294 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Deleted allocations for instance a7839c43-8fd9-4deb-81c9-f128963f09ec
May 27 23:07:54.662212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "f1f7bbd25d30adc4e4c433385f1ffe6ee1899823" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.005s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:55.074744 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:55.086352 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8a0567bd-5621-48f4-abc6-8c48b21e0b5b req-fb3c692e-1c18-4dc8-8545-0f5b2bf8b313 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:55.098244 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] There are 0 instances to clean {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 27 23:07:55.102802 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.02 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:07:55.123589 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:55.259570 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:55.341865 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8a0567bd-5621-48f4-abc6-8c48b21e0b5b req-fb3c692e-1c18-4dc8-8545-0f5b2bf8b313 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updated VIF entry in instance network info cache for port fcd4468c-2b77-4da0-a875-6375149e0a09. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:07:55.342181 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8a0567bd-5621-48f4-abc6-8c48b21e0b5b req-fb3c692e-1c18-4dc8-8545-0f5b2bf8b313 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updating instance_info_cache with network_info: [{"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:55.420435 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cef3a145-890e-40d2-bca9-51edb57fbbc1 req-8682f6fb-5445-406b-a107-6771400d2c34 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:55.420546 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cef3a145-890e-40d2-bca9-51edb57fbbc1 req-8682f6fb-5445-406b-a107-6771400d2c34 service nova] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:55.422575 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cef3a145-890e-40d2-bca9-51edb57fbbc1 req-8682f6fb-5445-406b-a107-6771400d2c34 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:55.422575 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cef3a145-890e-40d2-bca9-51edb57fbbc1 req-8682f6fb-5445-406b-a107-6771400d2c34 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:55.422575 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cef3a145-890e-40d2-bca9-51edb57fbbc1 req-8682f6fb-5445-406b-a107-6771400d2c34 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Processing event network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:07:55.553751 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:55.561896 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:55.563512 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:55.587739 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:55.676201 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31a147de-040c-4ce6-9a4a-270e0e0d9522 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "a7839c43-8fd9-4deb-81c9-f128963f09ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.043s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:55.797131 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:55.800576 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:55.800918 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823.part --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:55.847111 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8a0567bd-5621-48f4-abc6-8c48b21e0b5b req-fb3c692e-1c18-4dc8-8545-0f5b2bf8b313 service nova] Releasing lock "refresh_cache-a58d20c9-5038-4ea3-842e-406b0253f15b" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:07:55.889507 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823.part --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:55.890206 np0000001565 nova-compute[98289]: DEBUG nova.virt.images [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] 7b680bab-7ed7-4861-8133-c3f90c2ad838 was qcow2, converting to raw {{(pid=98289) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 23:07:55.890995 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:07:55.891398 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823.part /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823.converted {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:56.026645 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823.part /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823.converted" returned: 0 in 0.135s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:56.039464 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923276.0390897, d099633e-fe8f-425b-b486-3f325ce97d12 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:56.039631 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] VM Started (Lifecycle Event)
May 27 23:07:56.041292 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:07:56.041739 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823.converted --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:56.067822 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:07:56.071541 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Instance spawned successfully.
May 27 23:07:56.072226 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:07:56.124466 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:56.124857 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:56.124960 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:56.125146 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:56.125316 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:56.125472 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:56.125758 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:56.125872 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:07:56.126076 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:56.136537 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823.converted --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:56.137095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "f1f7bbd25d30adc4e4c433385f1ffe6ee1899823" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.475s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:56.137654 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:56.140570 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:56.141833 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:56.230622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823 --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:56.230986 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "f1f7bbd25d30adc4e4c433385f1ffe6ee1899823" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:56.231458 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "f1f7bbd25d30adc4e4c433385f1ffe6ee1899823" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:56.231901 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:56.234351 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:07:56.234673 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:56.317932 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823 --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:56.318404 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823,backing_fmt=raw /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:56.372664 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823,backing_fmt=raw /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk 1073741824" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:56.373149 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "f1f7bbd25d30adc4e4c433385f1ffe6ee1899823" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.142s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:56.373586 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:56.462398 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f7bbd25d30adc4e4c433385f1ffe6ee1899823 --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:56.462664 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'migration_context' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:56.565243 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:56.569300 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:07:56.585342 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:56.585676 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:56.585942 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:56.586166 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:56.587170 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:56.587429 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:07:56.628069 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:07:56.966359 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<a58d20c9-5038-4ea3-842e-406b0253f15b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:07:56.966359 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Rebasing disk image.
May 27 23:07:56.966359 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:57.067955 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:57.069186 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:57.069852 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:57.069852 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:57.069987 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:57.074506 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:07:57.076269 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Terminating instance
May 27 23:07:57.079013 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.113s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:57.079874 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923277.0790997, d099633e-fe8f-425b-b486-3f325ce97d12 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:57.080104 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] VM Paused (Lifecycle Event)
May 27 23:07:57.082452 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d -F raw /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:07:57.107916 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Took 9.02 seconds to spawn the instance on the hypervisor.
May 27 23:07:57.108673 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:57.318205 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:57.515570 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1794a776-14e4-4d38-8c1f-993fc5deb93a req-cea8b551-e8b2-4910-b63e-7fdd9e055073 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:57.517221 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1794a776-14e4-4d38-8c1f-993fc5deb93a req-cea8b551-e8b2-4910-b63e-7fdd9e055073 service nova] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:57.517221 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1794a776-14e4-4d38-8c1f-993fc5deb93a req-cea8b551-e8b2-4910-b63e-7fdd9e055073 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:57.517221 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1794a776-14e4-4d38-8c1f-993fc5deb93a req-cea8b551-e8b2-4910-b63e-7fdd9e055073 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:57.517221 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1794a776-14e4-4d38-8c1f-993fc5deb93a req-cea8b551-e8b2-4910-b63e-7fdd9e055073 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] No waiting events found dispatching network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:57.517221 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-1794a776-14e4-4d38-8c1f-993fc5deb93a req-cea8b551-e8b2-4910-b63e-7fdd9e055073 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received unexpected event network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f for instance with vm_state active and task_state None.
May 27 23:07:57.608111 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:57.610438 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923277.6099796, d099633e-fe8f-425b-b486-3f325ce97d12 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:07:57.610438 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] VM Resumed (Lifecycle Event)
May 27 23:07:57.618282 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:07:57.626114 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:57.626246 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98289) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 27 23:07:57.634282 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Took 16.44 seconds to build instance.
May 27 23:07:57.663345 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:57.684871 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:57.851668 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4aa3af86-7d48-4048-b2f5-c27841f91d11 req-984be84d-0d43-4d8b-809a-f8efcb30ed40 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Received event network-vif-unplugged-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:57.851869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4aa3af86-7d48-4048-b2f5-c27841f91d11 req-984be84d-0d43-4d8b-809a-f8efcb30ed40 service nova] Acquiring lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:57.852043 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4aa3af86-7d48-4048-b2f5-c27841f91d11 req-984be84d-0d43-4d8b-809a-f8efcb30ed40 service nova] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:57.852217 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4aa3af86-7d48-4048-b2f5-c27841f91d11 req-984be84d-0d43-4d8b-809a-f8efcb30ed40 service nova] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:57.852217 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4aa3af86-7d48-4048-b2f5-c27841f91d11 req-984be84d-0d43-4d8b-809a-f8efcb30ed40 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] No waiting events found dispatching network-vif-unplugged-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:57.852402 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4aa3af86-7d48-4048-b2f5-c27841f91d11 req-984be84d-0d43-4d8b-809a-f8efcb30ed40 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Received event network-vif-unplugged-fa19979e-8452-466d-983f-af63f239ced4 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:07:57.874595 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:57.882111 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:57.956052 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Instance destroyed successfully.
May 27 23:07:57.956783 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'resources' on Instance uuid 6ab04c1a-7858-471e-95fd-5b04d1da3061 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:58.051059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d -F raw /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk" returned: 0 in 0.969s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:07:58.051506 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:07:58.051737 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Ensure instance console log exists: /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:07:58.052008 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:58.052180 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:58.052356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:58.054072 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Start _get_guest_xml network_info=[{"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='8c2eeabdaf59662bd1fc839f2ef09d9c',container_format='bare',created_at=2026-05-27T23:07:33Z,direct_url=<?>,disk_format='qcow2',id=7b680bab-7ed7-4861-8133-c3f90c2ad838,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2055205716-shelved',owner='475430e1d5044d9b97a65459543a1361',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-05-27T23:07:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:07:58.057466 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:07:58.059263 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-2055205716', uuid='a58d20c9-5038-4ea3-842e-406b0253f15b'), owner=OwnerMeta(userid='dd1c936280234ce2ab39aacb89c5af22', username='tempest-AttachVolumeShelveTestJSON-876504441-project-member', projectid='475430e1d5044d9b97a65459543a1361', projectname='tempest-AttachVolumeShelveTestJSON-876504441'), image=ImageMeta(id='7b680bab-7ed7-4861-8133-c3f90c2ad838', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923278.0588923) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:07:58.061429 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:07:58.061783 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:07:58.062630 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:07:58.062813 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:07:58.063782 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:07:58.064111 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8c2eeabdaf59662bd1fc839f2ef09d9c',container_format='bare',created_at=2026-05-27T23:07:33Z,direct_url=<?>,disk_format='qcow2',id=7b680bab-7ed7-4861-8133-c3f90c2ad838,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2055205716-shelved',owner='475430e1d5044d9b97a65459543a1361',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-05-27T23:07:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:07:58.064253 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:07:58.064365 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:07:58.064501 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:07:58.064603 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:07:58.064707 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:07:58.064852 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:07:58.064953 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:07:58.065067 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:07:58.065174 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:07:58.065293 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:07:58.065667 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'vcpu_model' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:58.118622 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:07:58.121623 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:07:58.131068 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:07:58.137620 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.953s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:58.459148 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-1',id=22,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:03:16Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-kihy0sqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=6ab04c1a-7858-471e-95fd-5b04d1da3061,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:07:58.459617 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "fa19979e-8452-466d-983f-af63f239ced4", "address": "fa:16:3e:62:f3:f7", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa19979e-84", "ovs_interfaceid": "fa19979e-8452-466d-983f-af63f239ced4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:58.460079 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:f3:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa19979e-8452-466d-983f-af63f239ced4,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa19979e-84') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:58.460431 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:f3:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa19979e-8452-466d-983f-af63f239ced4,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa19979e-84') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:07:58.461599 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:58.461797 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa19979e-84, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:58.462705 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:58.463659 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:58.464737 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:58.465382 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:58.465501 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c73bf12-76ba-405d-82b0-3e19e698c3ed) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:58.465877 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:58.466447 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:58.466583 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:58.469786 np0000001565 nova-compute[98289]: INFO os_vif [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:f3:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa19979e-8452-466d-983f-af63f239ced4,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa19979e-84')
May 27 23:07:58.470055 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Deleting instance files /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061_del
May 27 23:07:58.470794 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Deletion of /opt/stack/data/nova/instances/6ab04c1a-7858-471e-95fd-5b04d1da3061_del complete
May 27 23:07:58.567838 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<a58d20c9-5038-4ea3-842e-406b0253f15b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:07:58.591391 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2055205716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-2055205716',id=34,image_ref='7b680bab-7ed7-4861-8133-c3f90c2ad838',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1961618511',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:06:52Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-j4dw1ehs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member',shelved_at='2026-05-27T23:07:39.880608',shelved_host='np0000001565',shelved_image_id='7b680bab-7ed7-4861-8133-c3f90c2ad838'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=a58d20c9-5038-4ea3-842e-406b0253f15b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:07:58.591834 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:58.592684 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:58.593307 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'pci_devices' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:07:58.624292 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999700179999763 future=<Future at 0x726e60576570 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:07:58.627940 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:58.630592 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:07:58.630970 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.49 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:07:58.979245 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 23:07:58.979953 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:07:58.980139 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:07:58.980424 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:07:58.980516 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:59.060190 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:59.095180 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<a58d20c9-5038-4ea3-842e-406b0253f15b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:07:59.096740 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] End _get_guest_xml xml=<domain type="qemu">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <uuid>a58d20c9-5038-4ea3-842e-406b0253f15b</uuid>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <name>instance-00000022</name>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2055205716</nova:name>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:07:58</nova:creationTime>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:user uuid="dd1c936280234ce2ab39aacb89c5af22">tempest-AttachVolumeShelveTestJSON-876504441-project-member</nova:user>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:project uuid="475430e1d5044d9b97a65459543a1361">tempest-AttachVolumeShelveTestJSON-876504441</nova:project>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         <nova:port uuid="fcd4468c-2b77-4da0-a875-6375149e0a09">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <system>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <entry name="serial">a58d20c9-5038-4ea3-842e-406b0253f15b</entry>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <entry name="uuid">a58d20c9-5038-4ea3-842e-406b0253f15b</entry>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     </system>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <os>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   </os>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <features>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   </features>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   <devices>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.config"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     </disk>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:fc:4f:23"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <target dev="tapfcd4468c-2b"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     </interface>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/console.log" append="off"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     </serial>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <video>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     </video>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     </rng>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:   </devices>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]: </domain>
May 27 23:07:59.096740 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:07:59.099270 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Preparing to wait for external event network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:07:59.099270 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:59.099270 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:59.099270 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:59.100312 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2055205716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-2055205716',id=34,image_ref='7b680bab-7ed7-4861-8133-c3f90c2ad838',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1961618511',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:06:52Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-j4dw1ehs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member',shelved_at='2026-05-27T23:07:39.880608',shelved_host='np0000001565',shelved_image_id='7b680bab-7ed7-4861-8133-c3f90c2ad838'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=a58d20c9-5038-4ea3-842e-406b0253f15b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:07:59.100312 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:07:59.100883 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:07:59.101148 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:07:59.101548 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:59.101754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:59.101934 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:07:59.102832 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:59.103002 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '635cde7a-4b4b-555a-9ffc-d61b6d518f16', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:59.104311 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:59.105033 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:59.105951 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:59.107880 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:59.108026 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcd4468c-2b, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:59.108505 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcd4468c-2b, col_values=(('qos', UUID('471c381e-c0a2-4a74-a6fa-1947568bf690')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:59.108667 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcd4468c-2b, col_values=(('external_ids', {'iface-id': 'fcd4468c-2b77-4da0-a875-6375149e0a09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:4f:23', 'vm-uuid': 'a58d20c9-5038-4ea3-842e-406b0253f15b'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:07:59.110668 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:59.111956 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:07:59.116819 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:07:59.117870 np0000001565 nova-compute[98289]: INFO os_vif [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b')
May 27 23:07:59.417202 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-887437ef-5b67-4809-8f96-7dad3ca04fab req-6ba12289-531c-4fd8-b3b7-25c51cd0d4d1 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-changed-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:59.417976 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-887437ef-5b67-4809-8f96-7dad3ca04fab req-6ba12289-531c-4fd8-b3b7-25c51cd0d4d1 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Refreshing instance network info cache due to event network-changed-0ec6133d-baba-415d-82ec-9cbe8dfb935f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:07:59.418483 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-887437ef-5b67-4809-8f96-7dad3ca04fab req-6ba12289-531c-4fd8-b3b7-25c51cd0d4d1 service nova] Acquiring lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:07:59.419860 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-887437ef-5b67-4809-8f96-7dad3ca04fab req-6ba12289-531c-4fd8-b3b7-25c51cd0d4d1 service nova] Acquired lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:07:59.419860 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-887437ef-5b67-4809-8f96-7dad3ca04fab req-6ba12289-531c-4fd8-b3b7-25c51cd0d4d1 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Refreshing network info cache for port 0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:07:59.858556 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:07:59.922686 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d6fc7a34-ac91-4ec1-8f45-93a010e53a5f req-6103c8d6-ef88-4ed0-8604-7a2085b24d32 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Received event network-vif-unplugged-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:07:59.923998 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-887437ef-5b67-4809-8f96-7dad3ca04fab req-6ba12289-531c-4fd8-b3b7-25c51cd0d4d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:07:59.925984 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d6fc7a34-ac91-4ec1-8f45-93a010e53a5f req-6103c8d6-ef88-4ed0-8604-7a2085b24d32 service nova] Acquiring lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:07:59.926192 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d6fc7a34-ac91-4ec1-8f45-93a010e53a5f req-6103c8d6-ef88-4ed0-8604-7a2085b24d32 service nova] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:07:59.926386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d6fc7a34-ac91-4ec1-8f45-93a010e53a5f req-6103c8d6-ef88-4ed0-8604-7a2085b24d32 service nova] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:07:59.926698 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d6fc7a34-ac91-4ec1-8f45-93a010e53a5f req-6103c8d6-ef88-4ed0-8604-7a2085b24d32 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] No waiting events found dispatching network-vif-unplugged-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:07:59.926905 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d6fc7a34-ac91-4ec1-8f45-93a010e53a5f req-6103c8d6-ef88-4ed0-8604-7a2085b24d32 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Received event network-vif-unplugged-fa19979e-8452-466d-983f-af63f239ced4 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:07:59.927281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d6fc7a34-ac91-4ec1-8f45-93a010e53a5f req-6103c8d6-ef88-4ed0-8604-7a2085b24d32 service nova] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Received event network-vif-deleted-fa19979e-8452-466d-983f-af63f239ced4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:00.313092 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-887437ef-5b67-4809-8f96-7dad3ca04fab req-6ba12289-531c-4fd8-b3b7-25c51cd0d4d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:00.360449 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Took 1.38 seconds to deallocate network for instance.
May 27 23:08:00.459301 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-887437ef-5b67-4809-8f96-7dad3ca04fab req-6ba12289-531c-4fd8-b3b7-25c51cd0d4d1 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updated VIF entry in instance network info cache for port 0ec6133d-baba-415d-82ec-9cbe8dfb935f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:08:00.459731 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-887437ef-5b67-4809-8f96-7dad3ca04fab req-6ba12289-531c-4fd8-b3b7-25c51cd0d4d1 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating instance_info_cache with network_info: [{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:00.463734 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 req-ecd00aae-847b-46f1-ba65-8ae0ac2ad223 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event volume-reimaged-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:00.464062 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 req-ecd00aae-847b-46f1-ba65-8ae0ac2ad223 service nova] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:00.464199 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 req-ecd00aae-847b-46f1-ba65-8ae0ac2ad223 service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:00.464318 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 req-ecd00aae-847b-46f1-ba65-8ae0ac2ad223 service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:00.464464 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 req-ecd00aae-847b-46f1-ba65-8ae0ac2ad223 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Processing event volume-reimaged-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:08:00.465527 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Instance event wait completed in 6 seconds for volume-reimaged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:08:00.641887 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:00.642080 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:00.642173 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] No VIF found with MAC fa:16:3e:fc:4f:23, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:08:00.642791 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Using config drive
May 27 23:08:00.866796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:00.867198 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:00.888529 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:00.963308 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-887437ef-5b67-4809-8f96-7dad3ca04fab req-6ba12289-531c-4fd8-b3b7-25c51cd0d4d1 service nova] Releasing lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:00.970779 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Booting with volume f0db4932-f904-4a76-b63e-0c23a6cb2dc2 at /dev/vda
May 27 23:08:01.033133 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:01.049917 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:08:01.073892 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:01.130722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:08:01.131064 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:08:01.148911 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'ec2_ids' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:01.156182 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:08:01.157430 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe8a:26c4', 'fe80::70b0:20ff:fe1f:52b3', 'fe80::fc16:3eff:fe2a:b72e', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fece:1a11', 'fe80::3cbc:9fff:fe13:5e69'] 
May 27 23:08:01.158548 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:08:01.159125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:08:01.159473 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:01.159857 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Updating existing volume attachment record: 71877f34-afd2-4a98-83af-6bfbbcecc861 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:08:01.314239 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:01.315094 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:01.470032 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:01.470289 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:01.654004 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<a58d20c9-5038-4ea3-842e-406b0253f15b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:01.654185 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'keypairs' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:01.819698 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:01.974012 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:02.157469 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Object Instance<a58d20c9-5038-4ea3-842e-406b0253f15b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:02.161672 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:02.286380 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Creating config drive at /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.config
May 27 23:08:02.289932 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkc2h9yvx {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:02.341520 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkc2h9yvx" returned: 0 in 0.051s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:02.483052 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.616s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:02.537347 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Deleted allocations for instance 6ab04c1a-7858-471e-95fd-5b04d1da3061
May 27 23:08:02.749959 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:02.771690 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:02.772990 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:02.827853 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:02.857032 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:03.088626 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:03.092055 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:03.093564 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:03.118102 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:03.274006 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:08:03.274206 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Creating image(s)
May 27 23:08:03.274528 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:08:03.274673 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Ensure instance console log exists: /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:08:03.274903 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:03.275084 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:03.275199 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:03.275850 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Start _get_guest_xml network_info=[{"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-27T22:58:06Z,direct_url=<?>,disk_format='qcow2',id=8ff2d219-b0c5-4008-bfa5-cea77f23c366,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-27T22:58:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '71877f34-afd2-4a98-83af-6bfbbcecc861', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '77ce6750-3568-4e9b-b99e-c1a7964536d0', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'serial': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:08:03.280030 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 27 23:08:03.281196 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='8ff2d219-b0c5-4008-bfa5-cea77f23c366', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1596944221', uuid='77ce6750-3568-4e9b-b99e-c1a7964536d0'), owner=OwnerMeta(userid='4451943f43444436bf50809c8ab7f0d3', username='tempest-ServerActionsV293TestJSON-984365273-project-member', projectid='932825702de943b48bbcada3b5763dac', projectname='tempest-ServerActionsV293TestJSON-984365273'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923283.2808025) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:08:03.282910 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:08:03.283381 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:08:03.285125 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:08:03.285349 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:08:03.286315 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:08:03.286671 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-27T22:58:06Z,direct_url=<?>,disk_format='qcow2',id=8ff2d219-b0c5-4008-bfa5-cea77f23c366,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-27T22:58:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:08:03.286811 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:08:03.286894 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:08:03.287030 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:08:03.287083 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:08:03.287170 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:08:03.287316 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:08:03.287425 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:08:03.287534 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:08:03.287638 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:08:03.287760 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:08:03.287896 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lazy-loading 'vcpu_model' on Instance uuid 77ce6750-3568-4e9b-b99e-c1a7964536d0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:03.428091 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4f12a9d7-10de-4cc9-acf5-e802250d3fda req-1d5d0704-e9c8-4c9f-b246-bd26ae71ebeb service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:03.428287 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4f12a9d7-10de-4cc9-acf5-e802250d3fda req-1d5d0704-e9c8-4c9f-b246-bd26ae71ebeb service nova] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:03.428457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4f12a9d7-10de-4cc9-acf5-e802250d3fda req-1d5d0704-e9c8-4c9f-b246-bd26ae71ebeb service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:03.428615 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4f12a9d7-10de-4cc9-acf5-e802250d3fda req-1d5d0704-e9c8-4c9f-b246-bd26ae71ebeb service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:03.429715 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4f12a9d7-10de-4cc9-acf5-e802250d3fda req-1d5d0704-e9c8-4c9f-b246-bd26ae71ebeb service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Processing event network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:08:03.488081 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00035796600013782154 future=<Future at 0x726e583832c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:03.488146 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:03.488238 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.6361404509998465 future=<Future at 0x726e605975f0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:03.488300 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.6360668339998483 future=<Future at 0x726e605975f0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:03.488619 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] Emitting event <LifecycleEvent: 1779923268.4875772, a7839c43-8fd9-4deb-81c9-f128963f09ec => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:03.488744 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] VM Stopped (Lifecycle Event)
May 27 23:08:03.526760 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923283.5263498, a58d20c9-5038-4ea3-842e-406b0253f15b => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:03.526936 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] VM Started (Lifecycle Event)
May 27 23:08:03.528819 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:08:03.531063 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:08:03.533004 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Instance spawned successfully.
May 27 23:08:03.545655 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cec899e4-8596-4843-8778-ab6eb6e9b1fa tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6ab04c1a-7858-471e-95fd-5b04d1da3061" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.477s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:03.630247 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:03.800971 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:08:03.801277 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:03.801601 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:03.801750 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:03.801934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:08:03.814899 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:03.815480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:03.815845 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:03.816012 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:08:03.816404 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:03.816586 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:08:03.829783 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:08:03.829783 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:03.839451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:08:03.839451 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:03.844997 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2] added
May 27 23:08:03.844997 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:08:03.844997 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:03.844997 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:03.844997 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:03.844997 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:03.844997 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:03.845196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:08:03.845348 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:08:03.845494 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:08:03.855033 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2] added
May 27 23:08:03.855033 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:08:03.855033 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:03.855033 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:03.855033 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:03.855033 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:03.855033 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:03.855226 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:08:03.855320 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:08:03.855489 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:08:03.910455 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:03.910770 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:03.911627 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Attaching volume 3fa638c3-7504-48e0-a5fc-52d1c14b94c5 to /dev/vdb
May 27 23:08:03.922969 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:03.977279 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:03.991383 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:08:03.992405 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3a70b261-5bea-4b1e-ba82-e95bd92f5e96 tempest-TaggedBootDevicesTest_v242-425781554 tempest-TaggedBootDevicesTest_v242-425781554-project-member] [instance: a7839c43-8fd9-4deb-81c9-f128963f09ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:04.012864 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:04.031504 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:04.036795 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:04.057463 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:08:04.057763 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:08:04.065631 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:08:04.066898 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe47:ade', 'fe80::fc16:3eff:fe8a:26c4', 'fe80::70b0:20ff:fe1f:52b3', 'fe80::fc16:3eff:fe2a:b72e', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fece:1a11', 'fe80::3cbc:9fff:fe13:5e69', 'fe80::fc16:3eff:fefc:4f23', 'fe80::f886:b6ff:fe99:9ebe'] 
May 27 23:08:04.067004 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:08:04.067112 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:08:04.067323 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:04.067569 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Updating existing volume attachment record: ef406f62-42bc-4f3e-9a5e-afa33925d857 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:08:04.110615 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:04.124985 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0005515249999916705 future=<Future at 0x726e605975f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:04.125577 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Emitting event <LifecycleEvent: 1779923269.1243038, 77ce6750-3568-4e9b-b99e-c1a7964536d0 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:04.125801 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:04.126067 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] VM Stopped (Lifecycle Event)
May 27 23:08:04.127277 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.496705793999809 future=<Future at 0x726e60576570 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:04.127455 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.49651151099988 future=<Future at 0x726e60576570 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:04.386775 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6a99f05a-6544-4994-9a1a-d98c320d088a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:04.387000 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:04.387194 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:04.387324 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:04.387612 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:04.389743 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Terminating instance
May 27 23:08:04.430802 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d9157ad0-8cee-45ad-9fce-68c2843a6c7a tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.053s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:04.540442 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923284.5401528, a58d20c9-5038-4ea3-842e-406b0253f15b => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:04.540591 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] VM Paused (Lifecycle Event)
May 27 23:08:04.629600 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:04.649954 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '52410d9c-d2b3-4a6f-85f4-ca4f26fe660f', 'attached_at': '', 'detached_at': '', 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'serial': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:08:04.651170 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:08:04.651631 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:04.651813 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:04.845943 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:08:04.855872 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:08:04.858773 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:08:04.858773 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:08:04.871974 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:08:04.871974 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:04.878634 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:04.889850 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:04.894153 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:08:04.897250 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.897250 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.897250 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.897250 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.897250 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:04.897531 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.897531 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.897531 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.897531 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.897531 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:04.905436 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.905436 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.905436 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.905436 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.905436 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:04.905628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.905628 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.905628 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.905628 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.905628 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:04.918762 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:04.938627 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.40.100,3260]
May 27 23:08:04.938627 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.40.100,3260] successful.
May 27 23:08:04.938627 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:04.943320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.50.100,3260]
May 27 23:08:04.943320 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.50.100,3260] successful.
May 27 23:08:04.943320 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:04.943320 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:04.957990 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:04.960726 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:04.973106 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.973106 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.973106 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.973106 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.973106 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:04.973106 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:04.973106 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:04.973349 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.973349 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.973349 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.973349 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.973349 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:04.973349 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:04.973349 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:04.973714 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:04.973885 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:08:04.974760 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.974760 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.974760 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.974760 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.974760 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:04.974760 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:04.974760 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:04.974994 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.974994 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:04.974994 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.974994 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:04.974994 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:04.974994 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:04.974994 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:04.975357 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:04.975522 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:08:04.977003 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] HCTL ('7', '-', '-', 0) found on session 76 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:08:04.977139 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:08:04.978002 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] HCTL ('8', '-', '-', 0) found on session 77 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:08:04.978154 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:08:04.993296 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Searching for a device in session 76 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:08:04.993296 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:08:04.999999 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Searching for a device in session 77 and hctl ['8', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:08:05.043233 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:05.053769 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923285.0533707, a58d20c9-5038-4ea3-842e-406b0253f15b => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:05.053890 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] VM Resumed (Lifecycle Event)
May 27 23:08:05.114312 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:05.120085 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:05.200527 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:05.208777 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:05.229618 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Instance destroyed successfully.
May 27 23:08:05.229956 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'resources' on Instance uuid 6a99f05a-6544-4994-9a1a-d98c320d088a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:05.492885 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aa128abf-1806-41e1-b9aa-75aff1038400 req-3dcc1de1-5dbc-4539-ac79-dcb78c7c9770 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:05.493096 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aa128abf-1806-41e1-b9aa-75aff1038400 req-3dcc1de1-5dbc-4539-ac79-dcb78c7c9770 service nova] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:05.493204 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aa128abf-1806-41e1-b9aa-75aff1038400 req-3dcc1de1-5dbc-4539-ac79-dcb78c7c9770 service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:05.493305 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aa128abf-1806-41e1-b9aa-75aff1038400 req-3dcc1de1-5dbc-4539-ac79-dcb78c7c9770 service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:05.493427 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aa128abf-1806-41e1-b9aa-75aff1038400 req-3dcc1de1-5dbc-4539-ac79-dcb78c7c9770 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] No waiting events found dispatching network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:05.493536 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-aa128abf-1806-41e1-b9aa-75aff1038400 req-3dcc1de1-5dbc-4539-ac79-dcb78c7c9770 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received unexpected event network-vif-plugged-fcd4468c-2b77-4da0-a875-6375149e0a09 for instance with vm_state active and task_state None.
May 27 23:08:05.562351 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:05.564070 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:05.732208 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='multiattach-server-0',id=18,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUeHziMngsB4piGyze1CT5wtAVsFlGuTjvw9uxf6RTdS9aa45/vCm6wWWiIpipdZ4QR4kENQRHHpzECsEsY3oS+tGxLNgWTZPRgrmtrLXB674YkMkumP4eKRD0F8tHiIQ==',key_name='tempest-keypair-1819729673',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:02:58Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-l45qiyb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=6a99f05a-6544-4994-9a1a-d98c320d088a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:08:05.732487 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "address": "fa:16:3e:47:0a:de", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9b8029-82", "ovs_interfaceid": "2d9b8029-820b-4780-a69e-2a8cca380d8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:05.733154 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:0a:de,bridge_name='br-int',has_traffic_filtering=True,id=2d9b8029-820b-4780-a69e-2a8cca380d8f,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9b8029-82') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:05.735042 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:0a:de,bridge_name='br-int',has_traffic_filtering=True,id=2d9b8029-820b-4780-a69e-2a8cca380d8f,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9b8029-82') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:08:05.735042 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:05.735404 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d9b8029-82, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:05.737413 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:05.737936 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:05.738774 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:05.738993 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58bcb6a6-537d-4c09-a213-66acd1c8c7d4) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:05.741091 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:05.741397 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:05.744300 np0000001565 nova-compute[98289]: INFO os_vif [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:0a:de,bridge_name='br-int',has_traffic_filtering=True,id=2d9b8029-820b-4780-a69e-2a8cca380d8f,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9b8029-82')
May 27 23:08:05.744611 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Deleting instance files /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a_del
May 27 23:08:05.745293 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Deletion of /opt/stack/data/nova/instances/6a99f05a-6544-4994-9a1a-d98c320d088a_del complete
May 27 23:08:05.810912 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:06.000279 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Searching for a device in session 77 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:08:06.000279 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:08:06.066341 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999768979999772 future=<Future at 0x726e602d33b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:06.252037 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 23:08:06.253538 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:08:06.254764 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:08:06.254873 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:08:06.255137 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:06.362792 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:06.626850 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-471f77a9-2d14-4168-88b8-410b92e038f7 req-f63d54a5-67d0-4c70-917f-16da73e9f162 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Received event network-vif-deleted-2d9b8029-820b-4780-a69e-2a8cca380d8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:06.627538 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-471f77a9-2d14-4168-88b8-410b92e038f7 req-f63d54a5-67d0-4c70-917f-16da73e9f162 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Neutron deleted interface 2d9b8029-820b-4780-a69e-2a8cca380d8f; detaching it from the instance and deleting it from the info cache
May 27 23:08:06.630490 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-471f77a9-2d14-4168-88b8-410b92e038f7 req-f63d54a5-67d0-4c70-917f-16da73e9f162 service nova] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Detach interface failed, port_id=2d9b8029-820b-4780-a69e-2a8cca380d8f, reason: Instance 6a99f05a-6544-4994-9a1a-d98c320d088a could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:08:06.832704 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Found WWN 330000000c66bbb07 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:08:06.833032 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:06.833397 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000c66bbb07', 'path': '/dev/dm-0', 'multipath_id': '330000000c66bbb07'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:06.833601 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c66bbb07', 'path': '/dev/dm-0', 'multipath_id': '330000000c66bbb07'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:08:06.834024 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.182s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:06.834232 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:08:06.845083 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:06.845645 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:06.846029 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:06.846316 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:08:06.846698 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:06.846875 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:08:06.857794 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:08:06.857794 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:06.863682 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:08:06.863682 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:06.874281 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5] added
May 27 23:08:06.874281 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:08:06.874281 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:06.874281 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:06.874281 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:06.874281 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:06.874281 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:06.874534 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:08:06.874727 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:08:06.874954 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:08:06.876364 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5] added
May 27 23:08:06.876364 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:08:06.876364 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:06.876364 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:06.876364 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:06.876364 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:06.876364 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:06.876364 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:08:06.876364 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:08:06.876364 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:08:07.070545 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:07.212628 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:07.213008 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:07.343156 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1596944221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionsv293testjson-server-440667466',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFF3ms/ZqADOPwQwgUDiksAV+TViqkb1xsZUeFJ9fXMFHAkOuFmlFD+buNkeEJSOa3xWsXInFjzmeNVuvHjuUmcUVOW9fKpVE4pVSKRmEFjcniprzLTbopfmOVDNzn6w==',key_name='tempest-keypair-482168530',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:17Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='932825702de943b48bbcada3b5763dac',ramdisk_id='',reservation_id='r-z6zy7sr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-984365273',owner_user_name='tempest-ServerActionsV293TestJSON-984365273-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4451943f43444436bf50809c8ab7f0d3',uuid=77ce6750-3568-4e9b-b99e-c1a7964536d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:08:07.343727 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converting VIF {"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:07.344490 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:07.345970 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] End _get_guest_xml xml=<domain type="qemu">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <uuid>77ce6750-3568-4e9b-b99e-c1a7964536d0</uuid>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <name>instance-00000023</name>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1596944221</nova:name>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:08:03</nova:creationTime>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <nova:image uuid="8ff2d219-b0c5-4008-bfa5-cea77f23c366">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:user uuid="4451943f43444436bf50809c8ab7f0d3">tempest-ServerActionsV293TestJSON-984365273-project-member</nova:user>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:project uuid="932825702de943b48bbcada3b5763dac">tempest-ServerActionsV293TestJSON-984365273</nova:project>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid="8ff2d219-b0c5-4008-bfa5-cea77f23c366"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         <nova:port uuid="61237f5f-3261-4c4e-83c3-7f4a5db90b8f">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <system>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <entry name="serial">77ce6750-3568-4e9b-b99e-c1a7964536d0</entry>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <entry name="uuid">77ce6750-3568-4e9b-b99e-c1a7964536d0</entry>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     </system>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <os>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   </os>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <features>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   </features>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   <devices>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/disk.config"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <alias name="ua-f0db4932-f904-4a76-b63e-0c23a6cb2dc2"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <serial>f0db4932-f904-4a76-b63e-0c23a6cb2dc2</serial>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ae:d8:ed"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <target dev="tap61237f5f-32"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     </interface>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/console.log" append="off"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     </serial>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <video>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     </video>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     </rng>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:   </devices>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]: </domain>
May 27 23:08:07.345970 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:08:07.347654 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1596944221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionsv293testjson-server-440667466',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFF3ms/ZqADOPwQwgUDiksAV+TViqkb1xsZUeFJ9fXMFHAkOuFmlFD+buNkeEJSOa3xWsXInFjzmeNVuvHjuUmcUVOW9fKpVE4pVSKRmEFjcniprzLTbopfmOVDNzn6w==',key_name='tempest-keypair-482168530',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:17Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='932825702de943b48bbcada3b5763dac',ramdisk_id='',reservation_id='r-z6zy7sr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-984365273',owner_user_name='tempest-ServerActionsV293TestJSON-984365273-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4451943f43444436bf50809c8ab7f0d3',uuid=77ce6750-3568-4e9b-b99e-c1a7964536d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:08:07.347654 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converting VIF {"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:07.347654 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:07.349203 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:08:07.349617 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:07.349853 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:07.350045 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:08:07.351072 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:07.351262 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c010fe6-bc3c-586a-8907-6164dd8bf878', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:07.352834 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:07.354394 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:07.356691 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:07.356854 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61237f5f-32, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:07.357155 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61237f5f-32, col_values=(('qos', UUID('a99363cb-033e-42f9-99f8-ade47febaf70')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:07.357317 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61237f5f-32, col_values=(('external_ids', {'iface-id': '61237f5f-3261-4c4e-83c3-7f4a5db90b8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:d8:ed', 'vm-uuid': '77ce6750-3568-4e9b-b99e-c1a7964536d0'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:07.358859 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:07.360090 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:07.366109 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:07.366545 np0000001565 nova-compute[98289]: INFO os_vif [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32')
May 27 23:08:07.572712 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Took 1.32 seconds to deallocate network for instance.
May 27 23:08:07.718125 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:07.875410 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:08:07.876236 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:08:07.889354 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:08:07.889354 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:08:07.896266 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:08:07.896266 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:07.903883 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:07.911630 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:07.922358 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:07.928917 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:07.928917 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:07.928917 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:07.928917 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:07.928917 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:07.928917 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:07.928917 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:07.929482 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:07.929482 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:07.929482 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:07.929482 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:07.929482 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:07.929482 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:07.929482 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:07.963710 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5, portal: 192.168.40.100,3260]
May 27 23:08:07.963710 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5, portal: 192.168.40.100,3260] successful.
May 27 23:08:07.963710 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:07.968550 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5, portal: 192.168.50.100,3260]
May 27 23:08:07.968550 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5, portal: 192.168.50.100,3260] successful.
May 27 23:08:07.968550 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:07.976898 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:07.986027 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:07.999493 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:07.999493 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:07.999493 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:07.999493 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:07.999493 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:07.999493 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:07.999493 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:07.999493 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:07.999493 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:08.000045 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:08.000045 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:08.000045 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:08.000045 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:08.000045 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:08.000045 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:08.000045 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:08.000045 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:08.000045 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:08.000045 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:08.000366 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:08:08.001239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('13', '-', '-', 0) found on session 78 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:08:08.001422 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:08:08.011716 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:08.011716 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:08.011716 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:08.011716 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:08.011716 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:08.011716 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:08.011716 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:08.011716 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:08.011716 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:08.012254 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:08.012254 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:08.012254 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:08.012254 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:08.012254 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:08.012254 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:08.012254 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:08.012254 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:08.012254 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:08.012254 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:08.012254 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:08:08.017049 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('14', '-', '-', 0) found on session 79 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:08:08.017049 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:08:08.029542 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 78 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:08:08.039554 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:08:08.044274 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 79 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:08:08.044274 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:08:08.080499 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:08.080499 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:08.095892 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:08.157274 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Refreshing inventories for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 27 23:08:08.208779 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Updating ProviderTree inventory for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 27 23:08:08.208950 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Updating inventory in ProviderTree for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 23:08:08.249062 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Refreshing aggregate associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, aggregates: None {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 27 23:08:08.292803 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Refreshing trait associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_PPC64LE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_AARCH64,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_STATELESS_FIRMWARE {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 27 23:08:08.630732 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:08.641714 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:08.641925 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:08.722603 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:08.746471 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:08:08.847259 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:08:08.888345 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:08.888604 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:08.888737 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] No VIF found with MAC fa:16:3e:ae:d8:ed, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:08:08.889168 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Using config drive
May 27 23:08:09.145004 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:09.391668 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lazy-loading 'ec2_ids' on Instance uuid 77ce6750-3568-4e9b-b99e-c1a7964536d0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:09.650865 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.570s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:09.693946 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Deleted allocations for instance 6a99f05a-6544-4994-9a1a-d98c320d088a
May 27 23:08:09.799413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:09.799413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:09.799413 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Attaching volume 6b311228-b94c-4246-8c69-1659f524de84 to /dev/vdb
May 27 23:08:09.845701 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:09.860272 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:08:09.865760 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found WWN 3300000000f74a0fb for multipath device dm-9 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:08:09.865893 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:09.867001 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== connect_volume: return (5215ms) {'type': 'block', 'scsi_wwn': '3300000000f74a0fb', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '3300000000f74a0fb'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:09.867115 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000f74a0fb', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '3300000000f74a0fb'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:08:09.869060 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:08:09.869748 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:08:09.870096 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:08:09.870932 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x726e386871a0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '52410d9c-d2b3-4a6f-85f4-ca4f26fe660f', 'attached_at': '', 'detached_at': '', 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'serial': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5'} {{(pid=98289) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 23:08:09.871355 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98289) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 27 23:08:09.871486 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] opening encrypted volume /dev/dm-9 {{(pid=98289) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 27 23:08:09.886876 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:09.907694 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Object Instance<77ce6750-3568-4e9b-b99e-c1a7964536d0> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:09.907946 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lazy-loading 'keypairs' on Instance uuid 77ce6750-3568-4e9b-b99e-c1a7964536d0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:09.936675 np0000001565 nova-compute[98289]: WARNING os_brick.encryptors.luks [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 23:08:09.938051 np0000001565 nova-compute[98289]: INFO os_brick.encryptors.luks [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] /dev/dm-9 is not a valid LUKS device; formatting device for first use
May 27 23:08:09.938190 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] formatting encrypted volume /dev/dm-9 {{(pid=98289) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 27 23:08:09.943773 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:08:09.944872 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:08:09.959494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:08:09.959494 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe94:3e4d', 'fe80::d8b3:7ff:fe22:ed7b', 'fe80::fc16:3eff:fe8a:26c4', 'fe80::70b0:20ff:fe1f:52b3', 'fe80::fc16:3eff:fe2a:b72e', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fece:1a11', 'fe80::3cbc:9fff:fe13:5e69', 'fe80::fc16:3eff:fefc:4f23', 'fe80::f886:b6ff:fe99:9ebe'] 
May 27 23:08:09.959494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:08:09.959494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:08:09.959494 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:09.959962 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Updating existing volume attachment record: 12fa667c-aef5-4a62-bd71-79fa0da1b91a {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:08:10.413645 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Object Instance<77ce6750-3568-4e9b-b99e-c1a7964536d0> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:10.416552 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 27 23:08:10.525388 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Creating config drive at /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/disk.config
May 27 23:08:10.529846 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe269v8ek {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:10.551364 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:08:10.551364 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:10.551364 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:10.551364 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:10.551364 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:08:10.563919 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:10.564682 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:10.565267 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:10.565583 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:08:10.567425 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:10.567425 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:08:10.577398 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:08:10.577398 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:10.580867 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe269v8ek" returned: 0 in 0.051s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:10.583746 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:08:10.583746 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:10.589321 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84] added
May 27 23:08:10.589321 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:08:10.589321 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:10.589321 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:10.589321 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:10.589321 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:10.589321 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:10.589520 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:08:10.589803 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:08:10.589981 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:08:10.594367 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84] added
May 27 23:08:10.594367 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:08:10.594367 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:10.594367 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:10.594367 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:10.594367 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:10.594367 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:10.594523 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:08:10.594753 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:08:10.594897 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:08:10.703635 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfe3ed70-7eb1-44c5-b415-4c9ec0acfe95 tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "6a99f05a-6544-4994-9a1a-d98c320d088a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.317s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:10.730166 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:10.730373 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:10.982068 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:11.018942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:11.102699 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:11.210705 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bf4c73d0-9433-4643-b5b5-1d0a9f2e35e8 req-b860201e-b398-4a29-a89f-b2a885774867 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:11.212367 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bf4c73d0-9433-4643-b5b5-1d0a9f2e35e8 req-b860201e-b398-4a29-a89f-b2a885774867 service nova] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:11.212642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bf4c73d0-9433-4643-b5b5-1d0a9f2e35e8 req-b860201e-b398-4a29-a89f-b2a885774867 service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:11.212831 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bf4c73d0-9433-4643-b5b5-1d0a9f2e35e8 req-b860201e-b398-4a29-a89f-b2a885774867 service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:11.213022 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bf4c73d0-9433-4643-b5b5-1d0a9f2e35e8 req-b860201e-b398-4a29-a89f-b2a885774867 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] No waiting events found dispatching network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:11.213497 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-bf4c73d0-9433-4643-b5b5-1d0a9f2e35e8 req-b860201e-b398-4a29-a89f-b2a885774867 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received unexpected event network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f for instance with vm_state active and task_state rebuild_spawning.
May 27 23:08:11.232584 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:08:11.406591 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:11.410498 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:11.412708 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:11.434487 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:11.437941 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:11.590987 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:08:11.595935 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:08:11.608528 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:08:11.608528 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:08:11.618646 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:08:11.618646 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:11.631843 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:11.643816 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:11.650613 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.650613 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.650613 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.650613 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.650613 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.650613 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.650613 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.650613 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.650613 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:11.650916 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.650916 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.650916 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.650916 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.650916 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.650916 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.650916 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.650916 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.650916 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:11.659738 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.659738 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.659738 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.659738 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.659738 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.659738 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.659738 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.659738 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.659738 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:11.660126 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.660126 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.660126 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.660126 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.660126 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.660126 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.660126 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.660126 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.660126 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:11.718229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.40.100,3260]
May 27 23:08:11.718229 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.40.100,3260] successful.
May 27 23:08:11.718229 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:11.718775 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.50.100,3260]
May 27 23:08:11.718775 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.50.100,3260] successful.
May 27 23:08:11.718775 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:11.734955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:11.751503 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:11.764196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.764196 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.764196 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.764196 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.764196 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.764196 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.764196 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.764196 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.764196 np0000001565 nova-compute[98289]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:11.764196 np0000001565 nova-compute[98289]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:11.764196 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:11.764601 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.764601 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.764601 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.764601 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.764601 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.764601 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.764601 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.764601 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.764601 np0000001565 nova-compute[98289]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:11.764601 np0000001565 nova-compute[98289]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:11.764601 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:11.764601 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:11.764933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:08:11.765543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] HCTL ('16', '-', '-', 0) found on session 81 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:08:11.765710 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:11.772257 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] HCTL ('15', '-', '-', 0) found on session 80 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:08:11.772257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:08:11.803717 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching for a device in session 80 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:08:11.803717 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:08:11.806126 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching for a device in session 81 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:08:11.806126 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:08:11.834603 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:11.834889 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:11.855444 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:08:11.858480 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Claim successful on node np0000001565
May 27 23:08:12.075995 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923292.0734942, 77ce6750-3568-4e9b-b99e-c1a7964536d0 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:12.076277 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] VM Resumed (Lifecycle Event)
May 27 23:08:12.077715 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Instance event wait completed in 0 seconds for  {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:08:12.077928 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:08:12.081712 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Instance spawned successfully.
May 27 23:08:12.085804 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:08:12.190529 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "f47a00cc-da92-40c9-a668-9a160670addd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:12.191372 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "f47a00cc-da92-40c9-a668-9a160670addd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:12.191372 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "f47a00cc-da92-40c9-a668-9a160670addd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:12.191372 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:12.191372 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:12.208251 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Terminating instance
May 27 23:08:12.362393 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:12.569182 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:08:12.581260 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:12.594670 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:12.608450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:12.608450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:12.608450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:12.608450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:12.608450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:12.608450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:12.719128 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:08:12.737705 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:12.740297 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:12.773627 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:12.777182 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:12.802411 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:13.100769 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 27 23:08:13.100769 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923293.0988848, 77ce6750-3568-4e9b-b99e-c1a7964536d0 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:13.100769 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] VM Started (Lifecycle Event)
May 27 23:08:13.108855 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Instance destroyed successfully.
May 27 23:08:13.119363 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lazy-loading 'resources' on Instance uuid f47a00cc-da92-40c9-a668-9a160670addd {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:13.135355 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:13.135916 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cad89e50-8cab-4db5-9c27-7b8742be6cf0 req-053ac392-19a8-4837-a95d-b72c9b434790 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Received event network-vif-unplugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:13.136368 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cad89e50-8cab-4db5-9c27-7b8742be6cf0 req-053ac392-19a8-4837-a95d-b72c9b434790 service nova] Acquiring lock "f47a00cc-da92-40c9-a668-9a160670addd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:13.136838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cad89e50-8cab-4db5-9c27-7b8742be6cf0 req-053ac392-19a8-4837-a95d-b72c9b434790 service nova] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:13.136838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cad89e50-8cab-4db5-9c27-7b8742be6cf0 req-053ac392-19a8-4837-a95d-b72c9b434790 service nova] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:13.136838 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cad89e50-8cab-4db5-9c27-7b8742be6cf0 req-053ac392-19a8-4837-a95d-b72c9b434790 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] No waiting events found dispatching network-vif-unplugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:13.138112 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cad89e50-8cab-4db5-9c27-7b8742be6cf0 req-053ac392-19a8-4837-a95d-b72c9b434790 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Received event network-vif-unplugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:08:13.323135 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3e91c2a2-732d-4185-b319-fd064f7a0176 req-6511a424-676f-436f-ab04-498e80a9d5db service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:13.323428 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e91c2a2-732d-4185-b319-fd064f7a0176 req-6511a424-676f-436f-ab04-498e80a9d5db service nova] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:13.323705 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e91c2a2-732d-4185-b319-fd064f7a0176 req-6511a424-676f-436f-ab04-498e80a9d5db service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:13.323916 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e91c2a2-732d-4185-b319-fd064f7a0176 req-6511a424-676f-436f-ab04-498e80a9d5db service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:13.324117 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3e91c2a2-732d-4185-b319-fd064f7a0176 req-6511a424-676f-436f-ab04-498e80a9d5db service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] No waiting events found dispatching network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:13.324296 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3e91c2a2-732d-4185-b319-fd064f7a0176 req-6511a424-676f-436f-ab04-498e80a9d5db service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received unexpected event network-vif-plugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f for instance with vm_state active and task_state None.
May 27 23:08:13.473585 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:13.473851 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:13.598438 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Found WWN 330000000cfb42acf for multipath device dm-10 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:08:13.598697 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:13.598883 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '330000000cfb42acf', 'path': '/dev/dm-10', 'multipath_id': '330000000cfb42acf'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:13.601408 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cfb42acf', 'path': '/dev/dm-10', 'multipath_id': '330000000cfb42acf'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:08:13.603670 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:13.624505 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004994079999960377 future=<Future at 0x726e60576570 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:13.624741 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:13.625041 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Emitting event <LifecycleEvent: 1779923278.6238866, 6ab04c1a-7858-471e-95fd-5b04d1da3061 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:13.625215 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=7.44086155299965 future=<Future at 0x726e602d33b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:13.625440 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] VM Stopped (Lifecycle Event)
May 27 23:08:13.626535 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=7.4395439879999685 future=<Future at 0x726e602d33b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:13.627859 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:13.629061 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:13.639297 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:02:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-120023004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumemultiattachtest-server-120023004',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:02:38Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec877dc7b2240969ac89c13673f8799',ramdisk_id='',reservation_id='r-gn4el310',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-AttachVolumeMultiAttachTest-781715127',owner_user_name='tempest-AttachVolumeMultiAttachTest-781715127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:02:39Z,user_data=None,user_id='2c6d94c1e6da4237aa5dd517c31e03d7',uuid=f47a00cc-da92-40c9-a668-9a160670addd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "address": "fa:16:3e:94:3e:4d", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap409f0bf7-c0", "ovs_interfaceid": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:08:13.639612 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converting VIF {"id": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "address": "fa:16:3e:94:3e:4d", "network": {"id": "abb5b3c8-437a-4c3e-8d0f-c66d24d543e7", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1538612474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0ec877dc7b2240969ac89c13673f8799", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap409f0bf7-c0", "ovs_interfaceid": "409f0bf7-c0d0-4da5-97f5-9608b91ea67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:13.640084 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=409f0bf7-c0d0-4da5-97f5-9608b91ea67c,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409f0bf7-c0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:13.640459 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=409f0bf7-c0d0-4da5-97f5-9608b91ea67c,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409f0bf7-c0') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:08:13.640888 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:13.656554 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:13.656874 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap409f0bf7-c0, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:13.660194 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:13.661473 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:13.661892 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40940519-6253-4f06-8383-f9debca9ed98) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:13.662473 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:13.663114 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:13.663758 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:13.668554 np0000001565 nova-compute[98289]: INFO os_vif [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:3e:4d,bridge_name='br-int',has_traffic_filtering=True,id=409f0bf7-c0d0-4da5-97f5-9608b91ea67c,network=Network(abb5b3c8-437a-4c3e-8d0f-c66d24d543e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409f0bf7-c0')
May 27 23:08:13.692236 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:13.710958 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:08:13.711452 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5040d323-2b77-4acd-90da-38f38e2680f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:13.711796 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:13.712280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:13.712781 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5040d323-2b77-4acd-90da-38f38e2680f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:08:13.713075 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsi session list stdout=tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:13.766116 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '81')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '18')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:08:13.766116 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1', '19')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:08:13.768994 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e5817b880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:08:13.768994 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Removing multipathed devices sdd, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:08:13.768994 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Flush multipath device 3300000004bdaf1bd {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:08:13.827270 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:08:13.894561 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:08:13.941293 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:08:13.941293 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:08:13.942787 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:08:13.956293 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:08:13.956293 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:08:13.975993 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:13.976912 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:14.030453 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1, portal: 192.168.40.100,3260]
May 27 23:08:14.030453 np0000001565 nova-compute[98289]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1, portal: 192.168.40.100,3260] successful.
May 27 23:08:14.030453 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:14.067350 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:14.077323 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:14.108135 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Attempting to attach volume 6b311228-b94c-4246-8c69-1659f524de84 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:08:14.109269 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:08:14.109269 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:08:14.109269 np0000001565 nova-compute[98289]:   <alias name="ua-6b311228-b94c-4246-8c69-1659f524de84"/>
May 27 23:08:14.109269 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-10"/>
May 27 23:08:14.109269 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:08:14.109269 np0000001565 nova-compute[98289]:   <serial>6b311228-b94c-4246-8c69-1659f524de84</serial>
May 27 23:08:14.109269 np0000001565 nova-compute[98289]: </disk>
May 27 23:08:14.109269 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:08:14.117521 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1, portal: 192.168.50.100,3260]
May 27 23:08:14.117521 np0000001565 nova-compute[98289]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-5040d323-2b77-4acd-90da-38f38e2680f1, portal: 192.168.50.100,3260] successful.
May 27 23:08:14.117521 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:14.134039 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:14.134282 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:14.134461 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] <== disconnect_volume: return (422ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:14.134650 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:08:14.134946 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Deleting instance files /opt/stack/data/nova/instances/f47a00cc-da92-40c9-a668-9a160670addd_del
May 27 23:08:14.135663 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Deletion of /opt/stack/data/nova/instances/f47a00cc-da92-40c9-a668-9a160670addd_del complete
May 27 23:08:14.156515 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 6ab04c1a-7858-471e-95fd-5b04d1da3061] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:14.157101 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99983086400016 future=<Future at 0x726e386cf9b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:14.489515 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.654s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:14.490361 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:08:14.492471 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.800s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:14.494355 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98289) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 27 23:08:14.646677 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Took 1.93 seconds to destroy the instance on the hypervisor.
May 27 23:08:14.647222 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:08:14.650025 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:08:14.650025 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: f47a00cc-da92-40c9-a668-9a160670addd] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:08:14.650025 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:14.741502 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:15.004377 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:08:15.005222 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:08:15.005222 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:15.005366 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:15.071928 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08c42711a5d14870b3f4ebecf1deaeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077b44d61ee49ffbb4b474bd8b6711a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:08:15.231902 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e60d2b3b-9d24-41ea-95f7-6c1e0e4b6d77 req-afc2372a-0cd5-4eab-8e61-bc9ea23eea31 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Received event network-vif-unplugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:15.232607 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e60d2b3b-9d24-41ea-95f7-6c1e0e4b6d77 req-afc2372a-0cd5-4eab-8e61-bc9ea23eea31 service nova] Acquiring lock "f47a00cc-da92-40c9-a668-9a160670addd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:15.232607 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e60d2b3b-9d24-41ea-95f7-6c1e0e4b6d77 req-afc2372a-0cd5-4eab-8e61-bc9ea23eea31 service nova] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:15.232727 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e60d2b3b-9d24-41ea-95f7-6c1e0e4b6d77 req-afc2372a-0cd5-4eab-8e61-bc9ea23eea31 service nova] Lock "f47a00cc-da92-40c9-a668-9a160670addd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:15.232861 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e60d2b3b-9d24-41ea-95f7-6c1e0e4b6d77 req-afc2372a-0cd5-4eab-8e61-bc9ea23eea31 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] No waiting events found dispatching network-vif-unplugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:15.232985 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e60d2b3b-9d24-41ea-95f7-6c1e0e4b6d77 req-afc2372a-0cd5-4eab-8e61-bc9ea23eea31 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Received event network-vif-unplugged-409f0bf7-c0d0-4da5-97f5-9608b91ea67c for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:08:15.410981 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cb1afec4-669c-4d7c-a297-18f98ec4d562 req-8ef5baa2-c0ba-4e73-a88a-8fede61fb749 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Received event network-vif-deleted-409f0bf7-c0d0-4da5-97f5-9608b91ea67c {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:15.412282 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-cb1afec4-669c-4d7c-a297-18f98ec4d562 req-8ef5baa2-c0ba-4e73-a88a-8fede61fb749 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Neutron deleted interface 409f0bf7-c0d0-4da5-97f5-9608b91ea67c; detaching it from the instance and deleting it from the info cache
May 27 23:08:15.415417 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cb1afec4-669c-4d7c-a297-18f98ec4d562 req-8ef5baa2-c0ba-4e73-a88a-8fede61fb749 service nova] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Detach interface failed, port_id=409f0bf7-c0d0-4da5-97f5-9608b91ea67c, reason: Instance f47a00cc-da92-40c9-a668-9a160670addd could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:08:15.505035 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:15.507322 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-39d7dc88-4cf0-4469-b4b1-6839af8eb292 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.015s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:15.509444 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:08:15.698659 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Successfully created port: 8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:08:15.778635 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:15.778635 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:15.778635 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:15.778635 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No VIF found with MAC fa:16:3e:8a:26:c4, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:08:15.954146 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] opening encrypted volume /dev/dm-9 {{(pid=98289) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 27 23:08:16.014837 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Took 1.37 seconds to deallocate network for instance.
May 27 23:08:16.017634 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:08:16.246153 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Successfully updated port: 8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:08:16.600495 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Took 0.59 seconds to detach 1 volumes for instance.
May 27 23:08:16.749037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:16.749222 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquired lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:16.749342 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:08:17.030537 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:08:17.031600 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:08:17.031866 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Creating image(s)
May 27 23:08:17.032427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "/opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:17.032570 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "/opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:17.032995 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "/opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:17.033878 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:17.036314 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:17.040351 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:17.111052 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:17.111193 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:17.146144 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.106s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:17.146423 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:17.146842 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:17.147203 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:17.150701 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:17.150701 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:17.242168 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:17.242679 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:17.297602 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a4ad45e8-cb5e-4527-8b99-1f6dbef6f9d0 req-24f28512-5e6b-478b-ad37-3cc0d02f5e05 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Received event network-changed-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:17.298084 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a4ad45e8-cb5e-4527-8b99-1f6dbef6f9d0 req-24f28512-5e6b-478b-ad37-3cc0d02f5e05 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Refreshing instance network info cache due to event network-changed-8ca731b3-122c-49a9-aea1-75b46d5644e1. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:08:17.298303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a4ad45e8-cb5e-4527-8b99-1f6dbef6f9d0 req-24f28512-5e6b-478b-ad37-3cc0d02f5e05 service nova] Acquiring lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:17.315791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk 1073741824" returned: 0 in 0.073s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:17.316151 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:17.316446 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:17.355121 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a70e375-e976-41ed-84e5-bfd076006ae2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.558s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:17.400835 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:17.403212 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:08:17.404982 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:08:17.405221 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:17.522663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:17.522663 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Cannot resize image /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:08:17.522663 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:08:17.522663 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Ensure instance console log exists: /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:08:17.522663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:17.522663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:17.522663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:17.601446 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:17.639847 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:17.640100 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:17.728542 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Updating instance_info_cache with network_info: [{"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:17.799283 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb0dbbec-4ce3-4697-9111-d66dc4725633 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:17.799483 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb0dbbec-4ce3-4697-9111-d66dc4725633 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:17.799627 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bb0dbbec-4ce3-4697-9111-d66dc4725633 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:17.801729 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bb0dbbec-4ce3-4697-9111-d66dc4725633 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98289) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 27 23:08:17.802231 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-bb0dbbec-4ce3-4697-9111-d66dc4725633 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:17.822702 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:18.143227 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:18.230490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Releasing lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:18.230755 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Instance network_info: |[{"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:08:18.231135 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a4ad45e8-cb5e-4527-8b99-1f6dbef6f9d0 req-24f28512-5e6b-478b-ad37-3cc0d02f5e05 service nova] Acquired lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:18.232795 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Start _get_guest_xml network_info=[{"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:08:18.233114 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a4ad45e8-cb5e-4527-8b99-1f6dbef6f9d0 req-24f28512-5e6b-478b-ad37-3cc0d02f5e05 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Refreshing network info cache for port 8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:08:18.235654 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:08:18.236965 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1438533498', uuid='92ea712d-1f47-4313-8c9f-6c7a4a5b3c46'), owner=OwnerMeta(userid='08c42711a5d14870b3f4ebecf1deaeeb', username='tempest-TestStampPattern-893938880-project-member', projectid='e077b44d61ee49ffbb4b474bd8b6711a', projectname='tempest-TestStampPattern-893938880'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923298.2364624) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:08:18.237986 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:08:18.238325 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:08:18.239190 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:08:18.239339 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:08:18.240386 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:08:18.240687 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:08:18.240799 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:08:18.240903 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:08:18.241017 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:08:18.241138 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:08:18.241235 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:08:18.241398 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:08:18.241490 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:08:18.241611 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:08:18.241836 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:08:18.241943 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:08:18.252596 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1438533498',display_name='tempest-TestStampPattern-server-1438533498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-teststamppattern-server-1438533498',id=40,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuEcu169UlUv7QteA0pyqLa0rS+TCUcqSe/52EzrwkMxCZMxvXkbwYZZ52jOtlT5g4axqhIG+f70+HHRNLCB4B5BkPxo86FW+2QK/hLCWkxS7WEa7mWN+8QeTpUvCGHkQ==',key_name='tempest-TestStampPattern-1547678374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e077b44d61ee49ffbb4b474bd8b6711a',ramdisk_id='',reservation_id='r-fhl04ehz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-893938880',owner_user_name='tempest-TestStampPattern-893938880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:08:16Z,user_data=None,user_id='08c42711a5d14870b3f4ebecf1deaeeb',uuid=92ea712d-1f47-4313-8c9f-6c7a4a5b3c46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:08:18.252815 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converting VIF {"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:18.253247 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0f:47,bridge_name='br-int',has_traffic_filtering=True,id=8ca731b3-122c-49a9-aea1-75b46d5644e1,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca731b3-12') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:18.254156 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lazy-loading 'pci_devices' on Instance uuid 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:18.325404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Attempting to attach volume 3fa638c3-7504-48e0-a5fc-52d1c14b94c5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:08:18.326668 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:08:18.326668 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:08:18.326668 np0000001565 nova-compute[98289]:   <alias name="ua-3fa638c3-7504-48e0-a5fc-52d1c14b94c5"/>
May 27 23:08:18.326668 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 27 23:08:18.326668 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:08:18.326668 np0000001565 nova-compute[98289]:   <serial>3fa638c3-7504-48e0-a5fc-52d1c14b94c5</serial>
May 27 23:08:18.326668 np0000001565 nova-compute[98289]: </disk>
May 27 23:08:18.326668 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:08:18.650306 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.539s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:18.651825 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.662833 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.716856 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Deleted allocations for instance f47a00cc-da92-40c9-a668-9a160670addd
May 27 23:08:18.735602 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a4ad45e8-cb5e-4527-8b99-1f6dbef6f9d0 req-24f28512-5e6b-478b-ad37-3cc0d02f5e05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:18.756935 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] End _get_guest_xml xml=<domain type="qemu">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <uuid>92ea712d-1f47-4313-8c9f-6c7a4a5b3c46</uuid>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <name>instance-00000028</name>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestStampPattern-server-1438533498</nova:name>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:08:18</nova:creationTime>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:user uuid="08c42711a5d14870b3f4ebecf1deaeeb">tempest-TestStampPattern-893938880-project-member</nova:user>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:project uuid="e077b44d61ee49ffbb4b474bd8b6711a">tempest-TestStampPattern-893938880</nova:project>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         <nova:port uuid="8ca731b3-122c-49a9-aea1-75b46d5644e1">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <system>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <entry name="serial">92ea712d-1f47-4313-8c9f-6c7a4a5b3c46</entry>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <entry name="uuid">92ea712d-1f47-4313-8c9f-6c7a4a5b3c46</entry>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     </system>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <os>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   </os>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <features>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   </features>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   <devices>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk.config"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:48:0f:47"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <target dev="tap8ca731b3-12"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     </interface>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/console.log" append="off"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     </serial>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <video>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     </video>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     </rng>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:   </devices>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]: </domain>
May 27 23:08:18.756935 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:08:18.758935 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Preparing to wait for external event network-vif-plugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:08:18.758935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:18.758935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:18.758935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:18.758935 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1438533498',display_name='tempest-TestStampPattern-server-1438533498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-teststamppattern-server-1438533498',id=40,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuEcu169UlUv7QteA0pyqLa0rS+TCUcqSe/52EzrwkMxCZMxvXkbwYZZ52jOtlT5g4axqhIG+f70+HHRNLCB4B5BkPxo86FW+2QK/hLCWkxS7WEa7mWN+8QeTpUvCGHkQ==',key_name='tempest-TestStampPattern-1547678374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e077b44d61ee49ffbb4b474bd8b6711a',ramdisk_id='',reservation_id='r-fhl04ehz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-893938880',owner_user_name='tempest-TestStampPattern-893938880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:08:16Z,user_data=None,user_id='08c42711a5d14870b3f4ebecf1deaeeb',uuid=92ea712d-1f47-4313-8c9f-6c7a4a5b3c46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:08:18.758935 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converting VIF {"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:18.760000 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0f:47,bridge_name='br-int',has_traffic_filtering=True,id=8ca731b3-122c-49a9-aea1-75b46d5644e1,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca731b3-12') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:18.760000 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0f:47,bridge_name='br-int',has_traffic_filtering=True,id=8ca731b3-122c-49a9-aea1-75b46d5644e1,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca731b3-12') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:08:18.760477 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.760718 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:18.763520 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:08:18.764325 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.764498 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23c6e961-a800-5f4d-83a0-3d6e0acb36a7', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:18.765171 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.765818 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:18.767704 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.769595 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.769763 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ca731b3-12, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:18.770141 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ca731b3-12, col_values=(('qos', UUID('46c22b6f-536b-4b1e-b21b-d5906f66d24c')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:18.770368 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ca731b3-12, col_values=(('external_ids', {'iface-id': '8ca731b3-122c-49a9-aea1-75b46d5644e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:0f:47', 'vm-uuid': '92ea712d-1f47-4313-8c9f-6c7a4a5b3c46'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:18.771761 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.772931 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:18.777208 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.778262 np0000001565 nova-compute[98289]: INFO os_vif [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0f:47,bridge_name='br-int',has_traffic_filtering=True,id=8ca731b3-122c-49a9-aea1-75b46d5644e1,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca731b3-12')
May 27 23:08:18.832309 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.836972 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.861249 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.888140 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.889846 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:18.982512 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-42afba9d-e108-402a-b1ae-52acd44b2535 req-4be2fc05-6cc3-46d2-80e2-2312d05c6ccf service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:18.982968 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-42afba9d-e108-402a-b1ae-52acd44b2535 req-4be2fc05-6cc3-46d2-80e2-2312d05c6ccf service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:18.983157 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-42afba9d-e108-402a-b1ae-52acd44b2535 req-4be2fc05-6cc3-46d2-80e2-2312d05c6ccf service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:18.983374 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-42afba9d-e108-402a-b1ae-52acd44b2535 req-4be2fc05-6cc3-46d2-80e2-2312d05c6ccf service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:18.983424 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-42afba9d-e108-402a-b1ae-52acd44b2535 req-4be2fc05-6cc3-46d2-80e2-2312d05c6ccf service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] No waiting events found dispatching network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:18.983545 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-42afba9d-e108-402a-b1ae-52acd44b2535 req-4be2fc05-6cc3-46d2-80e2-2312d05c6ccf service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received unexpected event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b for instance with vm_state active and task_state powering-off.
May 27 23:08:19.092758 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a4ad45e8-cb5e-4527-8b99-1f6dbef6f9d0 req-24f28512-5e6b-478b-ad37-3cc0d02f5e05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:19.157393 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99974582799996 future=<Future at 0x726e3873dac0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:19.160315 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance destroyed successfully.
May 27 23:08:19.160653 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-bb0dbbec-4ce3-4697-9111-d66dc4725633 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:19.253015 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a4ad45e8-cb5e-4527-8b99-1f6dbef6f9d0 req-24f28512-5e6b-478b-ad37-3cc0d02f5e05 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Updated VIF entry in instance network info cache for port 8ca731b3-122c-49a9-aea1-75b46d5644e1. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:08:19.253246 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a4ad45e8-cb5e-4527-8b99-1f6dbef6f9d0 req-24f28512-5e6b-478b-ad37-3cc0d02f5e05 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Updating instance_info_cache with network_info: [{"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:19.662205 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-bb0dbbec-4ce3-4697-9111-d66dc4725633 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:19.662434 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bb0dbbec-4ce3-4697-9111-d66dc4725633 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:19.723940 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-426c1fc3-fc51-42c9-94e2-dffd9cd097be tempest-AttachVolumeMultiAttachTest-781715127 tempest-AttachVolumeMultiAttachTest-781715127-project-member] Lock "f47a00cc-da92-40c9-a668-9a160670addd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.533s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:19.755156 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a4ad45e8-cb5e-4527-8b99-1f6dbef6f9d0 req-24f28512-5e6b-478b-ad37-3cc0d02f5e05 service nova] Releasing lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:19.984911 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:19.985083 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:19.985206 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:19.985340 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No VIF found with MAC fa:16:3e:2a:b7:2e, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:08:20.169955 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bb0dbbec-4ce3-4697-9111-d66dc4725633 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.370s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:20.299151 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:20.299319 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:20.299319 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No VIF found with MAC fa:16:3e:48:0f:47, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:08:20.301270 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Using config drive
May 27 23:08:20.582999 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:20.810881 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:20.953579 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Creating config drive at /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk.config
May 27 23:08:20.956654 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpja74v0v7 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:21.023007 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpja74v0v7" returned: 0 in 0.066s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:21.044199 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cbfb4b8e-ed55-476d-8e1e-6e55247e9d49 req-32b6dc8b-f3df-412b-a5db-8a9fd89019e0 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:21.045015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cbfb4b8e-ed55-476d-8e1e-6e55247e9d49 req-32b6dc8b-f3df-412b-a5db-8a9fd89019e0 service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:21.045209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cbfb4b8e-ed55-476d-8e1e-6e55247e9d49 req-32b6dc8b-f3df-412b-a5db-8a9fd89019e0 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:21.045428 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cbfb4b8e-ed55-476d-8e1e-6e55247e9d49 req-32b6dc8b-f3df-412b-a5db-8a9fd89019e0 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:21.045819 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cbfb4b8e-ed55-476d-8e1e-6e55247e9d49 req-32b6dc8b-f3df-412b-a5db-8a9fd89019e0 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] No waiting events found dispatching network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:21.045989 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-cbfb4b8e-ed55-476d-8e1e-6e55247e9d49 req-32b6dc8b-f3df-412b-a5db-8a9fd89019e0 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received unexpected event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b for instance with vm_state stopped and task_state powering-on.
May 27 23:08:21.066556 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.000428960000135703 future=<Future at 0x726e602d33b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:21.066885 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:21.067045 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.089749298000243 future=<Future at 0x726e386cf9b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:21.067177 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.089592596999864 future=<Future at 0x726e386cf9b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:21.067582 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Emitting event <LifecycleEvent: 1779923286.0660138, 6a99f05a-6544-4994-9a1a-d98c320d088a => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:21.067762 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] VM Stopped (Lifecycle Event)
May 27 23:08:21.090020 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:21.090145 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquired lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:21.090280 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:08:21.090422 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'info_cache' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:21.470693 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:21.493919 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:21.495310 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:21.550358 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-be150f04-5a35-4dc8-bcc1-87563e3be159 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.640s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:21.568687 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:21.573223 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 6a99f05a-6544-4994-9a1a-d98c320d088a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:21.594743 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:21.659521 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8da5e075-e384-45af-ad95-f8e4132dfef5 req-990ac61b-ba01-4219-9e0b-fefa3c6e572e service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Received event network-vif-plugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:21.659769 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8da5e075-e384-45af-ad95-f8e4132dfef5 req-990ac61b-ba01-4219-9e0b-fefa3c6e572e service nova] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:21.660312 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8da5e075-e384-45af-ad95-f8e4132dfef5 req-990ac61b-ba01-4219-9e0b-fefa3c6e572e service nova] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:21.661494 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8da5e075-e384-45af-ad95-f8e4132dfef5 req-990ac61b-ba01-4219-9e0b-fefa3c6e572e service nova] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:21.661494 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8da5e075-e384-45af-ad95-f8e4132dfef5 req-990ac61b-ba01-4219-9e0b-fefa3c6e572e service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Processing event network-vif-plugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:08:21.823693 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:21.832319 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:21.856208 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:21.862370 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:22.098241 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:22.247213 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:22.247399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:22.271537 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:08:22.272821 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923302.2717557, 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:22.272972 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] VM Started (Lifecycle Event)
May 27 23:08:22.274580 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:08:22.278350 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Instance spawned successfully.
May 27 23:08:22.278758 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:08:22.413640 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:22.556091 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Updating instance_info_cache with network_info: [{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:22.750270 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Detaching volume 3fa638c3-7504-48e0-a5fc-52d1c14b94c5
May 27 23:08:22.777308 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:22.782397 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:22.786878 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:22.786878 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:22.787017 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:22.787189 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:22.787633 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:22.787943 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:22.791528 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Attempting to driver detach volume 3fa638c3-7504-48e0-a5fc-52d1c14b94c5 from mountpoint /dev/vdb
May 27 23:08:22.821918 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '52410d9c-d2b3-4a6f-85f4-ca4f26fe660f', 'attached_at': '', 'detached_at': '', 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'serial': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:08:22.825060 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found disk vdb by alias ua-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:08:22.826308 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found disk vdb by alias ua-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:08:22.826448 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Attempting to detach device vdb from instance 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:08:22.826793 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:08:22.826793 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:08:22.826793 np0000001565 nova-compute[98289]:   <alias name="ua-3fa638c3-7504-48e0-a5fc-52d1c14b94c5"/>
May 27 23:08:22.826793 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 27 23:08:22.826793 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:08:22.826793 np0000001565 nova-compute[98289]:   <serial>3fa638c3-7504-48e0-a5fc-52d1c14b94c5</serial>
May 27 23:08:22.826793 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:08:22.826793 np0000001565 nova-compute[98289]: </disk>
May 27 23:08:22.826793 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:08:22.831443 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully detached device vdb from instance 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f from the persistent domain config.
May 27 23:08:22.831685 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] (1/8): Attempting to detach device vdb with device alias ua-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 from instance 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:08:22.831915 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:08:22.831915 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:08:22.831915 np0000001565 nova-compute[98289]:   <alias name="ua-3fa638c3-7504-48e0-a5fc-52d1c14b94c5"/>
May 27 23:08:22.831915 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 27 23:08:22.831915 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:08:22.831915 np0000001565 nova-compute[98289]:   <serial>3fa638c3-7504-48e0-a5fc-52d1c14b94c5</serial>
May 27 23:08:22.831915 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:08:22.831915 np0000001565 nova-compute[98289]: </disk>
May 27 23:08:22.831915 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:08:23.014903 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:23.058482 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Releasing lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:23.286167 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:08:23.286167 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923303.2848012, 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:23.286167 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] VM Paused (Lifecycle Event)
May 27 23:08:23.293096 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Took 6.26 seconds to spawn the instance on the hypervisor.
May 27 23:08:23.293377 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:23.310114 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 for instance 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:08:23.652426 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:23.719194 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9da2e9e3-3efc-4da5-93c6-6f709c5c77b7 req-e5edfda3-cc2a-495d-9636-b66fb9cd3973 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Received event network-vif-plugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:23.719639 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9da2e9e3-3efc-4da5-93c6-6f709c5c77b7 req-e5edfda3-cc2a-495d-9636-b66fb9cd3973 service nova] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:23.719824 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9da2e9e3-3efc-4da5-93c6-6f709c5c77b7 req-e5edfda3-cc2a-495d-9636-b66fb9cd3973 service nova] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:23.719983 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9da2e9e3-3efc-4da5-93c6-6f709c5c77b7 req-e5edfda3-cc2a-495d-9636-b66fb9cd3973 service nova] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:23.720137 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9da2e9e3-3efc-4da5-93c6-6f709c5c77b7 req-e5edfda3-cc2a-495d-9636-b66fb9cd3973 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] No waiting events found dispatching network-vif-plugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:23.720296 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9da2e9e3-3efc-4da5-93c6-6f709c5c77b7 req-e5edfda3-cc2a-495d-9636-b66fb9cd3973 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Received unexpected event network-vif-plugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 for instance with vm_state active and task_state None.
May 27 23:08:23.772053 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:23.789525 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:23.792227 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923303.7919948, 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:23.792375 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] VM Resumed (Lifecycle Event)
May 27 23:08:23.804591 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Took 12.05 seconds to build instance.
May 27 23:08:24.072475 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance destroyed successfully.
May 27 23:08:24.072475 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:24.294497 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:24.296646 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:24.306806 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ada691f-0a44-4e92-8b23-f5e58891ade8 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.576s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:24.573775 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:24.574083 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'resources' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:24.799507 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923304.7991724, 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f => ua-3fa638c3-7504-48e0-a5fc-52d1c14b94c5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:08:24.804892 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully detached device vdb from instance 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f from the live domain config.
May 27 23:08:24.806434 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:08:24.806691 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:08:24.806879 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:08:24.807593 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x726e602d0590>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '52410d9c-d2b3-4a6f-85f4-ca4f26fe660f', 'attached_at': '', 'detached_at': '', 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'serial': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5'} {{(pid=98289) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 23:08:24.807745 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] closing encrypted volume /dev/dm-1 {{(pid=98289) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 27 23:08:24.834036 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:08:24.834648 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:24.834912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:24.835357 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:24.835770 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:08:24.835985 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:08:24.868674 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:24.868674 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:24.868674 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:24.868674 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:24.868674 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:24.868674 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:24.868674 np0000001565 nova-compute[98289]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:24.868674 np0000001565 nova-compute[98289]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:24.868674 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:24.869021 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:24.869021 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:24.869021 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:24.869021 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:24.869021 np0000001565 nova-compute[98289]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:24.869021 np0000001565 nova-compute[98289]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5 (non-flash)
May 27 23:08:24.869021 np0000001565 nova-compute[98289]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:24.869021 np0000001565 nova-compute[98289]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:24.869021 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:24.869186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '81')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:08:24.869245 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', '78')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:08:24.873067 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5', '79')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:08:24.874225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e602b2b60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5'): ({'sdi'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:08:24.874525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Removing multipathed devices sdi, sdh {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:08:24.874849 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flush multipath device 3300000000f74a0fb {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:08:24.905750 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:08:24.947730 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:08:24.986681 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:08:24.986681 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:08:24.988464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:08:25.001296 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:08:25.001626 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:08:25.014913 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.054633 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5, portal: 192.168.40.100,3260]
May 27 23:08:25.054633 np0000001565 nova-compute[98289]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5, portal: 192.168.40.100,3260] successful.
May 27 23:08:25.054633 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.073397 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.077402 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:25.077402 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-238721078',display_name='tempest-AttachVolumeTestJSON-server-238721078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-238721078',id=37,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Qq0763SlHFA9VpZwsMi86ZEUPb6ApCeF8QACBJQZv1Rp1P7LElgDkrzQ2GQCg/z1bU9PMQyrWIL6JBPLYXYJUrkv+/pKYLhHsqJZtKFBBSXjOqDTK9LJJtTBA4xSw+w==',key_name='tempest-keypair-2072419759',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:27Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-rnai6jvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:08:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:08:25.077402 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:25.077402 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:25.078271 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:08:25.080093 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:25.080445 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda08a446-87, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:25.081558 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:25.085000 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.085529 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:25.086373 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:25.086650 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5fadbf96-222d-4f75-b92f-538b89affdce) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:25.089372 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:25.090369 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:25.092120 np0000001565 nova-compute[98289]: INFO os_vif [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87')
May 27 23:08:25.093723 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:08:25.094345 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:25.094580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:25.115518 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5, portal: 192.168.50.100,3260]
May 27 23:08:25.115518 np0000001565 nova-compute[98289]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-3fa638c3-7504-48e0-a5fc-52d1c14b94c5, portal: 192.168.50.100,3260] successful.
May 27 23:08:25.115518 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.133589 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.134639 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:25.134959 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== disconnect_volume: return (300ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:25.135132 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:08:25.136942 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.042s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:25.137543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:08:25.137543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:25.173294 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '81')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:08:25.173294 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '80')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:08:25.175101 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '81')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:08:25.176141 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e38708b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'): ({'sdk'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:08:25.176465 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Removing multipathed devices sdj, sdk {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:08:25.176820 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flush multipath device 330000000cfb42acf {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:08:25.217679 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:08:25.274260 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:08:25.318471 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:08:25.318471 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:08:25.318471 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:08:25.329255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:08:25.329255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:08:25.340170 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.382956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.40.100,3260]
May 27 23:08:25.382956 np0000001565 nova-compute[98289]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.40.100,3260] successful.
May 27 23:08:25.382956 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.398000 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.411033 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.440633 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.50.100,3260]
May 27 23:08:25.440633 np0000001565 nova-compute[98289]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.50.100,3260] successful.
May 27 23:08:25.440633 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.456764 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:25.456764 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:25.456764 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] <== disconnect_volume: return (361ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:25.456764 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:08:25.461363 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Start _get_guest_xml network_info=[{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '12fa667c-aef5-4a62-bd71-79fa0da1b91a', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, 'status': 'reserved', 'instance': '4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6', 'attached_at': '', 'detached_at': '', 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'serial': '6b311228-b94c-4246-8c69-1659f524de84'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:08:25.463690 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:08:25.464944 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-238721078', uuid='4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6'), owner=OwnerMeta(userid='946d9258fd0841dca06d0184677f7376', username='tempest-AttachVolumeTestJSON-849627440-project-member', projectid='996f2d92ddf941fab9c407482cbb534e', projectname='tempest-AttachVolumeTestJSON-849627440'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923305.4646616) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:08:25.466217 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:08:25.466731 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:08:25.467748 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:08:25.467988 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:08:25.469120 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:08:25.469568 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:08:25.470357 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:08:25.470357 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:08:25.470357 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:08:25.470357 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:08:25.470762 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:08:25.470971 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:08:25.471133 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:08:25.471349 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:08:25.471522 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:08:25.471710 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:08:25.471915 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:25.686662 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:25.973995 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:25.987201 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:26.044790 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dac6f746-3b79-42c7-a817-3d1acdca24ea req-cb9e7f7d-7f20-4ed4-9c8a-68e26bf2f6d3 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Received event network-changed-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:26.045050 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dac6f746-3b79-42c7-a817-3d1acdca24ea req-cb9e7f7d-7f20-4ed4-9c8a-68e26bf2f6d3 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Refreshing instance network info cache due to event network-changed-8ca731b3-122c-49a9-aea1-75b46d5644e1. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:08:26.045382 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dac6f746-3b79-42c7-a817-3d1acdca24ea req-cb9e7f7d-7f20-4ed4-9c8a-68e26bf2f6d3 service nova] Acquiring lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:26.046136 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dac6f746-3b79-42c7-a817-3d1acdca24ea req-cb9e7f7d-7f20-4ed4-9c8a-68e26bf2f6d3 service nova] Acquired lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:26.049268 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dac6f746-3b79-42c7-a817-3d1acdca24ea req-cb9e7f7d-7f20-4ed4-9c8a-68e26bf2f6d3 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Refreshing network info cache for port 8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:08:26.101088 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.config --force-share --output=json" returned: 0 in 0.114s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:26.101588 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:26.101831 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:26.102465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:26.102873 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:08:26.103278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:26.103464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:26.103852 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:26.104311 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:08:26.119500 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:26.119976 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:26.123461 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:26.123686 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:08:26.124113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:26.124647 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:08:26.138025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:08:26.138025 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:26.148201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:08:26.148201 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:26.153551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84] added
May 27 23:08:26.153551 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:08:26.153551 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:26.153551 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:26.153551 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:26.153551 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:26.153551 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:26.154087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:08:26.154087 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:08:26.154087 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:08:26.159325 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84] added
May 27 23:08:26.159325 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:08:26.159325 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:26.159325 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:26.159325 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:26.159325 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:26.159325 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:26.159325 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:08:26.159325 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0358(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:08:26.159325 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:08:26.520525 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:26.553345 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-dac6f746-3b79-42c7-a817-3d1acdca24ea req-cb9e7f7d-7f20-4ed4-9c8a-68e26bf2f6d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:26.697899 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-be65eaa2-6047-4b34-bf63-abcc707bb88e tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.450s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:27.007472 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-dac6f746-3b79-42c7-a817-3d1acdca24ea req-cb9e7f7d-7f20-4ed4-9c8a-68e26bf2f6d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:27.154504 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:08:27.158661 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dac6f746-3b79-42c7-a817-3d1acdca24ea req-cb9e7f7d-7f20-4ed4-9c8a-68e26bf2f6d3 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Updated VIF entry in instance network info cache for port 8ca731b3-122c-49a9-aea1-75b46d5644e1. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:08:27.159594 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dac6f746-3b79-42c7-a817-3d1acdca24ea req-cb9e7f7d-7f20-4ed4-9c8a-68e26bf2f6d3 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Updating instance_info_cache with network_info: [{"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:27.160164 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:08:27.170897 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:08:27.170897 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:08:27.178141 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:08:27.178141 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:27.188225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:27.193874 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:27.208105 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.208105 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.208105 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.208105 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.208105 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:27.208105 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.208105 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.208105 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.208105 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.208105 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:27.212817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.212817 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.212817 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.212817 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.212817 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:27.213729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.213729 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.213729 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.213729 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.213729 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:27.248234 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.50.100,3260]
May 27 23:08:27.248234 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.50.100,3260] successful.
May 27 23:08:27.248234 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:27.259608 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.40.100,3260]
May 27 23:08:27.259608 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.40.100,3260] successful.
May 27 23:08:27.259608 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:27.262561 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:27.277252 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:27.290496 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] HCTL ('9', '-', '-', 0) found on session 82 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:08:27.290496 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:27.295998 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:27.295998 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:08:27.296563 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] HCTL ('10', '-', '-', 0) found on session 83 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:08:27.296563 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:08:27.316017 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching for a device in session 82 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:08:27.316017 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:08:27.317323 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching for a device in session 83 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:08:27.317647 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:08:27.389784 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:27.389784 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:27.389784 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:27.391075 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:27.391297 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:27.395014 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Terminating instance
May 27 23:08:27.664158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dac6f746-3b79-42c7-a817-3d1acdca24ea req-cb9e7f7d-7f20-4ed4-9c8a-68e26bf2f6d3 service nova] Releasing lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:27.723457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:27.723549 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:27.723719 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:27.723835 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:27.723955 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:27.726275 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Terminating instance
May 27 23:08:27.898243 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:08:27.918717 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:27.943878 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:27.948011 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:27.972771 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.098238 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c9666de2-0734-4f01-9ca8-fc6e9c7c4df7 req-5cba707e-b9e7-4d55-a95e-2baa82a5f707 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:28.098678 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c9666de2-0734-4f01-9ca8-fc6e9c7c4df7 req-5cba707e-b9e7-4d55-a95e-2baa82a5f707 service nova] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:28.098763 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c9666de2-0734-4f01-9ca8-fc6e9c7c4df7 req-5cba707e-b9e7-4d55-a95e-2baa82a5f707 service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:28.098925 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c9666de2-0734-4f01-9ca8-fc6e9c7c4df7 req-5cba707e-b9e7-4d55-a95e-2baa82a5f707 service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:28.099342 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c9666de2-0734-4f01-9ca8-fc6e9c7c4df7 req-5cba707e-b9e7-4d55-a95e-2baa82a5f707 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] No waiting events found dispatching network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:28.099532 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c9666de2-0734-4f01-9ca8-fc6e9c7c4df7 req-5cba707e-b9e7-4d55-a95e-2baa82a5f707 service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:08:28.121893 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:08:28.228087 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999703287999637 future=<Future at 0x726e3874be90 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:28.229547 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:08:28.232744 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Instance destroyed successfully.
May 27 23:08:28.233401 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lazy-loading 'resources' on Instance uuid a58d20c9-5038-4ea3-842e-406b0253f15b {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:28.253796 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.278275 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.281070 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.311468 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.559231 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999756877999971 future=<Future at 0x726e387eb050 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:28.561280 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Instance destroyed successfully.
May 27 23:08:28.562385 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'resources' on Instance uuid 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:28.659198 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.738410 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2055205716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumeshelvetestjson-server-2055205716',id=34,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlXgwR+mJL4X62uviA59Sg2o4dXlvjOmgIlg6odsB10BjNBoGqu01/G0GMdVvx7UUCkjG6N+PhuPE4wyV5SToTI9u2Z8MdBW6kzcc68Hmu+/strmT6yCpg+Ql8+rNl3eg==',key_name='tempest-keypair-1961618511',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:08:03Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='475430e1d5044d9b97a65459543a1361',ramdisk_id='',reservation_id='r-j4dw1ehs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-876504441',owner_user_name='tempest-AttachVolumeShelveTestJSON-876504441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1c936280234ce2ab39aacb89c5af22',uuid=a58d20c9-5038-4ea3-842e-406b0253f15b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:08:28.738410 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converting VIF {"id": "fcd4468c-2b77-4da0-a875-6375149e0a09", "address": "fa:16:3e:fc:4f:23", "network": {"id": "037d4bd8-06af-44df-9815-60d3aa66a445", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-769958576-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "475430e1d5044d9b97a65459543a1361", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd4468c-2b", "ovs_interfaceid": "fcd4468c-2b77-4da0-a875-6375149e0a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:28.738410 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:28.738410 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:08:28.739302 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.740075 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcd4468c-2b, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:28.741170 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.742912 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:28.761630 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.765920 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.768108 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.768292 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=471c381e-c0a2-4a74-a6fa-1947568bf690) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:28.768844 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.769549 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:28.775221 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:28.777322 np0000001565 nova-compute[98289]: INFO os_vif [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:23,bridge_name='br-int',has_traffic_filtering=True,id=fcd4468c-2b77-4da0-a875-6375149e0a09,network=Network(037d4bd8-06af-44df-9815-60d3aa66a445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcd4468c-2b')
May 27 23:08:28.777653 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Deleting instance files /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b_del
May 27 23:08:28.787497 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Deletion of /opt/stack/data/nova/instances/a58d20c9-5038-4ea3-842e-406b0253f15b_del complete
May 27 23:08:29.063883 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1453941894',display_name='tempest-TestEncryptedCinderVolumes-server-1453941894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1453941894',id=38,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFWvH87oABsV3uPFPgYowmUUoUVRr/GvAtWFdPOg1d3C/UpqJiVaIb1ibllY84bdi+0xGc8nekizLJ4RH7M0wx/xu6EJhieQdJe2mNFy7blK69XA7d9Kkt2ox9C1M39+g==',key_name='tempest-keypair-625197076',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:32Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-hdknahey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:07:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=52410d9c-d2b3-4a6f-85f4-ca4f26fe660f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:08:29.064154 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "address": "fa:16:3e:2a:b7:2e", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d3ed57-0a", "ovs_interfaceid": "b0d3ed57-0a73-4f63-9330-eb4626f68f3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:29.064655 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=b0d3ed57-0a73-4f63-9330-eb4626f68f3d,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d3ed57-0a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:29.064878 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=b0d3ed57-0a73-4f63-9330-eb4626f68f3d,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d3ed57-0a') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:08:29.065854 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:29.066208 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0d3ed57-0a, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:29.067377 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:29.068459 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:29.069304 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:29.069532 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96ee9ab8-921a-4da6-a332-3f5d781902f3) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:29.070035 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:29.070712 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:29.072176 np0000001565 nova-compute[98289]: INFO os_vif [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=b0d3ed57-0a73-4f63-9330-eb4626f68f3d,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d3ed57-0a')
May 27 23:08:29.072442 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Deleting instance files /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f_del
May 27 23:08:29.073146 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Deletion of /opt/stack/data/nova/instances/52410d9c-d2b3-4a6f-85f4-ca4f26fe660f_del complete
May 27 23:08:29.140093 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Found WWN 330000000cfb42acf for multipath device dm-1 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:08:29.140624 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:29.140624 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000cfb42acf', 'path': '/dev/dm-1', 'multipath_id': '330000000cfb42acf'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:29.140624 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cfb42acf', 'path': '/dev/dm-1', 'multipath_id': '330000000cfb42acf'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:08:29.157232 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004087309998794808 future=<Future at 0x726e386cf9b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:29.157513 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:29.157513 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=4.99965113799999 future=<Future at 0x726e3873dac0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:29.157513 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=4.999575546999949 future=<Future at 0x726e3873dac0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:29.158373 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Emitting event <LifecycleEvent: 1779923294.1567068, f47a00cc-da92-40c9-a668-9a160670addd => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:29.158651 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] VM Stopped (Lifecycle Event)
May 27 23:08:29.295292 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Took 1.40 seconds to destroy the instance on the hypervisor.
May 27 23:08:29.296071 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:08:29.296477 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:08:29.296633 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:08:29.296905 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:29.362584 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:29.583790 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Took 1.35 seconds to destroy the instance on the hypervisor.
May 27 23:08:29.583790 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:08:29.583790 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:08:29.584108 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:08:29.584108 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:29.646491 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-238721078',display_name='tempest-AttachVolumeTestJSON-server-238721078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-238721078',id=37,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Qq0763SlHFA9VpZwsMi86ZEUPb6ApCeF8QACBJQZv1Rp1P7LElgDkrzQ2GQCg/z1bU9PMQyrWIL6JBPLYXYJUrkv+/pKYLhHsqJZtKFBBSXjOqDTK9LJJtTBA4xSw+w==',key_name='tempest-keypair-2072419759',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:27Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-rnai6jvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:08:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:08:29.647365 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:29.648036 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:29.649425 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:29.665023 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: f47a00cc-da92-40c9-a668-9a160670addd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:29.685164 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:29.746621 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:30.155362 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:30.155362 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] End _get_guest_xml xml=<domain type="qemu">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <uuid>4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6</uuid>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <name>instance-00000025</name>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeTestJSON-server-238721078</nova:name>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:08:25</nova:creationTime>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:user uuid="946d9258fd0841dca06d0184677f7376">tempest-AttachVolumeTestJSON-849627440-project-member</nova:user>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:project uuid="996f2d92ddf941fab9c407482cbb534e">tempest-AttachVolumeTestJSON-849627440</nova:project>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         <nova:port uuid="da08a446-879f-4bdd-9ac4-5d3d736fc30b">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <system>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <entry name="serial">4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6</entry>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <entry name="uuid">4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6</entry>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     </system>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <os>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   </os>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <features>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   </features>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   <devices>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.config"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <alias name="ua-6b311228-b94c-4246-8c69-1659f524de84"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-1"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <serial>6b311228-b94c-4246-8c69-1659f524de84</serial>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:8a:26:c4"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <target dev="tapda08a446-87"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     </interface>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/console.log" append="off"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     </serial>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <video>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     </video>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     </rng>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:   </devices>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]: </domain>
May 27 23:08:30.155362 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:08:30.155362 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:30.194657 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:30.195063 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] Acquiring lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:30.195453 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:30.195656 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:30.195875 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] No waiting events found dispatching network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:30.196057 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-vif-unplugged-fcd4468c-2b77-4da0-a875-6375149e0a09 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:08:30.196212 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Received event network-vif-unplugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:30.196420 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] Acquiring lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:30.196605 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:30.196769 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:30.196909 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] No waiting events found dispatching network-vif-unplugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:30.197051 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Received event network-vif-unplugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:08:30.197676 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Received event network-vif-unplugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:30.197871 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] Acquiring lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:30.198045 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:30.198175 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:30.198318 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] No waiting events found dispatching network-vif-unplugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:30.198486 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Received event network-vif-unplugged-b0d3ed57-0a73-4f63-9330-eb4626f68f3d for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:08:30.199043 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Received event network-vif-deleted-fcd4468c-2b77-4da0-a875-6375149e0a09 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:30.199314 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Neutron deleted interface fcd4468c-2b77-4da0-a875-6375149e0a09; detaching it from the instance and deleting it from the info cache
May 27 23:08:30.204198 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b0a7a18b-cfbe-4055-8bbf-7cb3fe2adad9 req-8bc05b2a-5bee-4fe4-aa78-db85f6261ffa service nova] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Detach interface failed, port_id=fcd4468c-2b77-4da0-a875-6375149e0a09, reason: Instance a58d20c9-5038-4ea3-842e-406b0253f15b could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:08:30.265882 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2028d4c4-442a-4fc6-bbdc-5d06b90aca31 req-98bac515-c7b2-4efc-bbbc-957077abbfe4 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Received event network-vif-deleted-b0d3ed57-0a73-4f63-9330-eb4626f68f3d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:30.265984 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-2028d4c4-442a-4fc6-bbdc-5d06b90aca31 req-98bac515-c7b2-4efc-bbbc-957077abbfe4 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Neutron deleted interface b0d3ed57-0a73-4f63-9330-eb4626f68f3d; detaching it from the instance and deleting it from the info cache
May 27 23:08:30.267419 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2028d4c4-442a-4fc6-bbdc-5d06b90aca31 req-98bac515-c7b2-4efc-bbbc-957077abbfe4 service nova] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Detach interface failed, port_id=b0d3ed57-0a73-4f63-9330-eb4626f68f3d, reason: Instance 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:08:30.280912 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:30.281389 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:30.325975 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:30.377288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:30.377754 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:08:30.378444 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:30.727104 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:30.830962 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Took 1.53 seconds to deallocate network for instance.
May 27 23:08:30.880224 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:30.883348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:30.975583 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:30.982398 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:08:30.982398 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:31.069947 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:31.072207 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Cannot resize image /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:08:31.072207 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'migration_context' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:31.229179 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Took 1.65 seconds to deallocate network for instance.
May 27 23:08:31.337926 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:31.338059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:31.575516 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:31.575516 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-238721078',display_name='tempest-AttachVolumeTestJSON-server-238721078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-238721078',id=37,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Qq0763SlHFA9VpZwsMi86ZEUPb6ApCeF8QACBJQZv1Rp1P7LElgDkrzQ2GQCg/z1bU9PMQyrWIL6JBPLYXYJUrkv+/pKYLhHsqJZtKFBBSXjOqDTK9LJJtTBA4xSw+w==',key_name='tempest-keypair-2072419759',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:27Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-rnai6jvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:08:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:08:31.575516 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:31.575516 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:31.575516 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:08:31.576024 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:31.576385 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:31.576729 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:08:31.577868 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:31.577868 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f18cdd6d-3c89-597d-a891-9147c3ade8c8', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:31.595086 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:31.595926 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:31.596813 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:31.599276 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:31.599591 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda08a446-87, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:31.600009 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda08a446-87, col_values=(('qos', UUID('b0e8c419-373c-4efe-bfe3-ffebfbeabad0')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:31.600268 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda08a446-87, col_values=(('external_ids', {'iface-id': 'da08a446-879f-4bdd-9ac4-5d3d736fc30b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:26:c4', 'vm-uuid': '4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:31.601209 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:31.603494 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:31.607144 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:31.608443 np0000001565 nova-compute[98289]: INFO os_vif [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87')
May 27 23:08:31.656444 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:31.656716 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:31.738251 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:31.887253 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:31.887506 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:32.067959 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:32.093232 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:32.093470 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:32.160693 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:32.195877 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:32.389432 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:08:32.425136 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:32.426880 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:32.437503 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:32.458985 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:32.667259 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.329s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:32.669128 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.929s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:32.750639 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Deleted allocations for instance a58d20c9-5038-4ea3-842e-406b0253f15b
May 27 23:08:32.792552 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2284420b-8043-46ca-8542-b21da4af27ab req-03616eb8-f856-4fb6-a4d9-7593d3bb729b service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:32.794880 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2284420b-8043-46ca-8542-b21da4af27ab req-03616eb8-f856-4fb6-a4d9-7593d3bb729b service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:32.795143 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2284420b-8043-46ca-8542-b21da4af27ab req-03616eb8-f856-4fb6-a4d9-7593d3bb729b service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:32.795251 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2284420b-8043-46ca-8542-b21da4af27ab req-03616eb8-f856-4fb6-a4d9-7593d3bb729b service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:32.795982 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2284420b-8043-46ca-8542-b21da4af27ab req-03616eb8-f856-4fb6-a4d9-7593d3bb729b service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] No waiting events found dispatching network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:32.795982 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-2284420b-8043-46ca-8542-b21da4af27ab req-03616eb8-f856-4fb6-a4d9-7593d3bb729b service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received unexpected event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b for instance with vm_state stopped and task_state powering-on.
May 27 23:08:32.905443 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 due to new event <LifecycleEvent: 1779923312.9049435, 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:08:32.905530 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923312.9049435, 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:32.905678 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] VM Resumed (Lifecycle Event)
May 27 23:08:32.909289 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance event wait completed in 0 seconds for  {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:08:32.912185 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance rebooted successfully.
May 27 23:08:32.967366 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:33.043513 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:33.043771 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:33.412001 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:33.413590 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:33.546188 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:33.657118 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:33.763985 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c042497-e4ae-4484-8bc0-aac904d2d467 tempest-AttachVolumeShelveTestJSON-876504441 tempest-AttachVolumeShelveTestJSON-876504441-project-member] Lock "a58d20c9-5038-4ea3-842e-406b0253f15b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.375s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:33.917350 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 23:08:33.917643 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923313.9174325, 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:33.917821 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] VM Started (Lifecycle Event)
May 27 23:08:34.053125 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.386s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:34.054894 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.086s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:34.059974 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:08:34.059974 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Claim successful on node np0000001565
May 27 23:08:34.100564 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deleted allocations for instance 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f
May 27 23:08:34.157740 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00061920200005261 future=<Future at 0x726e3873dac0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:34.157863 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:34.158605 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.069618330999674 future=<Future at 0x726e3874be90 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:34.158605 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.069544142999803 future=<Future at 0x726e3874be90 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:34.421260 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:34.425971 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:34.428873 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:34.429106 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:34.429340 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:34.429502 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No VIF found with MAC fa:16:3e:8a:26:c4, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:08:34.429885 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9af127ab-ba74-4363-9b47-747bcaf67caa tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:34.843975 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8ff8489e-5ad1-493d-abe5-9c95be316fb6 req-ba6f84f5-1411-4ef4-8c37-d6ab610d0793 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:34.844405 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8ff8489e-5ad1-493d-abe5-9c95be316fb6 req-ba6f84f5-1411-4ef4-8c37-d6ab610d0793 service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:34.844585 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8ff8489e-5ad1-493d-abe5-9c95be316fb6 req-ba6f84f5-1411-4ef4-8c37-d6ab610d0793 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:34.844724 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8ff8489e-5ad1-493d-abe5-9c95be316fb6 req-ba6f84f5-1411-4ef4-8c37-d6ab610d0793 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:34.844866 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8ff8489e-5ad1-493d-abe5-9c95be316fb6 req-ba6f84f5-1411-4ef4-8c37-d6ab610d0793 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] No waiting events found dispatching network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:34.845118 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-8ff8489e-5ad1-493d-abe5-9c95be316fb6 req-ba6f84f5-1411-4ef4-8c37-d6ab610d0793 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received unexpected event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b for instance with vm_state active and task_state None.
May 27 23:08:34.928559 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 23:08:35.110950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-da37a07c-66a3-4866-9554-629c4eb4730f tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "52410d9c-d2b3-4a6f-85f4-ca4f26fe660f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.387s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:35.326815 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:35.327138 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:35.829757 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:36.338307 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.285s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:36.338862 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:08:36.450440 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:36.450608 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:36.450736 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Shelve offloading
May 27 23:08:36.608270 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:36.845981 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:08:36.846298 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:08:36.846584 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:36.846887 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:36.929582 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9df5f69b62834b2caaf76302e55c9707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cb500558784c258720ab29bf2d40fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:08:37.353201 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:08:37.481632 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:37.503635 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:37.516208 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:37.542744 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:37.542744 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:37.557027 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Successfully created port: d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:08:37.688751 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e48de28d-0444-4b59-8054-f2f1593ab8d5 req-0ddff82a-9bb4-4008-a70c-4213201583e9 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:37.688751 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e48de28d-0444-4b59-8054-f2f1593ab8d5 req-0ddff82a-9bb4-4008-a70c-4213201583e9 service nova] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:37.689032 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e48de28d-0444-4b59-8054-f2f1593ab8d5 req-0ddff82a-9bb4-4008-a70c-4213201583e9 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:37.689032 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e48de28d-0444-4b59-8054-f2f1593ab8d5 req-0ddff82a-9bb4-4008-a70c-4213201583e9 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:37.689161 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e48de28d-0444-4b59-8054-f2f1593ab8d5 req-0ddff82a-9bb4-4008-a70c-4213201583e9 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] No waiting events found dispatching network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:37.689261 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e48de28d-0444-4b59-8054-f2f1593ab8d5 req-0ddff82a-9bb4-4008-a70c-4213201583e9 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received unexpected event network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f for instance with vm_state active and task_state shelving.
May 27 23:08:37.817741 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999674273999972 future=<Future at 0x726e5816a960 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:37.818917 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Instance destroyed successfully.
May 27 23:08:37.819347 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lazy-loading 'numa_topology' on Instance uuid d099633e-fe8f-425b-b486-3f325ce97d12 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:37.857091 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:08:38.325425 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:38.328853 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Successfully updated port: d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:08:38.331275 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:38.331456 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquired lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:38.331649 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:08:38.687369 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:38.690522 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:38.834647 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:38.838032 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "refresh_cache-f6a3b268-ad24-445e-a58c-b1e35a289f56" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:38.838173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquired lock "refresh_cache-f6a3b268-ad24-445e-a58c-b1e35a289f56" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:38.838469 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:08:38.876231 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:08:38.882975 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:08:38.882975 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Creating image(s)
May 27 23:08:38.882975 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:38.882975 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "/opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:38.882975 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "/opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:38.885750 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:38.890456 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:38.891582 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:39.002234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.109s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:39.002838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:39.003321 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:39.003795 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:39.007966 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:39.008640 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:39.098817 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:39.099205 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:39.157985 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk 1073741824" returned: 0 in 0.058s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:39.158409 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:39.158734 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:39.244028 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:39.244454 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:08:39.244714 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:39.331266 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:39.333932 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:39.333932 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Cannot resize image /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:08:39.334657 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:08:39.334657 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Ensure instance console log exists: /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:08:39.334840 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:39.335037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:39.335715 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:39.444929 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:08:39.519534 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating instance_info_cache with network_info: [{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:39.640094 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:39.790650 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:39.790650 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:39.790650 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:39.792064 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:39.793138 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] No waiting events found dispatching network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:39.793138 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received unexpected event network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f for instance with vm_state active and task_state shelving.
May 27 23:08:39.795406 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Received event network-changed-d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:39.795851 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Refreshing instance network info cache due to event network-changed-d2d9e625-52c4-4ee3-a7cb-5608d369222f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:08:39.795851 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] Acquiring lock "refresh_cache-f6a3b268-ad24-445e-a58c-b1e35a289f56" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:39.807328 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Updating instance_info_cache with network_info: [{"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:40.024304 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Releasing lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:40.025091 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:40.025290 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:40.281502 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:40.282177 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:40.309069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Releasing lock "refresh_cache-f6a3b268-ad24-445e-a58c-b1e35a289f56" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:40.309520 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Instance network_info: |[{"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:08:40.310180 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] Acquired lock "refresh_cache-f6a3b268-ad24-445e-a58c-b1e35a289f56" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:40.312258 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Start _get_guest_xml network_info=[{"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:08:40.313697 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Refreshing network info cache for port d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:08:40.317963 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:08:40.319242 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1592918536', uuid='f6a3b268-ad24-445e-a58c-b1e35a289f56'), owner=OwnerMeta(userid='9df5f69b62834b2caaf76302e55c9707', username='tempest-AttachVolumeNegativeTest-1834166666-project-member', projectid='47cb500558784c258720ab29bf2d40fe', projectname='tempest-AttachVolumeNegativeTest-1834166666'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923320.3188477) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:08:40.320303 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:08:40.320796 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:08:40.322727 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:08:40.322934 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:08:40.323933 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:08:40.324186 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:08:40.324274 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:08:40.324380 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:08:40.324489 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:08:40.324614 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:08:40.324703 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:08:40.324852 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:08:40.325173 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:08:40.325173 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:08:40.325173 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:08:40.325324 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:08:40.335740 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1592918536',display_name='tempest-AttachVolumeNegativeTest-server-1592918536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1592918536',id=41,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZfx0Zf4i6q1AY6g6YrvtRS8TcDci8yjBmSFKz4SDY2PPFSG8gbzOC87NBlOGkIBDijEPWVIq833Upg3c1gMqLWHGz1RR3Ml2pfm5Md57TXJ0VwV08x4MVwjJQizx9Kaw==',key_name='tempest-keypair-995744843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-5n46wwwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:08:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=f6a3b268-ad24-445e-a58c-b1e35a289f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:08:40.335978 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:40.336412 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:13:72,bridge_name='br-int',has_traffic_filtering=True,id=d2d9e625-52c4-4ee3-a7cb-5608d369222f,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d9e625-52') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:40.337250 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'pci_devices' on Instance uuid f6a3b268-ad24-445e-a58c-b1e35a289f56 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:40.460668 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Instance destroyed successfully.
May 27 23:08:40.461073 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lazy-loading 'resources' on Instance uuid d099633e-fe8f-425b-b486-3f325ce97d12 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:40.504976 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-40500d5a-3966-4de8-b2ca-9acb3998f6b3 req-7b33e7db-f0b0-4cf1-97d4-474627e8371b service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-changed-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:40.504976 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-40500d5a-3966-4de8-b2ca-9acb3998f6b3 req-7b33e7db-f0b0-4cf1-97d4-474627e8371b service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Refreshing instance network info cache due to event network-changed-0ec6133d-baba-415d-82ec-9cbe8dfb935f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:08:40.504976 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40500d5a-3966-4de8-b2ca-9acb3998f6b3 req-7b33e7db-f0b0-4cf1-97d4-474627e8371b service nova] Acquiring lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:40.504976 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40500d5a-3966-4de8-b2ca-9acb3998f6b3 req-7b33e7db-f0b0-4cf1-97d4-474627e8371b service nova] Acquired lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:40.504976 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-40500d5a-3966-4de8-b2ca-9acb3998f6b3 req-7b33e7db-f0b0-4cf1-97d4-474627e8371b service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Refreshing network info cache for port 0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:08:40.788053 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:08:40.818526 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:40.839509 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] End _get_guest_xml xml=<domain type="qemu">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <uuid>f6a3b268-ad24-445e-a58c-b1e35a289f56</uuid>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <name>instance-00000029</name>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1592918536</nova:name>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:08:40</nova:creationTime>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:user uuid="9df5f69b62834b2caaf76302e55c9707">tempest-AttachVolumeNegativeTest-1834166666-project-member</nova:user>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:project uuid="47cb500558784c258720ab29bf2d40fe">tempest-AttachVolumeNegativeTest-1834166666</nova:project>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         <nova:port uuid="d2d9e625-52c4-4ee3-a7cb-5608d369222f">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <system>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <entry name="serial">f6a3b268-ad24-445e-a58c-b1e35a289f56</entry>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <entry name="uuid">f6a3b268-ad24-445e-a58c-b1e35a289f56</entry>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     </system>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <os>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   </os>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <features>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   </features>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   <devices>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk.config"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:19:13:72"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <target dev="tapd2d9e625-52"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     </interface>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/console.log" append="off"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     </serial>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <video>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     </video>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     </rng>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:   </devices>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]: </domain>
May 27 23:08:40.839509 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:08:40.842154 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Preparing to wait for external event network-vif-plugged-d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:08:40.842154 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:40.842154 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:40.842154 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:40.842154 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1592918536',display_name='tempest-AttachVolumeNegativeTest-server-1592918536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1592918536',id=41,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZfx0Zf4i6q1AY6g6YrvtRS8TcDci8yjBmSFKz4SDY2PPFSG8gbzOC87NBlOGkIBDijEPWVIq833Upg3c1gMqLWHGz1RR3Ml2pfm5Md57TXJ0VwV08x4MVwjJQizx9Kaw==',key_name='tempest-keypair-995744843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-5n46wwwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:08:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=f6a3b268-ad24-445e-a58c-b1e35a289f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:08:40.842154 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:40.842154 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:13:72,bridge_name='br-int',has_traffic_filtering=True,id=d2d9e625-52c4-4ee3-a7cb-5608d369222f,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d9e625-52') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:40.842154 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:13:72,bridge_name='br-int',has_traffic_filtering=True,id=d2d9e625-52c4-4ee3-a7cb-5608d369222f,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d9e625-52') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:08:40.846492 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.846492 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:40.846492 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:08:40.846947 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.847079 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a99f0ab-d513-53a2-8fc4-52253b5dddc5', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:40.848967 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.849478 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:40.858977 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.861094 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.861282 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2d9e625-52, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:40.863551 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2d9e625-52, col_values=(('qos', UUID('bd6e05a1-048e-4135-84be-d17c43c492f3')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:40.863551 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2d9e625-52, col_values=(('external_ids', {'iface-id': 'd2d9e625-52c4-4ee3-a7cb-5608d369222f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:13:72', 'vm-uuid': 'f6a3b268-ad24-445e-a58c-b1e35a289f56'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:40.863551 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.863658 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:40.874373 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.875595 np0000001565 nova-compute[98289]: INFO os_vif [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:13:72,bridge_name='br-int',has_traffic_filtering=True,id=d2d9e625-52c4-4ee3-a7cb-5608d369222f,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d9e625-52')
May 27 23:08:40.962735 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Object Instance<d099633e-fe8f-425b-b486-3f325ce97d12> lazy-loaded attributes: numa_topology,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:40.963407 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1892961998',display_name='tempest-TestShelveInstance-server-1892961998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testshelveinstance-server-1892961998',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWCU6efaHvzG5loviLci2EWhflUFzxorLb2dKK8/e4l6LBfmbsuAMiPeTHSpUAakWRl1Yt9Cuh7F6B+3kDbokEdnyEqt/j2SLnkbohJPY+gKSpX+1QSNNHsYyNbdnkWNw==',key_name='tempest-TestShelveInstance-1672332914',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:57Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce5d1153ffbc42b5863df7b2db23eaec',ramdisk_id='',reservation_id='r-dl8ft992',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1900497856',owner_user_name='tempest-TestShelveInstance-1900497856-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:07:57Z,user_data=None,user_id='e16486bc9a2b451788f9c61df0c20472',uuid=d099633e-fe8f-425b-b486-3f325ce97d12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:08:40.963593 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converting VIF {"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:40.964065 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:40.964288 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:08:40.965962 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.966120 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ec6133d-ba, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:40.967136 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.967720 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:40.972658 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.973248 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.973392 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=745e3424-af94-41e3-a0bb-d62f8be8c8c0) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:40.973858 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.974188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:40.980095 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:40.982545 np0000001565 nova-compute[98289]: INFO os_vif [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba')
May 27 23:08:40.983888 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:08:40.984201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:40.984406 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:40.984836 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:40.985181 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:08:40.985320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:08:41.006171 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-40500d5a-3966-4de8-b2ca-9acb3998f6b3 req-7b33e7db-f0b0-4cf1-97d4-474627e8371b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsi session list stdout=tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:41.013057 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:41.013057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '83')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:08:41.014100 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '72')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:08:41.014597 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '73')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:08:41.015911 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58178e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:08:41.016113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:08:41.016341 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Flush multipath device 33000000053a926ad {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:08:41.067983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:08:41.112932 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:08:41.159030 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:08:41.159208 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:08:41.160158 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:08:41.162782 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:41.173821 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:08:41.174074 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:08:41.186690 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:41.225244 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.40.100,3260]
May 27 23:08:41.225244 np0000001565 nova-compute[98289]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.40.100,3260] successful.
May 27 23:08:41.225244 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:41.241958 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:41.254479 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:41.286478 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 73, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.50.100,3260]
May 27 23:08:41.286478 np0000001565 nova-compute[98289]: Logout of [sid: 73, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.50.100,3260] successful.
May 27 23:08:41.286478 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:41.298946 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:41.300552 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:41.300552 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] <== disconnect_volume: return (314ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:41.300552 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:08:41.300552 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Deleting instance files /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12_del
May 27 23:08:41.300552 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Deletion of /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12_del complete
May 27 23:08:41.309596 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Updated VIF entry in instance network info cache for port d2d9e625-52c4-4ee3-a7cb-5608d369222f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:08:41.311948 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Updating instance_info_cache with network_info: [{"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:41.357668 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:41.357668 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:41.360355 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:08:41.360694 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Claim successful on node np0000001565
May 27 23:08:41.380618 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-40500d5a-3966-4de8-b2ca-9acb3998f6b3 req-7b33e7db-f0b0-4cf1-97d4-474627e8371b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:41.514683 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-40500d5a-3966-4de8-b2ca-9acb3998f6b3 req-7b33e7db-f0b0-4cf1-97d4-474627e8371b service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updated VIF entry in instance network info cache for port 0ec6133d-baba-415d-82ec-9cbe8dfb935f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:08:41.514935 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-40500d5a-3966-4de8-b2ca-9acb3998f6b3 req-7b33e7db-f0b0-4cf1-97d4-474627e8371b service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating instance_info_cache with network_info: [{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": null, "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:41.814399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74256b1d-da7a-4513-899e-26757893f826 req-709fca22-2dd5-4bfe-9cec-23d851f8c2db service nova] Releasing lock "refresh_cache-f6a3b268-ad24-445e-a58c-b1e35a289f56" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:42.016825 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40500d5a-3966-4de8-b2ca-9acb3998f6b3 req-7b33e7db-f0b0-4cf1-97d4-474627e8371b service nova] Releasing lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:42.395463 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:42.395463 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:42.395463 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No VIF found with MAC fa:16:3e:19:13:72, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:08:42.395463 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Using config drive
May 27 23:08:42.679864 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:42.680054 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:42.900578 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:43.002309 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Deleted allocations for instance d099633e-fe8f-425b-b486-3f325ce97d12
May 27 23:08:43.057461 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Creating config drive at /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk.config
May 27 23:08:43.062116 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp48kbio1a {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:43.131015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp48kbio1a" returned: 0 in 0.069s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:43.183418 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:43.231848 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.004135480000059033 future=<Future at 0x726e3874be90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:43.232948 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Emitting event <LifecycleEvent: 1779923308.2275898, a58d20c9-5038-4ea3-842e-406b0253f15b => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:43.233104 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:43.233287 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] VM Stopped (Lifecycle Event)
May 27 23:08:43.235539 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.3234841150001557 future=<Future at 0x726e387eb050 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:43.235772 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.3232069200003025 future=<Future at 0x726e387eb050 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:43.508615 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:43.559509 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003115839999736636 future=<Future at 0x726e387eb050 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:43.559509 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:43.559509 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.25786361900009 future=<Future at 0x726e5816a960 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:43.559736 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.257758503999867 future=<Future at 0x726e5816a960 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:43.559912 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Emitting event <LifecycleEvent: 1779923308.558918, 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:43.560093 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] VM Stopped (Lifecycle Event)
May 27 23:08:43.596057 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:43.621478 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:43.689364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:43.693866 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.337s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:43.694368 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:08:43.699201 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.191s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:43.725866 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:43.738784 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: a58d20c9-5038-4ea3-842e-406b0253f15b] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:43.841373 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-346390fd-7b7c-4935-959f-cece01551d6a req-29a9453a-4e9e-4a34-88e1-210788fdf0bb service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Received event network-vif-plugged-d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:43.842155 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-346390fd-7b7c-4935-959f-cece01551d6a req-29a9453a-4e9e-4a34-88e1-210788fdf0bb service nova] Acquiring lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:43.842308 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-346390fd-7b7c-4935-959f-cece01551d6a req-29a9453a-4e9e-4a34-88e1-210788fdf0bb service nova] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:43.842416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-346390fd-7b7c-4935-959f-cece01551d6a req-29a9453a-4e9e-4a34-88e1-210788fdf0bb service nova] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:43.842606 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-346390fd-7b7c-4935-959f-cece01551d6a req-29a9453a-4e9e-4a34-88e1-210788fdf0bb service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Processing event network-vif-plugged-d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:08:43.987131 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:43.990197 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:43.990561 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:44.011367 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:44.062632 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 52410d9c-d2b3-4a6f-85f4-ca4f26fe660f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:44.081604 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:44.081810 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:44.206568 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:08:44.206811 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:08:44.207158 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:44.207453 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:44.285324 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e15e4b45c874974b28db7f3448a3945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b69ef10bedf41b48b1455ae48aa534e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:08:44.411502 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923324.4110975, f6a3b268-ad24-445e-a58c-b1e35a289f56 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:44.412141 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:08:44.412397 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] VM Started (Lifecycle Event)
May 27 23:08:44.417632 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:08:44.424756 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Instance spawned successfully.
May 27 23:08:44.425189 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:08:44.584541 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:44.710087 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:08:44.904437 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Successfully created port: f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:08:44.914629 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:44.916381 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:44.938745 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:44.940723 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:44.941235 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:44.941583 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:44.941915 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:44.942236 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:45.095577 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.396s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:45.213048 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:08:45.296170 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:45.418609 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:08:45.418960 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923325.418716, f6a3b268-ad24-445e-a58c-b1e35a289f56 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:45.419132 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] VM Paused (Lifecycle Event)
May 27 23:08:45.453617 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Took 6.58 seconds to spawn the instance on the hypervisor.
May 27 23:08:45.453971 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:45.542272 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Successfully updated port: f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:08:45.601196 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bfe9bf08-b4a9-41ce-9a04-811bae79c9e9 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 9.150s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:45.601884 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.306s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:45.602079 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Unshelving
May 27 23:08:45.908599 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Received event network-vif-plugged-d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:45.908799 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] Acquiring lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:45.909000 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:45.909195 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:45.909475 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] No waiting events found dispatching network-vif-plugged-d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:45.909558 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Received unexpected event network-vif-plugged-d2d9e625-52c4-4ee3-a7cb-5608d369222f for instance with vm_state active and task_state None.
May 27 23:08:45.909736 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-changed-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:45.909884 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Refreshing instance network info cache due to event network-changed-f03578e3-9014-4578-b259-d4577bb95e72. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:08:45.910061 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] Acquiring lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:45.910191 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] Acquired lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:45.910294 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Refreshing network info cache for port f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:08:45.924226 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:45.925831 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923325.925612, f6a3b268-ad24-445e-a58c-b1e35a289f56 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:45.925951 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] VM Resumed (Lifecycle Event)
May 27 23:08:45.965364 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Took 13.07 seconds to build instance.
May 27 23:08:45.987351 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:46.044312 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:46.226061 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:08:46.227354 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:08:46.227702 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Creating image(s)
May 27 23:08:46.228342 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:46.228547 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:46.229257 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:46.230059 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:46.235233 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:46.238265 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:46.334300 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.096s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:46.336184 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:46.336184 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:46.336184 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:46.338460 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:08:46.338798 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:46.413843 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:46.428937 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:46.431553 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:46.431999 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:46.453351 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:46.468251 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a73cdf75-c10e-4331-b711-2d47fa578131 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.581s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:46.488935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk 1073741824" returned: 0 in 0.057s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:46.489423 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:46.489823 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:46.535534 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:08:46.600868 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.111s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:46.602346 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:08:46.602346 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:46.628589 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Booting with volume cc739915-bed4-402d-afff-e7278e2139c6 at /dev/vda
May 27 23:08:46.698741 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:46.709740 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:46.711457 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Cannot resize image /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:08:46.711457 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:08:46.711457 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Ensure instance console log exists: /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:08:46.711457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:46.711457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:46.711457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:46.715094 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:08:46.745585 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:46.763952 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:46.795468 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:08:46.795752 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:08:46.806726 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:08:46.807775 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:feae:d8ed', 'fe80::4835:1aff:fe2f:6c9d', 'fe80::fc16:3eff:fe48:f47', 'fe80::fc5d:41ff:fe1a:3ede', 'fe80::fc16:3eff:fe8a:26c4', 'fe80::70b0:20ff:fe1f:52b3', 'fe80::fc16:3eff:fe19:1372', 'fe80::bc78:52ff:fe4d:ba0f'] 
May 27 23:08:46.807949 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:08:46.808063 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:08:46.808323 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:46.808579 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating existing volume attachment record: fd2cfec1-c63a-4cb2-94d2-257467af25e5 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:08:47.123948 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:08:47.270050 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-786fa6ef-69b1-4701-ae38-139aa732965e req-d66b3906-322c-4529-a71f-c0e119961884 service nova] Releasing lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:47.270717 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquired lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:47.270866 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:08:47.630825 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:47.631961 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:47.631961 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:47.631961 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:08:47.703037 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-682a8d8e-5ce7-49b2-9a8b-5a1ff350d49b req-5af4e44b-5825-4eff-8632-2224a72702ca service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Received event network-changed-d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:47.703183 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-682a8d8e-5ce7-49b2-9a8b-5a1ff350d49b req-5af4e44b-5825-4eff-8632-2224a72702ca service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Refreshing instance network info cache due to event network-changed-d2d9e625-52c4-4ee3-a7cb-5608d369222f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:08:47.703355 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-682a8d8e-5ce7-49b2-9a8b-5a1ff350d49b req-5af4e44b-5825-4eff-8632-2224a72702ca service nova] Acquiring lock "refresh_cache-f6a3b268-ad24-445e-a58c-b1e35a289f56" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:47.703451 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-682a8d8e-5ce7-49b2-9a8b-5a1ff350d49b req-5af4e44b-5825-4eff-8632-2224a72702ca service nova] Acquired lock "refresh_cache-f6a3b268-ad24-445e-a58c-b1e35a289f56" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:47.703780 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-682a8d8e-5ce7-49b2-9a8b-5a1ff350d49b req-5af4e44b-5825-4eff-8632-2224a72702ca service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Refreshing network info cache for port d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:08:47.844623 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:08:48.014051 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:48.145172 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating instance_info_cache with network_info: [{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:48.207474 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-682a8d8e-5ce7-49b2-9a8b-5a1ff350d49b req-5af4e44b-5825-4eff-8632-2224a72702ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:48.521475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:48.521475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:48.523371 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lazy-loading 'pci_requests' on Instance uuid d099633e-fe8f-425b-b486-3f325ce97d12 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:48.535982 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-682a8d8e-5ce7-49b2-9a8b-5a1ff350d49b req-5af4e44b-5825-4eff-8632-2224a72702ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:48.647564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Releasing lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:48.647941 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance network_info: |[{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:08:48.650067 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Start _get_guest_xml network_info=[{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:08:48.654081 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:08:48.655522 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-952310270', uuid='cae297ad-de9f-4adf-9e00-20b1f926df45'), owner=OwnerMeta(userid='1e15e4b45c874974b28db7f3448a3945', username='tempest-TestEncryptedCinderVolumes-762189049-project-member', projectid='8b69ef10bedf41b48b1455ae48aa534e', projectname='tempest-TestEncryptedCinderVolumes-762189049'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923328.6550765) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:08:48.659107 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:08:48.659670 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:08:48.663622 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-682a8d8e-5ce7-49b2-9a8b-5a1ff350d49b req-5af4e44b-5825-4eff-8632-2224a72702ca service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Updated VIF entry in instance network info cache for port d2d9e625-52c4-4ee3-a7cb-5608d369222f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:08:48.663905 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-682a8d8e-5ce7-49b2-9a8b-5a1ff350d49b req-5af4e44b-5825-4eff-8632-2224a72702ca service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Updating instance_info_cache with network_info: [{"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:48.666242 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:48.666967 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:08:48.666967 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:08:48.710450 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:48.716361 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:08:48.717870 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:08:48.726451 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:08:48.726451 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:08:48.726451 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:08:48.726451 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:08:48.726451 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:08:48.726451 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:08:48.726451 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:08:48.726451 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:08:48.726451 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:08:48.726451 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:08:48.744047 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-952310270',display_name='tempest-TestEncryptedCinderVolumes-server-952310270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-952310270',id=42,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeBhqxE20M9Bm677ecVK4Bxso3Be10ZNZMOFKVGpzJiVLkzjgBf1GilnWj8FQLjvLgdCO1az9+IE11uvwD9zV3ZRW3erwfzlyCmPI79SXH2T2Xk/O7n070Zg7gHRisLaQ==',key_name='tempest-keypair-1714797866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-z0h6rwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=cae297ad-de9f-4adf-9e00-20b1f926df45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:08:48.744047 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:48.744663 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:48.745424 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'pci_devices' on Instance uuid cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:48.776092 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:48.776550 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:48.870862 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:48.871259 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:08:48.874747 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:08:48.875889 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:48.966234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:48.966776 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:49.029786 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lazy-loading 'numa_topology' on Instance uuid d099633e-fe8f-425b-b486-3f325ce97d12 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:49.060421 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:49.064391 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:49.158282 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:49.158817 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:49.217449 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-682a8d8e-5ce7-49b2-9a8b-5a1ff350d49b req-5af4e44b-5825-4eff-8632-2224a72702ca service nova] Releasing lock "refresh_cache-f6a3b268-ad24-445e-a58c-b1e35a289f56" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:49.246622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:49.250763 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] End _get_guest_xml xml=<domain type="qemu">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <uuid>cae297ad-de9f-4adf-9e00-20b1f926df45</uuid>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <name>instance-0000002a</name>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-952310270</nova:name>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:08:48</nova:creationTime>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:user uuid="1e15e4b45c874974b28db7f3448a3945">tempest-TestEncryptedCinderVolumes-762189049-project-member</nova:user>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:project uuid="8b69ef10bedf41b48b1455ae48aa534e">tempest-TestEncryptedCinderVolumes-762189049</nova:project>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         <nova:port uuid="f03578e3-9014-4578-b259-d4577bb95e72">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <system>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <entry name="serial">cae297ad-de9f-4adf-9e00-20b1f926df45</entry>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <entry name="uuid">cae297ad-de9f-4adf-9e00-20b1f926df45</entry>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     </system>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <os>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   </os>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <features>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   </features>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   <devices>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:5f:f9:a9"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <target dev="tapf03578e3-90"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     </interface>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/console.log" append="off"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     </serial>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <video>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     </video>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     </rng>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:   </devices>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]: </domain>
May 27 23:08:49.250763 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:08:49.252712 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Preparing to wait for external event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:08:49.252712 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:08:49.253740 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:49.254010 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:49.254221 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:49.254364 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:49.255130 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-952310270',display_name='tempest-TestEncryptedCinderVolumes-server-952310270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-952310270',id=42,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeBhqxE20M9Bm677ecVK4Bxso3Be10ZNZMOFKVGpzJiVLkzjgBf1GilnWj8FQLjvLgdCO1az9+IE11uvwD9zV3ZRW3erwfzlyCmPI79SXH2T2Xk/O7n070Zg7gHRisLaQ==',key_name='tempest-keypair-1714797866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-z0h6rwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=cae297ad-de9f-4adf-9e00-20b1f926df45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:08:49.255309 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:49.255960 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:49.256179 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:08:49.271978 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:49.273209 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:49.276710 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:08:49.278947 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:49.279324 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a573e56f-7106-5031-941e-84225418f961', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:49.283714 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:49.285239 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:49.287343 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:49.287562 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf03578e3-90, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:49.288151 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf03578e3-90, col_values=(('qos', UUID('cc765a40-5d0f-45ad-b4e4-755ac290b672')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:49.288491 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf03578e3-90, col_values=(('external_ids', {'iface-id': 'f03578e3-9014-4578-b259-d4577bb95e72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:f9:a9', 'vm-uuid': 'cae297ad-de9f-4adf-9e00-20b1f926df45'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:49.290025 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:49.291770 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:49.297077 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:49.298549 np0000001565 nova-compute[98289]: INFO os_vif [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90')
May 27 23:08:49.303867 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:49.304321 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=12750MB free_disk=73.96979141235352GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:08:49.304592 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:49.535635 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:08:49.535807 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Claim successful on node np0000001565
May 27 23:08:50.818058 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:50.818058 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:08:50.818540 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No VIF found with MAC fa:16:3e:5f:f9:a9, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:08:50.818766 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Using config drive
May 27 23:08:50.832288 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:50.832740 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:51.329313 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:51.336012 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:51.500107 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Creating config drive at /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config
May 27 23:08:51.503740 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpll_xlcdt {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:51.563126 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpll_xlcdt" returned: 0 in 0.059s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:08:51.769899 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:51.769899 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:51.769899 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:51.769899 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:51.769899 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:51.772824 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Terminating instance
May 27 23:08:51.843741 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.322s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:51.844251 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.539s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:51.845065 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:51.910476 np0000001565 nova-compute[98289]: INFO nova.network.neutron [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating port 0ec6133d-baba-415d-82ec-9cbe8dfb935f with attributes {'binding:host_id': 'np0000001565', 'device_owner': 'compute:nova'}
May 27 23:08:51.983418 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.014393 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.117959 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.196096 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e55c6b54-69cc-4704-bd62-01410218658b req-7c1efbf2-22f1-4ec1-b654-f23b8063ce66 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:52.196632 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e55c6b54-69cc-4704-bd62-01410218658b req-7c1efbf2-22f1-4ec1-b654-f23b8063ce66 service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:52.196996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e55c6b54-69cc-4704-bd62-01410218658b req-7c1efbf2-22f1-4ec1-b654-f23b8063ce66 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:52.197303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e55c6b54-69cc-4704-bd62-01410218658b req-7c1efbf2-22f1-4ec1-b654-f23b8063ce66 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:52.197823 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e55c6b54-69cc-4704-bd62-01410218658b req-7c1efbf2-22f1-4ec1-b654-f23b8063ce66 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Processing event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:08:52.277642 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:08:52.302452 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.325651 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.384955 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.393689 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.396421 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.424687 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.433584 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.544472 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1a508263-084b-4803-bbfd-f81e9ced9c76 req-cf393a7f-ca68-4991-ba6d-23c2b915f98d service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:52.544472 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1a508263-084b-4803-bbfd-f81e9ced9c76 req-cf393a7f-ca68-4991-ba6d-23c2b915f98d service nova] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:52.544792 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1a508263-084b-4803-bbfd-f81e9ced9c76 req-cf393a7f-ca68-4991-ba6d-23c2b915f98d service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:52.544967 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1a508263-084b-4803-bbfd-f81e9ced9c76 req-cf393a7f-ca68-4991-ba6d-23c2b915f98d service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:52.545148 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1a508263-084b-4803-bbfd-f81e9ced9c76 req-cf393a7f-ca68-4991-ba6d-23c2b915f98d service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] No waiting events found dispatching network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:52.545308 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1a508263-084b-4803-bbfd-f81e9ced9c76 req-cf393a7f-ca68-4991-ba6d-23c2b915f98d service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:08:52.555357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:52.556950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquired lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:52.557265 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:08:52.569110 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.596064 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:52.616872 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6148659d-a7bc-4b84-aea4-17e2445e1ebf req-32869d13-279b-4651-942d-f8d2d8a3c5ef service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-changed-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:52.616872 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6148659d-a7bc-4b84-aea4-17e2445e1ebf req-32869d13-279b-4651-942d-f8d2d8a3c5ef service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Refreshing instance network info cache due to event network-changed-0ec6133d-baba-415d-82ec-9cbe8dfb935f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:08:52.616989 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6148659d-a7bc-4b84-aea4-17e2445e1ebf req-32869d13-279b-4651-942d-f8d2d8a3c5ef service nova] Acquiring lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:52.638178 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999620176000008 future=<Future at 0x726e58393c50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:52.642523 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Instance destroyed successfully.
May 27 23:08:52.642978 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lazy-loading 'resources' on Instance uuid 77ce6750-3568-4e9b-b99e-c1a7964536d0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:52.817843 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00042746100007207133 future=<Future at 0x726e5816a960 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:52.817944 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:52.818018 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.819734504999815 future=<Future at 0x726e58393c50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:52.818123 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.819627785999728 future=<Future at 0x726e58393c50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:08:52.820792 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Emitting event <LifecycleEvent: 1779923317.8173087, d099633e-fe8f-425b-b486-3f325ce97d12 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:52.820965 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] VM Stopped (Lifecycle Event)
May 27 23:08:52.925707 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 77ce6750-3568-4e9b-b99e-c1a7964536d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:08:52.926226 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:08:52.926226 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:08:52.926226 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance f6a3b268-ad24-445e-a58c-b1e35a289f56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:08:52.926384 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance cae297ad-de9f-4adf-9e00-20b1f926df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:08:52.926448 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance d099633e-fe8f-425b-b486-3f325ce97d12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:08:52.926667 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:08:52.926834 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:08:49 up 37 min,  2 users,  load average: 6.83, 6.84, 4.16\n', 'num_instances': '6', 'num_vm_active': '4', 'num_task_deleting': '1', 'num_os_type_None': '6', 'num_proj_932825702de943b48bbcada3b5763dac': '1', 'io_workload': '1', 'num_task_None': '3', 'num_proj_996f2d92ddf941fab9c407482cbb534e': '1', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '2', 'num_proj_ce5d1153ffbc42b5863df7b2db23eaec': '1', 'num_proj_e077b44d61ee49ffbb4b474bd8b6711a': '1', 'num_proj_47cb500558784c258720ab29bf2d40fe': '1', 'num_vm_building': '1', 'num_proj_8b69ef10bedf41b48b1455ae48aa534e': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:08:52.970633 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:08:52.970900 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923332.9706976, cae297ad-de9f-4adf-9e00-20b1f926df45 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:52.971025 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] VM Started (Lifecycle Event)
May 27 23:08:52.978562 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:08:52.985876 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance spawned successfully.
May 27 23:08:52.986494 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:08:53.059345 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:53.148667 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1596944221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-serveractionsv293testjson-server-440667466',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiFF3ms/ZqADOPwQwgUDiksAV+TViqkb1xsZUeFJ9fXMFHAkOuFmlFD+buNkeEJSOa3xWsXInFjzmeNVuvHjuUmcUVOW9fKpVE4pVSKRmEFjcniprzLTbopfmOVDNzn6w==',key_name='tempest-keypair-482168530',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:08:13Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='932825702de943b48bbcada3b5763dac',ramdisk_id='',reservation_id='r-z6zy7sr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8ff2d219-b0c5-4008-bfa5-cea77f23c366',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-984365273',owner_user_name='tempest-ServerActionsV293TestJSON-984365273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4451943f43444436bf50809c8ab7f0d3',uuid=77ce6750-3568-4e9b-b99e-c1a7964536d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:08:53.149049 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converting VIF {"id": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "address": "fa:16:3e:ae:d8:ed", "network": {"id": "a434e675-da40-4e80-b02e-435033e12745", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-54579509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "932825702de943b48bbcada3b5763dac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61237f5f-32", "ovs_interfaceid": "61237f5f-3261-4c4e-83c3-7f4a5db90b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:53.149857 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:53.150249 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:08:53.151891 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:53.152209 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61237f5f-32, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:53.153615 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:53.154732 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:53.155577 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:53.156137 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:53.156288 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a99363cb-033e-42f9-99f8-ade47febaf70) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:53.156899 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:53.157570 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:53.157570 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:53.159567 np0000001565 nova-compute[98289]: INFO os_vif [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d8:ed,bridge_name='br-int',has_traffic_filtering=True,id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f,network=Network(a434e675-da40-4e80-b02e-435033e12745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61237f5f-32')
May 27 23:08:53.161049 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:08:53.161528 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:53.161732 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:53.162236 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:53.162689 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:08:53.162895 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:08:53.190551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:53.190551 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:53.190551 np0000001565 nova-compute[98289]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:53.190551 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:53.190551 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:53.190827 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsi session list stdout=tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:53.190827 np0000001565 nova-compute[98289]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2 (non-flash)
May 27 23:08:53.190827 np0000001565 nova-compute[98289]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:53.190827 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:53.190827 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:53.190957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '83')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:08:53.191019 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '76')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:08:53.192227 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2', '77')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:08:53.193038 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e5817bc40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'): ({'sdc'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:08:53.193256 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:08:53.193519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Flush multipath device 330000000c66bbb07 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:08:53.242512 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:08:53.296516 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:08:53.324452 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:53.335123 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:08:53.335287 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:08:53.336138 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:08:53.348871 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:08:53.349135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:08:53.361716 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:53.393274 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.40.100,3260]
May 27 23:08:53.393274 np0000001565 nova-compute[98289]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.40.100,3260] successful.
May 27 23:08:53.393274 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:53.407769 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:53.408289 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:53.409471 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:53.423801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:53.452107 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:53.455305 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.50.100,3260]
May 27 23:08:53.455305 np0000001565 nova-compute[98289]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-f0db4932-f904-4a76-b63e-0c23a6cb2dc2, portal: 192.168.50.100,3260] successful.
May 27 23:08:53.455305 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:53.468955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:53.469156 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:53.469302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] <== disconnect_volume: return (307ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:53.469544 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:08:53.469842 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Deleting instance files /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0_del
May 27 23:08:53.470343 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Deletion of /opt/stack/data/nova/instances/77ce6750-3568-4e9b-b99e-c1a7964536d0_del complete
May 27 23:08:53.474030 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:53.475726 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:53.494088 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:53.494243 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:53.494569 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:53.495001 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:53.495248 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:53.495529 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:08:53.610206 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating instance_info_cache with network_info: [{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:53.708262 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:53.911517 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:53.975897 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Took 1.70 seconds to destroy the instance on the hypervisor.
May 27 23:08:53.977295 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:08:53.977547 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:08:53.977657 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:08:53.977900 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:53.982994 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:08:53.983666 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923333.9833167, cae297ad-de9f-4adf-9e00-20b1f926df45 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:53.983970 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] VM Paused (Lifecycle Event)
May 27 23:08:54.000669 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Took 7.77 seconds to spawn the instance on the hypervisor.
May 27 23:08:54.001080 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:54.089375 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:54.113855 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Releasing lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:54.115242 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:08:54.116524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6148659d-a7bc-4b84-aea4-17e2445e1ebf req-32869d13-279b-4651-942d-f8d2d8a3c5ef service nova] Acquired lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:54.116524 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6148659d-a7bc-4b84-aea4-17e2445e1ebf req-32869d13-279b-4651-942d-f8d2d8a3c5ef service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Refreshing network info cache for port 0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:08:54.117191 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Creating image(s)
May 27 23:08:54.117869 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:08:54.118006 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Ensure instance console log exists: /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:08:54.118447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:54.118677 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:54.118791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:54.119107 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Start _get_guest_xml network_info=[{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fd2cfec1-c63a-4cb2-94d2-257467af25e5', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd099633e-fe8f-425b-b486-3f325ce97d12', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'serial': 'cc739915-bed4-402d-afff-e7278e2139c6'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:08:54.120944 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:08:54.121937 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1892961998', uuid='d099633e-fe8f-425b-b486-3f325ce97d12'), owner=OwnerMeta(userid='e16486bc9a2b451788f9c61df0c20472', username='tempest-TestShelveInstance-1900497856-project-member', projectid='ce5d1153ffbc42b5863df7b2db23eaec', projectname='tempest-TestShelveInstance-1900497856'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923334.1216354) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:08:54.122956 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:08:54.123442 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:08:54.124258 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:08:54.124433 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:08:54.125449 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:08:54.126112 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:08:54.126112 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:08:54.126112 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:08:54.126112 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:08:54.126395 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:08:54.126395 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:08:54.126519 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:08:54.126626 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:08:54.126743 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:08:54.126848 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:08:54.127012 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:08:54.127170 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lazy-loading 'vcpu_model' on Instance uuid d099633e-fe8f-425b-b486-3f325ce97d12 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:54.257567 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-890733f8-a860-4111-86d4-60ab3f5f28c2 req-19d48e82-7cb3-4868-a64e-d638d399b026 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:54.258526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-890733f8-a860-4111-86d4-60ab3f5f28c2 req-19d48e82-7cb3-4868-a64e-d638d399b026 service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:54.258526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-890733f8-a860-4111-86d4-60ab3f5f28c2 req-19d48e82-7cb3-4868-a64e-d638d399b026 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:54.258526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-890733f8-a860-4111-86d4-60ab3f5f28c2 req-19d48e82-7cb3-4868-a64e-d638d399b026 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:54.258526 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-890733f8-a860-4111-86d4-60ab3f5f28c2 req-19d48e82-7cb3-4868-a64e-d638d399b026 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] No waiting events found dispatching network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:54.258670 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-890733f8-a860-4111-86d4-60ab3f5f28c2 req-19d48e82-7cb3-4868-a64e-d638d399b026 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received unexpected event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 for instance with vm_state active and task_state None.
May 27 23:08:54.418273 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:08:54.418507 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.575s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:54.419023 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:08:54.487081 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:54.488437 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923334.4881542, cae297ad-de9f-4adf-9e00-20b1f926df45 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:08:54.488733 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] VM Resumed (Lifecycle Event)
May 27 23:08:54.509388 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Took 13.22 seconds to build instance.
May 27 23:08:54.605372 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5785c7c5-7424-4651-9de2-4343ada136dd req-6dffbde6-bb89-42a0-a671-2010ef9079f7 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:54.606293 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5785c7c5-7424-4651-9de2-4343ada136dd req-6dffbde6-bb89-42a0-a671-2010ef9079f7 service nova] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:54.606621 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5785c7c5-7424-4651-9de2-4343ada136dd req-6dffbde6-bb89-42a0-a671-2010ef9079f7 service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:54.606733 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5785c7c5-7424-4651-9de2-4343ada136dd req-6dffbde6-bb89-42a0-a671-2010ef9079f7 service nova] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:54.606865 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5785c7c5-7424-4651-9de2-4343ada136dd req-6dffbde6-bb89-42a0-a671-2010ef9079f7 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] No waiting events found dispatching network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:08:54.607025 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5785c7c5-7424-4651-9de2-4343ada136dd req-6dffbde6-bb89-42a0-a671-2010ef9079f7 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-vif-unplugged-61237f5f-3261-4c4e-83c3-7f4a5db90b8f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:08:54.607174 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5785c7c5-7424-4651-9de2-4343ada136dd req-6dffbde6-bb89-42a0-a671-2010ef9079f7 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Received event network-vif-deleted-61237f5f-3261-4c4e-83c3-7f4a5db90b8f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:54.607344 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-5785c7c5-7424-4651-9de2-4343ada136dd req-6dffbde6-bb89-42a0-a671-2010ef9079f7 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Neutron deleted interface 61237f5f-3261-4c4e-83c3-7f4a5db90b8f; detaching it from the instance and deleting it from the info cache
May 27 23:08:54.609953 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5785c7c5-7424-4651-9de2-4343ada136dd req-6dffbde6-bb89-42a0-a671-2010ef9079f7 service nova] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Detach interface failed, port_id=61237f5f-3261-4c4e-83c3-7f4a5db90b8f, reason: Instance 77ce6750-3568-4e9b-b99e-c1a7964536d0 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:08:54.619080 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-6148659d-a7bc-4b84-aea4-17e2445e1ebf req-32869d13-279b-4651-942d-f8d2d8a3c5ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:54.629312 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Object Instance<d099633e-fe8f-425b-b486-3f325ce97d12> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:54.638749 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:08:54.639027 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:54.639175 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:54.639558 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:54.639740 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:08:54.655284 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:54.655653 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:54.655842 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:08:54.656456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:08:54.657081 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:08:54.657081 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:08:54.669052 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:08:54.669052 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:54.673374 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:08:54.673374 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:54.682513 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6] added
May 27 23:08:54.682513 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:08:54.682513 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:54.682513 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:54.682513 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:54.682513 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:54.682513 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:54.682863 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:08:54.682919 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:08:54.683137 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:08:54.685201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6] added
May 27 23:08:54.685201 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:08:54.685201 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:54.685201 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:54.685201 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:08:54.685201 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:08:54.685201 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:54.685201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:08:54.685201 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:08:54.685201 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:08:54.967606 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:54.973443 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-6148659d-a7bc-4b84-aea4-17e2445e1ebf req-32869d13-279b-4651-942d-f8d2d8a3c5ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:54.991644 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:08:54.994066 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:08:55.010950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.729s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:55.147048 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6148659d-a7bc-4b84-aea4-17e2445e1ebf req-32869d13-279b-4651-942d-f8d2d8a3c5ef service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updated VIF entry in instance network info cache for port 0ec6133d-baba-415d-82ec-9cbe8dfb935f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:08:55.147385 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6148659d-a7bc-4b84-aea4-17e2445e1ebf req-32869d13-279b-4651-942d-f8d2d8a3c5ef service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating instance_info_cache with network_info: [{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:55.469516 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Took 1.49 seconds to deallocate network for instance.
May 27 23:08:55.649873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6148659d-a7bc-4b84-aea4-17e2445e1ebf req-32869d13-279b-4651-942d-f8d2d8a3c5ef service nova] Releasing lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:55.683557 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:08:55.685507 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:08:55.695196 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:08:55.695196 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:08:55.699899 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:08:55.699899 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:55.707798 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:55.718739 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:55.725687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.725687 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.725687 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:55.725849 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.725849 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.725849 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:55.731453 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.731453 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.731453 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:55.731597 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.731597 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.731597 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:55.752813 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.40.100,3260]
May 27 23:08:55.752813 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.40.100,3260] successful.
May 27 23:08:55.752813 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:55.763472 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.50.100,3260]
May 27 23:08:55.763472 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.50.100,3260] successful.
May 27 23:08:55.763472 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:55.763854 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:55.776307 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:08:55.784770 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.784770 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.784770 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:55.784770 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:55.784770 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:55.784770 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.784770 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.784770 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:55.784770 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:55.784770 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:55.785659 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:55.785659 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:08:55.785786 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] HCTL ('7', '-', '-', 0) found on session 84 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:08:55.785875 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:55.796580 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:08:55.796580 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] HCTL ('8', '-', '-', 0) found on session 85 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:08:55.796580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:08:55.803637 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Searching for a device in session 84 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:08:55.803892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:08:55.813699 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Searching for a device in session 85 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:08:55.813699 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:08:56.046066 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Took 0.57 seconds to detach 1 volumes for instance.
May 27 23:08:56.047148 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Deleting volume: f0db4932-f904-4a76-b63e-0c23a6cb2dc2 {{(pid=98289) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 23:08:56.367791 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-eb857c20-f0a2-4058-83df-bc8fad46fbe5 req-aa423f30-af70-406f-9650-612326194852 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-changed-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:08:56.368285 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-eb857c20-f0a2-4058-83df-bc8fad46fbe5 req-aa423f30-af70-406f-9650-612326194852 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Refreshing instance network info cache due to event network-changed-f03578e3-9014-4578-b259-d4577bb95e72. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:08:56.369558 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-eb857c20-f0a2-4058-83df-bc8fad46fbe5 req-aa423f30-af70-406f-9650-612326194852 service nova] Acquiring lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:08:56.369714 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-eb857c20-f0a2-4058-83df-bc8fad46fbe5 req-aa423f30-af70-406f-9650-612326194852 service nova] Acquired lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:08:56.369921 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-eb857c20-f0a2-4058-83df-bc8fad46fbe5 req-aa423f30-af70-406f-9650-612326194852 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Refreshing network info cache for port f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:08:56.632629 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:56.632901 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:56.658674 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:08:56.872108 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-eb857c20-f0a2-4058-83df-bc8fad46fbe5 req-aa423f30-af70-406f-9650-612326194852 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:57.036945 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:57.037367 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:57.052104 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:08:57.052600 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:08:57.251155 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-eb857c20-f0a2-4058-83df-bc8fad46fbe5 req-aa423f30-af70-406f-9650-612326194852 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:08:57.399369 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-eb857c20-f0a2-4058-83df-bc8fad46fbe5 req-aa423f30-af70-406f-9650-612326194852 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updated VIF entry in instance network info cache for port f03578e3-9014-4578-b259-d4577bb95e72. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:08:57.399602 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-eb857c20-f0a2-4058-83df-bc8fad46fbe5 req-aa423f30-af70-406f-9650-612326194852 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating instance_info_cache with network_info: [{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:08:57.413198 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:08:57.413198 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:08:57.413198 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:08:57.413574 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:08:57.413805 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:08:57.414066 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:08:57.542308 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lazy-loading 'flavor' on Instance uuid 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:57.556785 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:08:57.677812 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Found WWN 33000000053a926ad for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:08:57.678135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:08:57.678346 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '33000000053a926ad', 'path': '/dev/dm-0', 'multipath_id': '33000000053a926ad'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:57.678570 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000053a926ad', 'path': '/dev/dm-0', 'multipath_id': '33000000053a926ad'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:08:57.904588 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-eb857c20-f0a2-4058-83df-bc8fad46fbe5 req-aa423f30-af70-406f-9650-612326194852 service nova] Releasing lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:08:57.922997 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] While synchronizing instance power states, found 6 instances in the database and 4 instances on the hypervisor.
May 27 23:08:57.923223 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Triggering sync for uuid 77ce6750-3568-4e9b-b99e-c1a7964536d0 {{(pid=98289) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 23:08:57.923788 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Triggering sync for uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 23:08:57.924195 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "77ce6750-3568-4e9b-b99e-c1a7964536d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:57.924557 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Triggering sync for uuid d099633e-fe8f-425b-b486-3f325ce97d12 {{(pid=98289) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 23:08:57.924966 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:57.925929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:57.926192 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Triggering sync for uuid 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 {{(pid=98289) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 23:08:57.926712 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:57.927149 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Triggering sync for uuid f6a3b268-ad24-445e-a58c-b1e35a289f56 {{(pid=98289) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 23:08:57.927519 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:57.927889 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Triggering sync for uuid cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 23:08:57.928283 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:57.928381 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:57.929876 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:08:57.930048 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:08:57.930351 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.71 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:08:58.063590 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.430s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:58.134489 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Deleted allocations for instance 77ce6750-3568-4e9b-b99e-c1a7964536d0
May 27 23:08:58.157961 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:58.183721 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1892961998',display_name='tempest-TestShelveInstance-server-1892961998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testshelveinstance-server-1892961998',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1672332914',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:57Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ce5d1153ffbc42b5863df7b2db23eaec',ramdisk_id='',reservation_id='r-dl8ft992',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1900497856',owner_user_name='tempest-TestShelveInstance-1900497856-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:08:46Z,user_data=None,user_id='e16486bc9a2b451788f9c61df0c20472',uuid=d099633e-fe8f-425b-b486-3f325ce97d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:08:58.183968 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converting VIF {"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:58.184669 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:58.185310 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lazy-loading 'pci_devices' on Instance uuid d099633e-fe8f-425b-b486-3f325ce97d12 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:08:58.431176 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:58.431398 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:58.431673 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:58.434944 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:58.548961 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:58.551111 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.622s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:58.690204 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Object Instance<d099633e-fe8f-425b-b486-3f325ce97d12> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:08:58.690204 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] End _get_guest_xml xml=<domain type="qemu">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <uuid>d099633e-fe8f-425b-b486-3f325ce97d12</uuid>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <name>instance-00000027</name>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestShelveInstance-server-1892961998</nova:name>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:08:54</nova:creationTime>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:user uuid="e16486bc9a2b451788f9c61df0c20472">tempest-TestShelveInstance-1900497856-project-member</nova:user>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:project uuid="ce5d1153ffbc42b5863df7b2db23eaec">tempest-TestShelveInstance-1900497856</nova:project>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         <nova:port uuid="0ec6133d-baba-415d-82ec-9cbe8dfb935f">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <system>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <entry name="serial">d099633e-fe8f-425b-b486-3f325ce97d12</entry>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <entry name="uuid">d099633e-fe8f-425b-b486-3f325ce97d12</entry>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     </system>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <os>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   </os>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <features>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   </features>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   <devices>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/disk.config"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <alias name="ua-cc739915-bed4-402d-afff-e7278e2139c6"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <serial>cc739915-bed4-402d-afff-e7278e2139c6</serial>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     </disk>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ce:1a:11"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <target dev="tap0ec6133d-ba"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     </interface>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/console.log" append="off"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     </serial>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <video>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     </video>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     </rng>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:   </devices>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]: </domain>
May 27 23:08:58.690204 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:08:58.690204 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Preparing to wait for external event network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:08:58.690204 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:58.690204 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:58.690204 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:58.690204 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1892961998',display_name='tempest-TestShelveInstance-server-1892961998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testshelveinstance-server-1892961998',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1672332914',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:57Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ce5d1153ffbc42b5863df7b2db23eaec',ramdisk_id='',reservation_id='r-dl8ft992',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1900497856',owner_user_name='tempest-TestShelveInstance-1900497856-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:08:46Z,user_data=None,user_id='e16486bc9a2b451788f9c61df0c20472',uuid=d099633e-fe8f-425b-b486-3f325ce97d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:08:58.690204 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converting VIF {"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:08:58.690204 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:08:58.690204 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:08:58.692641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:58.692641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:58.692641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:08:58.693623 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:58.693771 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab913ddb-104d-59c3-8a98-07a8c57e49d0', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:58.705905 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:58.706781 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:58.709383 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:58.711952 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:58.712081 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ec6133d-ba, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:58.712378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ec6133d-ba, col_values=(('qos', UUID('6cff850e-274e-4be2-a514-eeefb0c44a09')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:58.712734 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ec6133d-ba, col_values=(('external_ids', {'iface-id': '0ec6133d-baba-415d-82ec-9cbe8dfb935f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:1a:11', 'vm-uuid': 'd099633e-fe8f-425b-b486-3f325ce97d12'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:08:58.713484 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:58.714779 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:08:58.719661 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:08:58.721541 np0000001565 nova-compute[98289]: INFO os_vif [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba')
May 27 23:08:58.936178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:59.057508 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.508s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:59.142345 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3c4-a85c-4fb6-973d-6bfa21b9cac6 tempest-ServerActionsV293TestJSON-984365273 tempest-ServerActionsV293TestJSON-984365273-project-member] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.375s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:59.143191 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.218s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:59.607137 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:08:59.607344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:08:59.607597 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Attaching volume a1a9263b-d77e-487e-97e5-281d95a0c565 to /dev/vdb
May 27 23:08:59.647144 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "77ce6750-3568-4e9b-b99e-c1a7964536d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:08:59.651471 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:08:59.665885 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:08:59.690661 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:08:59.750463 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:08:59.750977 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:08:59.762162 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:08:59.763739 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe48:f47', 'fe80::fc5d:41ff:fe1a:3ede', 'fe80::fc16:3eff:fe8a:26c4', 'fe80::70b0:20ff:fe1f:52b3', 'fe80::fc16:3eff:fe19:1372', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fe5f:f9a9', 'fe80::4cb6:a6ff:feaf:184a'] 
May 27 23:08:59.764294 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:08:59.764516 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:08:59.765071 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:08:59.765167 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Updating existing volume attachment record: 01538d8e-015c-4df0-ba85-f90dad018b36 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:09:00.019430 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:00.252772 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:00.255399 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:00.255399 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] No VIF found with MAC fa:16:3e:ce:1a:11, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:09:00.255399 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Using config drive
May 27 23:09:00.335320 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:09:00.335320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1a9263b-d77e-487e-97e5-281d95a0c565', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:09:00.335320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:00.335742 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:00.335933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1a9263b-d77e-487e-97e5-281d95a0c565', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:09:00.349457 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:00.350149 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:00.350341 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:09:00.353656 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:00.353656 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:00.353656 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:09:00.369039 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:09:00.369039 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:00.372032 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:09:00.372032 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:00.386474 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565] added
May 27 23:09:00.386474 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:09:00.386474 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:00.386474 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:00.386474 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:00.386474 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:00.386474 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:00.386835 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:09:00.386835 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0364(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:09:00.388351 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:09:00.392465 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565] added
May 27 23:09:00.392465 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:09:00.392465 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:00.392465 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:00.392465 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:00.392465 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:00.392465 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:00.392644 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:09:00.392883 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0407(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:09:00.393060 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:09:00.641899 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:09:00.642559 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.48 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:09:00.759381 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lazy-loading 'ec2_ids' on Instance uuid d099633e-fe8f-425b-b486-3f325ce97d12 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:01.260437 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Object Instance<d099633e-fe8f-425b-b486-3f325ce97d12> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:09:01.260922 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lazy-loading 'keypairs' on Instance uuid d099633e-fe8f-425b-b486-3f325ce97d12 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:01.387527 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:09:01.393490 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:09:01.403564 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:09:01.403564 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:09:01.412369 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:09:01.412369 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:01.424163 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:01.429377 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:01.438003 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.438003 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.438003 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.438003 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.438003 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:01.438251 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.438251 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.438251 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.438251 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.438251 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:01.444395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.444395 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.444395 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.444395 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.444395 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:01.444553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.444553 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.444553 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.444553 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.444553 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:01.469668 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565, portal: 192.168.40.100,3260]
May 27 23:09:01.469668 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565, portal: 192.168.40.100,3260] successful.
May 27 23:09:01.469668 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:01.482416 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565, portal: 192.168.50.100,3260]
May 27 23:09:01.482416 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565, portal: 192.168.50.100,3260] successful.
May 27 23:09:01.482416 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:01.482910 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:01.497015 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:01.508366 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] HCTL ('11', '-', '-', 0) found on session 86 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:09:01.508366 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:09:01.516820 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.516820 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.516820 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.516820 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.516820 np0000001565 nova-compute[98289]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:01.516820 np0000001565 nova-compute[98289]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:01.516820 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:01.517110 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.517110 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:01.517110 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.517110 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:01.517110 np0000001565 nova-compute[98289]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:01.517110 np0000001565 nova-compute[98289]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:01.517110 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:01.517356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:01.517356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:09:01.518542 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] HCTL ('12', '-', '-', 0) found on session 87 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:09:01.518542 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:09:01.529708 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Searching for a device in session 86 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:09:01.529957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1a9263b-d77e-487e-97e5-281d95a0c565', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:09:01.543265 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Searching for a device in session 87 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:09:01.543554 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a1a9263b-d77e-487e-97e5-281d95a0c565', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:09:01.762817 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Object Instance<d099633e-fe8f-425b-b486-3f325ce97d12> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:09:01.765407 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:01.909077 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Creating config drive at /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/disk.config
May 27 23:09:01.912639 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpura8pnbw {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:01.934188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:01.978647 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpura8pnbw" returned: 0 in 0.066s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:02.185646 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:02.352818 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:09:02.464165 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:02.499491 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:02.601009 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:02.698321 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-de6ebb29-ee93-49a8-be8f-8f6a928acc95 req-ab231343-688b-438c-aa1e-3b245809b026 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:02.698694 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-de6ebb29-ee93-49a8-be8f-8f6a928acc95 req-ab231343-688b-438c-aa1e-3b245809b026 service nova] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:02.698974 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-de6ebb29-ee93-49a8-be8f-8f6a928acc95 req-ab231343-688b-438c-aa1e-3b245809b026 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:02.699147 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-de6ebb29-ee93-49a8-be8f-8f6a928acc95 req-ab231343-688b-438c-aa1e-3b245809b026 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:02.699347 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-de6ebb29-ee93-49a8-be8f-8f6a928acc95 req-ab231343-688b-438c-aa1e-3b245809b026 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Processing event network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:09:02.844915 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:02.846244 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:02.871703 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:03.319518 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923343.3191082, d099633e-fe8f-425b-b486-3f325ce97d12 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:03.319876 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:09:03.320025 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] VM Started (Lifecycle Event)
May 27 23:09:03.322280 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:09:03.326771 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Instance spawned successfully.
May 27 23:09:03.327776 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:03.376452 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Found WWN 330000000295f5cf8 for multipath device dm-4 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:09:03.376913 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:03.376913 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000295f5cf8', 'path': '/dev/dm-4', 'multipath_id': '330000000295f5cf8'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:09:03.376976 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000295f5cf8', 'path': '/dev/dm-4', 'multipath_id': '330000000295f5cf8'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:09:03.385206 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lazy-loading 'flavor' on Instance uuid 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:03.711066 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:03.714554 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:03.823384 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:03.825355 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:09:03.841702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-086400ff-0085-4f8b-9d27-e0eba55c155c tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.240s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:03.843012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "d099633e-fe8f-425b-b486-3f325ce97d12" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.916s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:03.843448 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:09:03.843664 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "d099633e-fe8f-425b-b486-3f325ce97d12" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:03.889360 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Attempting to attach volume a1a9263b-d77e-487e-97e5-281d95a0c565 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:09:03.890640 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:09:03.890640 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:09:03.890640 np0000001565 nova-compute[98289]:   <alias name="ua-a1a9263b-d77e-487e-97e5-281d95a0c565"/>
May 27 23:09:03.890640 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-4"/>
May 27 23:09:03.890640 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:09:03.890640 np0000001565 nova-compute[98289]:   <serial>a1a9263b-d77e-487e-97e5-281d95a0c565</serial>
May 27 23:09:03.890640 np0000001565 nova-compute[98289]: </disk>
May 27 23:09:03.890640 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:09:04.328451 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923344.3280916, d099633e-fe8f-425b-b486-3f325ce97d12 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:04.328596 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] VM Paused (Lifecycle Event)
May 27 23:09:04.789486 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b14f2146-56c1-4705-a536-fdc71b849c6b req-795893b2-adbb-4851-861a-64aebd52be1d service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:04.789955 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b14f2146-56c1-4705-a536-fdc71b849c6b req-795893b2-adbb-4851-861a-64aebd52be1d service nova] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:04.790037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b14f2146-56c1-4705-a536-fdc71b849c6b req-795893b2-adbb-4851-861a-64aebd52be1d service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:04.790152 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b14f2146-56c1-4705-a536-fdc71b849c6b req-795893b2-adbb-4851-861a-64aebd52be1d service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:04.790360 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b14f2146-56c1-4705-a536-fdc71b849c6b req-795893b2-adbb-4851-861a-64aebd52be1d service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] No waiting events found dispatching network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:04.790585 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-b14f2146-56c1-4705-a536-fdc71b849c6b req-795893b2-adbb-4851-861a-64aebd52be1d service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received unexpected event network-vif-plugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f for instance with vm_state active and task_state None.
May 27 23:09:04.832773 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:04.834938 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923344.8346837, d099633e-fe8f-425b-b486-3f325ce97d12 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:04.835246 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] VM Resumed (Lifecycle Event)
May 27 23:09:05.247248 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:05.337570 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:05.339380 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:09:05.559231 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:05.559387 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:05.559553 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:05.559687 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No VIF found with MAC fa:16:3e:48:0f:47, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:09:06.812853 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:07.125078 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-62519a76-8cbf-467d-beda-b87871b2cd6f tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.518s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:07.640791 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0029729850002695457 future=<Future at 0x726e58393c50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:07.641031 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:07.642124 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Emitting event <LifecycleEvent: 1779923332.6376553, 77ce6750-3568-4e9b-b99e-c1a7964536d0 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:07.642325 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] VM Stopped (Lifecycle Event)
May 27 23:09:08.145970 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: 77ce6750-3568-4e9b-b99e-c1a7964536d0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:08.479897 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Acquiring lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:08.480133 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:08.714927 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:08.715278 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:08.985606 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:09:09.535479 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:09.535857 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:09.538484 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:09:09.538613 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Claim successful on node np0000001565
May 27 23:09:10.837627 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:09:10.837951 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:09:11.222923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:11.223035 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:11.340555 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:09:11.725412 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Detaching volume a1a9263b-d77e-487e-97e5-281d95a0c565
May 27 23:09:11.783706 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Attempting to driver detach volume a1a9263b-d77e-487e-97e5-281d95a0c565 from mountpoint /dev/vdb
May 27 23:09:11.788827 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Found disk vdb by alias ua-a1a9263b-d77e-487e-97e5-281d95a0c565 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:09:11.790585 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Found disk vdb by alias ua-a1a9263b-d77e-487e-97e5-281d95a0c565 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:09:11.790585 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Attempting to detach device vdb from instance 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:09:11.790585 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:09:11.790585 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:09:11.790585 np0000001565 nova-compute[98289]:   <alias name="ua-a1a9263b-d77e-487e-97e5-281d95a0c565"/>
May 27 23:09:11.790585 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-4"/>
May 27 23:09:11.790585 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:09:11.790585 np0000001565 nova-compute[98289]:   <serial>a1a9263b-d77e-487e-97e5-281d95a0c565</serial>
May 27 23:09:11.790585 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:09:11.790585 np0000001565 nova-compute[98289]: </disk>
May 27 23:09:11.790585 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:09:11.797288 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Successfully detached device vdb from instance 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 from the persistent domain config.
May 27 23:09:11.797288 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] (1/8): Attempting to detach device vdb with device alias ua-a1a9263b-d77e-487e-97e5-281d95a0c565 from instance 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:09:11.797288 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:09:11.797288 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:09:11.797288 np0000001565 nova-compute[98289]:   <alias name="ua-a1a9263b-d77e-487e-97e5-281d95a0c565"/>
May 27 23:09:11.797288 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-4"/>
May 27 23:09:11.797288 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:09:11.797288 np0000001565 nova-compute[98289]:   <serial>a1a9263b-d77e-487e-97e5-281d95a0c565</serial>
May 27 23:09:11.797288 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:09:11.797288 np0000001565 nova-compute[98289]: </disk>
May 27 23:09:11.797288 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:09:11.849134 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.313s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:11.849663 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:09:12.269595 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:12.269818 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:12.345828 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923352.3454757, 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 => ua-a1a9263b-d77e-487e-97e5-281d95a0c565> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:09:12.346798 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a1a9263b-d77e-487e-97e5-281d95a0c565 for instance 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:09:12.349049 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Successfully detached device vdb from instance 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 from the live domain config.
May 27 23:09:12.349728 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:09:12.350066 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1a9263b-d77e-487e-97e5-281d95a0c565', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:09:12.350313 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:12.351239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:12.351239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a1a9263b-d77e-487e-97e5-281d95a0c565', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:09:12.351239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:09:12.357904 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:09:12.358194 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:09:12.358480 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:12.358719 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:12.378049 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:12.378049 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:12.378049 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:12.378049 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:12.378049 np0000001565 nova-compute[98289]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:12.378049 np0000001565 nova-compute[98289]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:12.378049 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:12.379033 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:12.379033 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:12.379033 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:12.379033 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:12.379033 np0000001565 nova-compute[98289]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:12.379033 np0000001565 nova-compute[98289]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565 (non-flash)
May 27 23:09:12.379033 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:12.379033 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', '87')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:09:12.379033 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', '86')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:09:12.381628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565', '87')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:09:12.381628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e38709080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:09:12.381628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:09:12.381628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Flush multipath device 330000000295f5cf8 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:09:12.421525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:09:12.450975 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5803701dd2c948a2bb1e2226c26ff27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a944cc56b24e0f8e0a1d1449c63682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:09:12.474378 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:09:12.523621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:09:12.523621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:09:12.523621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:09:12.534321 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:09:12.534867 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:09:12.545661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:12.575475 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565, portal: 192.168.40.100,3260]
May 27 23:09:12.575475 np0000001565 nova-compute[98289]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565, portal: 192.168.40.100,3260] successful.
May 27 23:09:12.575475 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:12.589821 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:12.605302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:12.640201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 87, target: iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565, portal: 192.168.50.100,3260]
May 27 23:09:12.640201 np0000001565 nova-compute[98289]: Logout of [sid: 87, target: iqn.2023-03.storpool.com:os--volume-a1a9263b-d77e-487e-97e5-281d95a0c565, portal: 192.168.50.100,3260] successful.
May 27 23:09:12.640201 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:12.657572 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:12.657935 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:12.660361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] <== disconnect_volume: return (307ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:09:12.660361 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:09:12.771916 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Detaching volume 6b311228-b94c-4246-8c69-1659f524de84
May 27 23:09:12.815011 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Attempting to driver detach volume 6b311228-b94c-4246-8c69-1659f524de84 from mountpoint /dev/vdb
May 27 23:09:12.819204 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Found disk vdb by alias ua-6b311228-b94c-4246-8c69-1659f524de84 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:09:12.820910 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Found disk vdb by alias ua-6b311228-b94c-4246-8c69-1659f524de84 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:09:12.821162 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Attempting to detach device vdb from instance 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:09:12.821559 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:09:12.821559 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:09:12.821559 np0000001565 nova-compute[98289]:   <alias name="ua-6b311228-b94c-4246-8c69-1659f524de84"/>
May 27 23:09:12.821559 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-1"/>
May 27 23:09:12.821559 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:09:12.821559 np0000001565 nova-compute[98289]:   <serial>6b311228-b94c-4246-8c69-1659f524de84</serial>
May 27 23:09:12.821559 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:09:12.821559 np0000001565 nova-compute[98289]: </disk>
May 27 23:09:12.821559 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:09:12.829598 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully detached device vdb from instance 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 from the persistent domain config.
May 27 23:09:12.829598 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] (1/8): Attempting to detach device vdb with device alias ua-6b311228-b94c-4246-8c69-1659f524de84 from instance 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:09:12.829598 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:09:12.829598 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:09:12.829598 np0000001565 nova-compute[98289]:   <alias name="ua-6b311228-b94c-4246-8c69-1659f524de84"/>
May 27 23:09:12.829598 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-1"/>
May 27 23:09:12.829598 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:09:12.829598 np0000001565 nova-compute[98289]:   <serial>6b311228-b94c-4246-8c69-1659f524de84</serial>
May 27 23:09:12.829598 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:09:12.829598 np0000001565 nova-compute[98289]: </disk>
May 27 23:09:12.829598 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:09:12.860800 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:09:12.873814 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Successfully created port: f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:09:13.220187 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lazy-loading 'flavor' on Instance uuid 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:13.364596 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:09:13.375223 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Successfully updated port: f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:09:13.426554 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923353.4260674, 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 => ua-6b311228-b94c-4246-8c69-1659f524de84> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:09:13.427537 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6b311228-b94c-4246-8c69-1659f524de84 for instance 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:09:13.430069 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-50dedc8e-8b24-41e5-8bb3-1393c198cf10 req-1f541819-f981-4c69-aee1-e5fec833bb44 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Received event network-changed-f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:13.430286 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-50dedc8e-8b24-41e5-8bb3-1393c198cf10 req-1f541819-f981-4c69-aee1-e5fec833bb44 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Refreshing instance network info cache due to event network-changed-f1428b8e-46c9-4f64-ac65-4993a29661e9. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:09:13.430550 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-50dedc8e-8b24-41e5-8bb3-1393c198cf10 req-1f541819-f981-4c69-aee1-e5fec833bb44 service nova] Acquiring lock "refresh_cache-1f6b0265-a79e-4b95-91d7-f9c5c81a9594" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:09:13.430704 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-50dedc8e-8b24-41e5-8bb3-1393c198cf10 req-1f541819-f981-4c69-aee1-e5fec833bb44 service nova] Acquired lock "refresh_cache-1f6b0265-a79e-4b95-91d7-f9c5c81a9594" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:09:13.432104 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-50dedc8e-8b24-41e5-8bb3-1393c198cf10 req-1f541819-f981-4c69-aee1-e5fec833bb44 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Refreshing network info cache for port f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:09:13.433945 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully detached device vdb from instance 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 from the live domain config.
May 27 23:09:13.437825 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:09:13.437825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:09:13.437825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:13.437825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:13.437825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b311228-b94c-4246-8c69-1659f524de84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:09:13.437825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:09:13.464519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:13.464519 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:13.464519 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:13.464519 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:13.464519 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:13.464519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:13.464519 np0000001565 nova-compute[98289]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84 (non-flash)
May 27 23:09:13.464519 np0000001565 nova-compute[98289]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:13.464519 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:13.464519 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:13.464519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '85')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:09:13.464519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '83')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:09:13.466217 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84', '82')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:09:13.467737 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3870af20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'): ({'sdd'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:09:13.467737 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Removing multipathed devices sdd, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:09:13.467737 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flush multipath device 330000000cfb42acf {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:09:13.496823 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:09:13.543131 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:09:13.578900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:09:13.578900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:09:13.578900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:09:13.591555 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:09:13.591555 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:09:13.603081 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:13.638592 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.40.100,3260]
May 27 23:09:13.638592 np0000001565 nova-compute[98289]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.40.100,3260] successful.
May 27 23:09:13.638592 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:13.653794 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:13.663862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:13.691819 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.50.100,3260]
May 27 23:09:13.691819 np0000001565 nova-compute[98289]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-6b311228-b94c-4246-8c69-1659f524de84, portal: 192.168.50.100,3260] successful.
May 27 23:09:13.691819 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:13.703910 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:13.704108 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:13.704234 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] <== disconnect_volume: return (267ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:09:13.704348 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:09:13.717381 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:13.877572 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Acquiring lock "refresh_cache-1f6b0265-a79e-4b95-91d7-f9c5c81a9594" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:09:13.935676 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-50dedc8e-8b24-41e5-8bb3-1393c198cf10 req-1f541819-f981-4c69-aee1-e5fec833bb44 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:14.014370 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-50dedc8e-8b24-41e5-8bb3-1393c198cf10 req-1f541819-f981-4c69-aee1-e5fec833bb44 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:09:14.150744 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-50dedc8e-8b24-41e5-8bb3-1393c198cf10 req-1f541819-f981-4c69-aee1-e5fec833bb44 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:14.232634 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c2f67ab0-b3b0-4071-8fbe-7f7290b82e45 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.009s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:14.258651 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:14.379279 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:09:14.380281 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:09:14.380573 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Creating image(s)
May 27 23:09:14.381042 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:14.381222 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "/opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:14.381715 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "/opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:14.382790 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:14.385348 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:14.386461 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:14.476125 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:14.476631 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:14.477094 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:14.477575 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:14.480464 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:14.480798 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:14.564156 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:14.564767 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:14.619017 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk 1073741824" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:14.619637 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.142s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:14.620108 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:14.654639 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-50dedc8e-8b24-41e5-8bb3-1393c198cf10 req-1f541819-f981-4c69-aee1-e5fec833bb44 service nova] Releasing lock "refresh_cache-1f6b0265-a79e-4b95-91d7-f9c5c81a9594" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:09:14.655630 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Acquired lock "refresh_cache-1f6b0265-a79e-4b95-91d7-f9c5c81a9594" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:09:14.655917 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:09:14.708790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:14.709190 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:09:14.709527 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:14.796215 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:14.796850 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Cannot resize image /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:09:14.797292 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:09:14.797576 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Ensure instance console log exists: /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:09:14.797924 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:14.798190 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:14.798410 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:15.257267 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:09:15.267771 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f040338b-8ecd-4b97-9d10-4e98fad7a849 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.998s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:15.430621 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:15.518605 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7a708286-8483-4e6c-8f27-c69433338592 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:15.518770 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7a708286-8483-4e6c-8f27-c69433338592 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:15.518900 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7a708286-8483-4e6c-8f27-c69433338592 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:15.523240 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7a708286-8483-4e6c-8f27-c69433338592 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98289) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 27 23:09:15.523737 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-7a708286-8483-4e6c-8f27-c69433338592 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:15.575721 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Updating instance_info_cache with network_info: [{"id": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "address": "fa:16:3e:71:df:71", "network": {"id": "f9ebaeba-39cc-4404-8855-f34d7fd9d6a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1480954740-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62a944cc56b24e0f8e0a1d1449c63682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1428b8e-46", "ovs_interfaceid": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:16.077791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Releasing lock "refresh_cache-1f6b0265-a79e-4b95-91d7-f9c5c81a9594" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:09:16.078077 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Instance network_info: |[{"id": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "address": "fa:16:3e:71:df:71", "network": {"id": "f9ebaeba-39cc-4404-8855-f34d7fd9d6a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1480954740-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62a944cc56b24e0f8e0a1d1449c63682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1428b8e-46", "ovs_interfaceid": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:09:16.079701 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Start _get_guest_xml network_info=[{"id": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "address": "fa:16:3e:71:df:71", "network": {"id": "f9ebaeba-39cc-4404-8855-f34d7fd9d6a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1480954740-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62a944cc56b24e0f8e0a1d1449c63682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1428b8e-46", "ovs_interfaceid": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:09:16.085429 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:09:16.086558 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1885015544', uuid='1f6b0265-a79e-4b95-91d7-f9c5c81a9594'), owner=OwnerMeta(userid='5803701dd2c948a2bb1e2226c26ff27b', username='tempest-VolumesActionsTest-1984000371-project-member', projectid='62a944cc56b24e0f8e0a1d1449c63682', projectname='tempest-VolumesActionsTest-1984000371'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "address": "fa:16:3e:71:df:71", "network": {"id": "f9ebaeba-39cc-4404-8855-f34d7fd9d6a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1480954740-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62a944cc56b24e0f8e0a1d1449c63682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1428b8e-46", "ovs_interfaceid": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923356.0862164) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:09:16.087427 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:09:16.087739 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:09:16.090408 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:09:16.090589 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:09:16.091434 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:09:16.091710 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:09:16.091834 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:09:16.091917 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:09:16.092025 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:09:16.092103 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:09:16.092195 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:09:16.092406 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:09:16.092544 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:09:16.092695 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:09:16.092820 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:09:16.092927 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:09:16.112718 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1885015544',display_name='tempest-VolumesActionsTest-instance-1885015544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesactionstest-instance-1885015544',id=43,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a944cc56b24e0f8e0a1d1449c63682',ramdisk_id='',reservation_id='r-ok4hlgjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1984000371',owner_user_name='tempest-VolumesActionsTest-1984000371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:09:13Z,user_data=None,user_id='5803701dd2c948a2bb1e2226c26ff27b',uuid=1f6b0265-a79e-4b95-91d7-f9c5c81a9594,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "address": "fa:16:3e:71:df:71", "network": {"id": "f9ebaeba-39cc-4404-8855-f34d7fd9d6a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1480954740-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62a944cc56b24e0f8e0a1d1449c63682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1428b8e-46", "ovs_interfaceid": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:09:16.112905 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Converting VIF {"id": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "address": "fa:16:3e:71:df:71", "network": {"id": "f9ebaeba-39cc-4404-8855-f34d7fd9d6a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1480954740-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62a944cc56b24e0f8e0a1d1449c63682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1428b8e-46", "ovs_interfaceid": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:16.113506 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:df:71,bridge_name='br-int',has_traffic_filtering=True,id=f1428b8e-46c9-4f64-ac65-4993a29661e9,network=Network(f9ebaeba-39cc-4404-8855-f34d7fd9d6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1428b8e-46') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:16.113977 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f6b0265-a79e-4b95-91d7-f9c5c81a9594 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:16.546601 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:16.548531 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:16.573474 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:16.599876 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:16.616281 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] End _get_guest_xml xml=<domain type="qemu">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <uuid>1f6b0265-a79e-4b95-91d7-f9c5c81a9594</uuid>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <name>instance-0000002b</name>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumesActionsTest-instance-1885015544</nova:name>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:09:16</nova:creationTime>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:user uuid="5803701dd2c948a2bb1e2226c26ff27b">tempest-VolumesActionsTest-1984000371-project-member</nova:user>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:project uuid="62a944cc56b24e0f8e0a1d1449c63682">tempest-VolumesActionsTest-1984000371</nova:project>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         <nova:port uuid="f1428b8e-46c9-4f64-ac65-4993a29661e9">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <system>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <entry name="serial">1f6b0265-a79e-4b95-91d7-f9c5c81a9594</entry>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <entry name="uuid">1f6b0265-a79e-4b95-91d7-f9c5c81a9594</entry>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     </system>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <os>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   </os>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <features>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   </features>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   <devices>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     </disk>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk.config"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     </disk>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:71:df:71"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <target dev="tapf1428b8e-46"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     </interface>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/console.log" append="off"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     </serial>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <video>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     </video>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     </rng>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:   </devices>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]: </domain>
May 27 23:09:16.616281 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:09:16.619100 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Preparing to wait for external event network-vif-plugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:09:16.619100 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Acquiring lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:16.619100 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:16.619100 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:16.619100 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1885015544',display_name='tempest-VolumesActionsTest-instance-1885015544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesactionstest-instance-1885015544',id=43,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a944cc56b24e0f8e0a1d1449c63682',ramdisk_id='',reservation_id='r-ok4hlgjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1984000371',owner_user_name='tempest-VolumesActionsTest-1984000371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:09:13Z,user_data=None,user_id='5803701dd2c948a2bb1e2226c26ff27b',uuid=1f6b0265-a79e-4b95-91d7-f9c5c81a9594,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "address": "fa:16:3e:71:df:71", "network": {"id": "f9ebaeba-39cc-4404-8855-f34d7fd9d6a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1480954740-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62a944cc56b24e0f8e0a1d1449c63682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1428b8e-46", "ovs_interfaceid": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:09:16.619100 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Converting VIF {"id": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "address": "fa:16:3e:71:df:71", "network": {"id": "f9ebaeba-39cc-4404-8855-f34d7fd9d6a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1480954740-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62a944cc56b24e0f8e0a1d1449c63682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1428b8e-46", "ovs_interfaceid": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:16.621648 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:df:71,bridge_name='br-int',has_traffic_filtering=True,id=f1428b8e-46c9-4f64-ac65-4993a29661e9,network=Network(f9ebaeba-39cc-4404-8855-f34d7fd9d6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1428b8e-46') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:16.621875 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:df:71,bridge_name='br-int',has_traffic_filtering=True,id=f1428b8e-46c9-4f64-ac65-4993a29661e9,network=Network(f9ebaeba-39cc-4404-8855-f34d7fd9d6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1428b8e-46') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:09:16.622150 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:16.622378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:16.622616 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:09:16.623206 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:16.623390 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6170dacf-a369-5442-84eb-b0e95f0ccfdb', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:16.624469 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:16.625091 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:16.630267 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:16.632840 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:16.633122 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1428b8e-46, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:16.633766 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1428b8e-46, col_values=(('qos', UUID('f0ad98b9-e4d3-48be-804e-e9c20a26f65e')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:16.634065 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1428b8e-46, col_values=(('external_ids', {'iface-id': 'f1428b8e-46c9-4f64-ac65-4993a29661e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:df:71', 'vm-uuid': '1f6b0265-a79e-4b95-91d7-f9c5c81a9594'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:16.635025 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:16.636258 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:16.647063 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:16.648186 np0000001565 nova-compute[98289]: INFO os_vif [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:df:71,bridge_name='br-int',has_traffic_filtering=True,id=f1428b8e-46c9-4f64-ac65-4993a29661e9,network=Network(f9ebaeba-39cc-4404-8855-f34d7fd9d6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1428b8e-46')
May 27 23:09:16.682588 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-17b32f66-3738-42ed-9968-ecca2c9623fc req-40db0aaa-3d66-4e92-8485-32d2656c8cd5 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:16.683043 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-17b32f66-3738-42ed-9968-ecca2c9623fc req-40db0aaa-3d66-4e92-8485-32d2656c8cd5 service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:16.683460 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-17b32f66-3738-42ed-9968-ecca2c9623fc req-40db0aaa-3d66-4e92-8485-32d2656c8cd5 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:16.683590 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-17b32f66-3738-42ed-9968-ecca2c9623fc req-40db0aaa-3d66-4e92-8485-32d2656c8cd5 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:16.683711 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-17b32f66-3738-42ed-9968-ecca2c9623fc req-40db0aaa-3d66-4e92-8485-32d2656c8cd5 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] No waiting events found dispatching network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:16.683887 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-17b32f66-3738-42ed-9968-ecca2c9623fc req-40db0aaa-3d66-4e92-8485-32d2656c8cd5 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received unexpected event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b for instance with vm_state active and task_state powering-off.
May 27 23:09:16.756345 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:16.858065 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999704171999838 future=<Future at 0x726e601fef60 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:16.858654 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999121872999694 future=<Future at 0x726e601fef60 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:16.860234 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.997509436999735 future=<Future at 0x726e601fef60 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:16.862319 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance destroyed successfully.
May 27 23:09:16.863439 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-7a708286-8483-4e6c-8f27-c69433338592 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:17.263836 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] instance snapshotting
May 27 23:09:17.365406 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-7a708286-8483-4e6c-8f27-c69433338592 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:09:17.365704 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7a708286-8483-4e6c-8f27-c69433338592 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:17.369428 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Beginning live snapshot process
May 27 23:09:17.881042 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7a708286-8483-4e6c-8f27-c69433338592 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.361s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:18.164440 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:18.164573 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:18.164677 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] No VIF found with MAC fa:16:3e:71:df:71, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:09:18.165128 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Using config drive
May 27 23:09:18.260901 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:18.669706 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:18.724757 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:18.750947 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a7ba8cae-ed01-4d3f-b2c6-bd2c290e64be req-fc85f682-ba28-4d22-8c4c-292f3d79413a service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:18.752264 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a7ba8cae-ed01-4d3f-b2c6-bd2c290e64be req-fc85f682-ba28-4d22-8c4c-292f3d79413a service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:18.752264 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a7ba8cae-ed01-4d3f-b2c6-bd2c290e64be req-fc85f682-ba28-4d22-8c4c-292f3d79413a service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:18.752264 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a7ba8cae-ed01-4d3f-b2c6-bd2c290e64be req-fc85f682-ba28-4d22-8c4c-292f3d79413a service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:18.752264 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a7ba8cae-ed01-4d3f-b2c6-bd2c290e64be req-fc85f682-ba28-4d22-8c4c-292f3d79413a service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] No waiting events found dispatching network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:18.752264 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-a7ba8cae-ed01-4d3f-b2c6-bd2c290e64be req-fc85f682-ba28-4d22-8c4c-292f3d79413a service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received unexpected event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b for instance with vm_state stopped and task_state powering-on.
May 27 23:09:18.767705 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:09:18.767829 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquired lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:09:18.768221 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:09:18.768561 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'info_cache' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:18.814265 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Creating config drive at /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk.config
May 27 23:09:18.817447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp41lgpsx6 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:18.873045 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp41lgpsx6" returned: 0 in 0.055s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:18.889235 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json -f qcow2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:18.986505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json -f qcow2" returned: 0 in 0.096s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:18.987396 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json -f qcow2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:19.099177 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json -f qcow2" returned: 0 in 0.112s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:19.100212 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:19.102743 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:19.103184 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:19.208643 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.105s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:19.209214 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6mfcq0au/7eeb6b17947b432594393813e5f9d690.delta 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:19.263770 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6mfcq0au/7eeb6b17947b432594393813e5f9d690.delta 1073741824" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:19.264876 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Quiescing instance not available: QEMU guest agent is not enabled.
May 27 23:09:19.274264 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:09:19.282496 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:19.313618 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:19.319666 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:19.416737 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:19.490965 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0aa6c834-d020-4dab-ab4b-0a4f4d368d3a req-803630c2-fcfe-4ab4-a1fa-883a3f3bc5b2 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Received event network-vif-plugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:19.491283 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0aa6c834-d020-4dab-ab4b-0a4f4d368d3a req-803630c2-fcfe-4ab4-a1fa-883a3f3bc5b2 service nova] Acquiring lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:19.491527 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0aa6c834-d020-4dab-ab4b-0a4f4d368d3a req-803630c2-fcfe-4ab4-a1fa-883a3f3bc5b2 service nova] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:19.491711 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0aa6c834-d020-4dab-ab4b-0a4f4d368d3a req-803630c2-fcfe-4ab4-a1fa-883a3f3bc5b2 service nova] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:19.491842 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0aa6c834-d020-4dab-ab4b-0a4f4d368d3a req-803630c2-fcfe-4ab4-a1fa-883a3f3bc5b2 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Processing event network-vif-plugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:09:19.646969 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] COPY block job progress, current cursor: 458752 final cursor: 76742656 {{(pid=98289) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 23:09:19.671592 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:19.681676 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:19.686350 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:19.708601 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:19.715661 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:19.779681 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:20.104204 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:20.149617 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=98289) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 23:09:20.151628 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Skipping quiescing instance: QEMU guest agent is not enabled.
May 27 23:09:20.193251 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:09:20.193580 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6mfcq0au/7eeb6b17947b432594393813e5f9d690.delta /opt/stack/data/nova/instances/snapshots/tmp6mfcq0au/7eeb6b17947b432594393813e5f9d690 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:20.279358 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Updating instance_info_cache with network_info: [{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:20.332985 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923360.3325846, 1f6b0265-a79e-4b95-91d7-f9c5c81a9594 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:20.333128 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] VM Started (Lifecycle Event)
May 27 23:09:20.334984 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:09:20.340372 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:09:20.340372 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Instance spawned successfully.
May 27 23:09:20.340709 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:09:20.417235 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6mfcq0au/7eeb6b17947b432594393813e5f9d690.delta /opt/stack/data/nova/instances/snapshots/tmp6mfcq0au/7eeb6b17947b432594393813e5f9d690" returned: 0 in 0.224s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:20.421724 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Snapshot extracted, beginning image upload
May 27 23:09:20.781856 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Releasing lock "refresh_cache-4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:09:20.836162 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:20.838569 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:09:20.852845 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:20.852845 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:20.852845 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:20.852845 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:20.852845 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:20.852845 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:21.340707 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:09:21.341076 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923361.3408456, 1f6b0265-a79e-4b95-91d7-f9c5c81a9594 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:21.341226 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] VM Paused (Lifecycle Event)
May 27 23:09:21.358613 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Took 6.98 seconds to spawn the instance on the hypervisor.
May 27 23:09:21.358613 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:21.561187 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5b551f3e-8a3c-4f7f-8d0f-352d5461cd4f req-53f36cb8-7ad6-4cdd-bf41-4d108e10070a service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Received event network-vif-plugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:21.561447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5b551f3e-8a3c-4f7f-8d0f-352d5461cd4f req-53f36cb8-7ad6-4cdd-bf41-4d108e10070a service nova] Acquiring lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:21.561644 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5b551f3e-8a3c-4f7f-8d0f-352d5461cd4f req-53f36cb8-7ad6-4cdd-bf41-4d108e10070a service nova] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:21.561766 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5b551f3e-8a3c-4f7f-8d0f-352d5461cd4f req-53f36cb8-7ad6-4cdd-bf41-4d108e10070a service nova] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:21.561881 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5b551f3e-8a3c-4f7f-8d0f-352d5461cd4f req-53f36cb8-7ad6-4cdd-bf41-4d108e10070a service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] No waiting events found dispatching network-vif-plugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:21.561999 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5b551f3e-8a3c-4f7f-8d0f-352d5461cd4f req-53f36cb8-7ad6-4cdd-bf41-4d108e10070a service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Received unexpected event network-vif-plugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 for instance with vm_state active and task_state None.
May 27 23:09:21.644009 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:21.793842 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance destroyed successfully.
May 27 23:09:21.794236 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:21.843534 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:21.847575 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923361.8472357, 1f6b0265-a79e-4b95-91d7-f9c5c81a9594 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:21.847788 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] VM Resumed (Lifecycle Event)
May 27 23:09:21.868168 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Took 12.38 seconds to build instance.
May 27 23:09:22.296902 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:09:22.297404 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'resources' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:22.352170 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:22.356136 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:09:22.373468 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.893s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:22.800980 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:09:22.801843 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-238721078',display_name='tempest-AttachVolumeTestJSON-server-238721078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-238721078',id=37,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Qq0763SlHFA9VpZwsMi86ZEUPb6ApCeF8QACBJQZv1Rp1P7LElgDkrzQ2GQCg/z1bU9PMQyrWIL6JBPLYXYJUrkv+/pKYLhHsqJZtKFBBSXjOqDTK9LJJtTBA4xSw+w==',key_name='tempest-keypair-2072419759',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:27Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-rnai6jvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:09:22.802118 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:22.803033 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:22.803363 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:09:22.804634 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:22.804905 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda08a446-87, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:22.817362 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:22.818668 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:22.819793 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:22.819939 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0e8c419-373c-4efe-bfe3-ffebfbeabad0) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:22.820463 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:22.821081 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:22.823713 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:22.828621 np0000001565 nova-compute[98289]: INFO os_vif [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87')
May 27 23:09:22.833040 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Start _get_guest_xml network_info=[{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:09:22.836183 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:09:22.838738 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-238721078', uuid='4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6'), owner=OwnerMeta(userid='946d9258fd0841dca06d0184677f7376', username='tempest-AttachVolumeTestJSON-849627440-project-member', projectid='996f2d92ddf941fab9c407482cbb534e', projectname='tempest-AttachVolumeTestJSON-849627440'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923362.838307) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:09:22.848433 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:09:22.848686 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:09:22.850297 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:09:22.850605 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:09:22.852073 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:09:22.852470 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:09:22.852704 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:09:22.852819 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:09:22.853014 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:09:22.853154 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:09:22.853320 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:09:22.853591 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:09:22.853809 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:09:22.853960 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:09:22.854113 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:09:22.854303 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:09:22.854538 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:22.984565 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Snapshot image upload complete
May 27 23:09:22.984565 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c5e28158-6638-4af0-9abe-e7a23dc6a1c4 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Took 5.72 seconds to snapshot the instance on the hypervisor.
May 27 23:09:23.357962 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:09:23.377084 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-238721078',display_name='tempest-AttachVolumeTestJSON-server-238721078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-238721078',id=37,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Qq0763SlHFA9VpZwsMi86ZEUPb6ApCeF8QACBJQZv1Rp1P7LElgDkrzQ2GQCg/z1bU9PMQyrWIL6JBPLYXYJUrkv+/pKYLhHsqJZtKFBBSXjOqDTK9LJJtTBA4xSw+w==',key_name='tempest-keypair-2072419759',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:27Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-rnai6jvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:09:23.377272 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:23.377766 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:23.381184 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:23.724820 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:23.882844 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:09:23.887957 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] End _get_guest_xml xml=<domain type="qemu">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <uuid>4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6</uuid>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <name>instance-00000025</name>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeTestJSON-server-238721078</nova:name>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:09:22</nova:creationTime>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:user uuid="946d9258fd0841dca06d0184677f7376">tempest-AttachVolumeTestJSON-849627440-project-member</nova:user>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:project uuid="996f2d92ddf941fab9c407482cbb534e">tempest-AttachVolumeTestJSON-849627440</nova:project>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         <nova:port uuid="da08a446-879f-4bdd-9ac4-5d3d736fc30b">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <system>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <entry name="serial">4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6</entry>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <entry name="uuid">4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6</entry>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     </system>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <os>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   </os>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <features>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   </features>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   <devices>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     </disk>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk.config"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     </disk>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:8a:26:c4"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <target dev="tapda08a446-87"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     </interface>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/console.log" append="off"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     </serial>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <video>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     </video>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     </rng>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:   </devices>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]: </domain>
May 27 23:09:23.887957 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:09:23.887957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:23.982442 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:23.983172 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:24.078987 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:24.080448 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:24.585144 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:09:24.585775 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:24.649578 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "9caacf98-b127-48ed-ab3e-75fdb2776598" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:24.651346 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:24.673195 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:24.673609 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:09:24.673840 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:24.760919 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:24.761344 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Cannot resize image /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:09:24.761658 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'migration_context' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:25.152589 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:09:25.265141 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Object Instance<4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:09:25.266492 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-238721078',display_name='tempest-AttachVolumeTestJSON-server-238721078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-238721078',id=37,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Qq0763SlHFA9VpZwsMi86ZEUPb6ApCeF8QACBJQZv1Rp1P7LElgDkrzQ2GQCg/z1bU9PMQyrWIL6JBPLYXYJUrkv+/pKYLhHsqJZtKFBBSXjOqDTK9LJJtTBA4xSw+w==',key_name='tempest-keypair-2072419759',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:27Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-rnai6jvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:09:25.266766 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:25.267458 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:25.267741 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:09:25.269672 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:25.270009 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:25.270368 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:09:25.272010 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:25.272177 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f18cdd6d-3c89-597d-a891-9147c3ade8c8', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:25.274406 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:25.275627 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:25.281918 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:25.282166 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda08a446-87, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:25.282883 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda08a446-87, col_values=(('qos', UUID('b82be2b4-9c9b-4625-8d10-6c5fd4672ba5')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:25.283102 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda08a446-87, col_values=(('external_ids', {'iface-id': 'da08a446-879f-4bdd-9ac4-5d3d736fc30b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:26:c4', 'vm-uuid': '4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:25.284360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:25.286007 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:25.290114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:25.291112 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:25.292976 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:25.294189 np0000001565 nova-compute[98289]: INFO os_vif [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87')
May 27 23:09:25.705358 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:25.705648 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:25.712556 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:09:25.712702 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Claim successful on node np0000001565
May 27 23:09:25.718970 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:25.753472 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:25.797968 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'flavor' on Instance uuid f6a3b268-ad24-445e-a58c-b1e35a289f56 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:25.853358 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:25.939992 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b1dffc-b10a-46b1-a7d3-3c91fcfb5efa req-2a8be681-5f76-48cc-a8d4-15e0692938e4 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:25.940392 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b1dffc-b10a-46b1-a7d3-3c91fcfb5efa req-2a8be681-5f76-48cc-a8d4-15e0692938e4 service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:25.940612 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b1dffc-b10a-46b1-a7d3-3c91fcfb5efa req-2a8be681-5f76-48cc-a8d4-15e0692938e4 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:25.940768 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b1dffc-b10a-46b1-a7d3-3c91fcfb5efa req-2a8be681-5f76-48cc-a8d4-15e0692938e4 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:25.940887 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b1dffc-b10a-46b1-a7d3-3c91fcfb5efa req-2a8be681-5f76-48cc-a8d4-15e0692938e4 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] No waiting events found dispatching network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:25.941009 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c0b1dffc-b10a-46b1-a7d3-3c91fcfb5efa req-2a8be681-5f76-48cc-a8d4-15e0692938e4 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received unexpected event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b for instance with vm_state stopped and task_state powering-on.
May 27 23:09:26.101006 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:26.103103 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:26.107113 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:26.129440 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:26.488169 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance event wait completed in 0 seconds for  {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:09:26.489093 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 due to new event <LifecycleEvent: 1779923366.488699, 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:09:26.489093 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923366.488699, 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:26.489345 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] VM Resumed (Lifecycle Event)
May 27 23:09:26.492020 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance rebooted successfully.
May 27 23:09:26.802914 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:26.992028 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:26.997132 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:09:27.063550 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:09:27.063834 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:09:27.499220 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 23:09:27.499494 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923367.4992757, 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:27.499649 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] VM Started (Lifecycle Event)
May 27 23:09:27.566750 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:09:27.790801 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Acquiring lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:27.790980 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:27.791184 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Acquiring lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:27.791344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:27.791499 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:27.793371 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Terminating instance
May 27 23:09:27.868413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:27.868413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:27.868413 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Attaching volume 9952761e-515c-464d-9151-a628c54216c9 to /dev/vdb
May 27 23:09:27.899953 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:09:27.911590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:09:27.935356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:27.977563 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:09:27.977871 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:09:27.987719 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:09:27.989459 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe48:f47', 'fe80::fc5d:41ff:fe1a:3ede', 'fe80::fc16:3eff:fe19:1372', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fe5f:f9a9', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fece:1a11', 'fe80::3cbc:9fff:fe13:5e69', 'fe80::fc16:3eff:fe71:df71', 'fe80::b47f:37ff:fe4e:f20d', 'fe80::fc16:3eff:fe8a:26c4', 'fe80::70b0:20ff:fe1f:52b3'] 
May 27 23:09:27.989585 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:09:27.989714 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:09:27.990013 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:09:27.990324 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Updating existing volume attachment record: 2486932b-c12f-4a24-a1c1-62fab28869c9 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:09:27.998888 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ad838e6d-3a9c-48e7-af4f-8e65abf4e3c3 req-b8f2511b-63ed-4146-bdb4-f6e9d9f0101f service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:28.000083 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ad838e6d-3a9c-48e7-af4f-8e65abf4e3c3 req-b8f2511b-63ed-4146-bdb4-f6e9d9f0101f service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:28.000647 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ad838e6d-3a9c-48e7-af4f-8e65abf4e3c3 req-b8f2511b-63ed-4146-bdb4-f6e9d9f0101f service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:28.000859 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ad838e6d-3a9c-48e7-af4f-8e65abf4e3c3 req-b8f2511b-63ed-4146-bdb4-f6e9d9f0101f service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:28.001053 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ad838e6d-3a9c-48e7-af4f-8e65abf4e3c3 req-b8f2511b-63ed-4146-bdb4-f6e9d9f0101f service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] No waiting events found dispatching network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:28.001259 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-ad838e6d-3a9c-48e7-af4f-8e65abf4e3c3 req-b8f2511b-63ed-4146-bdb4-f6e9d9f0101f service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received unexpected event network-vif-plugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b for instance with vm_state stopped and task_state powering-on.
May 27 23:09:28.005015 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:28.005425 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:28.005800 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No VIF found with MAC fa:16:3e:8a:26:c4, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:09:28.006461 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-31ccbc06-fec7-4daf-ad60-c844a753367b tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:28.007912 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:28.013876 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:09:28.073891 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.368s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:28.074489 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:09:28.298436 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:09:28.316540 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:28.318955 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:28.339268 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:28.364190 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:28.365099 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:28.458643 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3841972b-43f8-405b-a5db-e8b2564caa32 req-c463b3fd-3cee-434a-8867-84626c7792e5 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Received event network-vif-unplugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:28.458997 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3841972b-43f8-405b-a5db-e8b2564caa32 req-c463b3fd-3cee-434a-8867-84626c7792e5 service nova] Acquiring lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:28.459195 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3841972b-43f8-405b-a5db-e8b2564caa32 req-c463b3fd-3cee-434a-8867-84626c7792e5 service nova] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:28.459344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3841972b-43f8-405b-a5db-e8b2564caa32 req-c463b3fd-3cee-434a-8867-84626c7792e5 service nova] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:28.459576 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3841972b-43f8-405b-a5db-e8b2564caa32 req-c463b3fd-3cee-434a-8867-84626c7792e5 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] No waiting events found dispatching network-vif-unplugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:28.459706 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3841972b-43f8-405b-a5db-e8b2564caa32 req-c463b3fd-3cee-434a-8867-84626c7792e5 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Received event network-vif-unplugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:09:28.518023 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 23:09:28.556863 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:09:28.557254 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9952761e-515c-464d-9151-a628c54216c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:09:28.557442 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:28.557820 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:28.558035 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9952761e-515c-464d-9151-a628c54216c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:09:28.574645 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:28.577351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:28.577351 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:09:28.577351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:28.577351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:28.577351 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:09:28.580553 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:09:28.580923 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:09:28.581256 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:28.581580 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:28.587867 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:09:28.587867 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:28.595403 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:09:28.595403 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:28.602602 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9] added
May 27 23:09:28.602602 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:09:28.602602 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:28.602602 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:28.602602 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:28.602602 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:28.602602 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:28.602965 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:09:28.603233 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:09:28.603575 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:09:28.609140 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9] added
May 27 23:09:28.609140 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:09:28.609140 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:28.609140 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:28.609140 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:28.609140 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:28.609140 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:28.609351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:09:28.609529 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:09:28.609721 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:09:28.620694 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:28.629600 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:28.655045 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99975213100015 future=<Future at 0x726e386a5820 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:28.657230 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Instance destroyed successfully.
May 27 23:09:28.657579 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lazy-loading 'resources' on Instance uuid 1f6b0265-a79e-4b95-91d7-f9c5c81a9594 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:28.671444 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08c42711a5d14870b3f4ebecf1deaeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077b44d61ee49ffbb4b474bd8b6711a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:09:28.730516 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:29.087253 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:09:29.133208 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Successfully created port: 86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:09:29.160296 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1885015544',display_name='tempest-VolumesActionsTest-instance-1885015544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesactionstest-instance-1885015544',id=43,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:09:21Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a944cc56b24e0f8e0a1d1449c63682',ramdisk_id='',reservation_id='r-ok4hlgjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1984000371',owner_user_name='tempest-VolumesActionsTest-1984000371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:09:21Z,user_data=None,user_id='5803701dd2c948a2bb1e2226c26ff27b',uuid=1f6b0265-a79e-4b95-91d7-f9c5c81a9594,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "address": "fa:16:3e:71:df:71", "network": {"id": "f9ebaeba-39cc-4404-8855-f34d7fd9d6a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1480954740-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62a944cc56b24e0f8e0a1d1449c63682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1428b8e-46", "ovs_interfaceid": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:09:29.160506 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Converting VIF {"id": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "address": "fa:16:3e:71:df:71", "network": {"id": "f9ebaeba-39cc-4404-8855-f34d7fd9d6a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1480954740-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "62a944cc56b24e0f8e0a1d1449c63682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1428b8e-46", "ovs_interfaceid": "f1428b8e-46c9-4f64-ac65-4993a29661e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:29.161201 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:df:71,bridge_name='br-int',has_traffic_filtering=True,id=f1428b8e-46c9-4f64-ac65-4993a29661e9,network=Network(f9ebaeba-39cc-4404-8855-f34d7fd9d6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1428b8e-46') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:29.161499 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:df:71,bridge_name='br-int',has_traffic_filtering=True,id=f1428b8e-46c9-4f64-ac65-4993a29661e9,network=Network(f9ebaeba-39cc-4404-8855-f34d7fd9d6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1428b8e-46') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:09:29.163103 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:29.163371 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1428b8e-46, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:29.166273 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:29.167374 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:29.167838 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0ad98b9-e4d3-48be-804e-e9c20a26f65e) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:29.169203 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:29.170958 np0000001565 nova-compute[98289]: INFO os_vif [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:df:71,bridge_name='br-int',has_traffic_filtering=True,id=f1428b8e-46c9-4f64-ac65-4993a29661e9,network=Network(f9ebaeba-39cc-4404-8855-f34d7fd9d6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1428b8e-46')
May 27 23:09:29.171237 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Deleting instance files /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594_del
May 27 23:09:29.171845 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Deletion of /opt/stack/data/nova/instances/1f6b0265-a79e-4b95-91d7-f9c5c81a9594_del complete
May 27 23:09:29.591209 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:09:29.603964 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:09:29.610922 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:09:29.618345 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:09:29.618345 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:09:29.626635 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:09:29.626635 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:29.634825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:29.642679 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:29.649384 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.649384 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.649384 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:29.649601 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.649601 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.649601 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:29.658843 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Successfully updated port: 86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:09:29.660300 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.660300 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.660300 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:29.660478 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.660478 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.660478 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:29.679029 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 23:09:29.679716 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:09:29.679949 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:09:29.680075 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:09:29.680358 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:29.685492 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9, portal: 192.168.40.100,3260]
May 27 23:09:29.685492 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9, portal: 192.168.40.100,3260] successful.
May 27 23:09:29.685492 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:29.698807 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:29.704496 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9, portal: 192.168.50.100,3260]
May 27 23:09:29.704496 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9, portal: 192.168.50.100,3260] successful.
May 27 23:09:29.704496 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:29.714006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.714006 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.714006 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:29.714006 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:29.714006 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:29.716843 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.716843 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.716843 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:29.716843 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:29.716843 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:29.716843 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:29.717019 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:09:29.717976 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] HCTL ('9', '-', '-', 0) found on session 88 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:09:29.719063 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:09:29.729551 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bc01c547-5db2-4c47-a158-352b8568990b req-ba13b911-de5c-44a3-9699-b96b3376cd9f service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Received event network-changed-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:29.730484 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bc01c547-5db2-4c47-a158-352b8568990b req-ba13b911-de5c-44a3-9699-b96b3376cd9f service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Refreshing instance network info cache due to event network-changed-86ad7902-8e2c-46df-abf0-8c14e0f72ce8. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:09:29.731022 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bc01c547-5db2-4c47-a158-352b8568990b req-ba13b911-de5c-44a3-9699-b96b3376cd9f service nova] Acquiring lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:09:29.731166 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bc01c547-5db2-4c47-a158-352b8568990b req-ba13b911-de5c-44a3-9699-b96b3376cd9f service nova] Acquired lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:09:29.732325 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-bc01c547-5db2-4c47-a158-352b8568990b req-ba13b911-de5c-44a3-9699-b96b3376cd9f service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Refreshing network info cache for port 86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:09:29.732631 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:29.739958 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching for a device in session 88 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:09:29.740449 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9952761e-515c-464d-9151-a628c54216c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:09:29.751960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.751960 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.751960 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:29.751960 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:29.751960 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:29.751960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.751960 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:29.751960 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:29.751960 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:29.751960 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:29.752489 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:29.752489 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:09:29.754794 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] HCTL ('10', '-', '-', 0) found on session 89 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:09:29.754794 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:09:29.768842 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching for a device in session 89 and hctl ['10', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:09:29.822511 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:30.161947 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:09:30.194080 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:30.236450 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-bc01c547-5db2-4c47-a158-352b8568990b req-ba13b911-de5c-44a3-9699-b96b3376cd9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:30.295902 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-bc01c547-5db2-4c47-a158-352b8568990b req-ba13b911-de5c-44a3-9699-b96b3376cd9f service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:09:30.431344 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-bc01c547-5db2-4c47-a158-352b8568990b req-ba13b911-de5c-44a3-9699-b96b3376cd9f service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:30.515529 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f2453324-f10a-4190-9254-3980a8717f3e req-1139be9b-847c-41f2-a912-a813e2c571f6 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Received event network-vif-unplugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:30.515529 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f2453324-f10a-4190-9254-3980a8717f3e req-1139be9b-847c-41f2-a912-a813e2c571f6 service nova] Acquiring lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:30.515529 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f2453324-f10a-4190-9254-3980a8717f3e req-1139be9b-847c-41f2-a912-a813e2c571f6 service nova] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:30.515529 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f2453324-f10a-4190-9254-3980a8717f3e req-1139be9b-847c-41f2-a912-a813e2c571f6 service nova] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:30.515831 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f2453324-f10a-4190-9254-3980a8717f3e req-1139be9b-847c-41f2-a912-a813e2c571f6 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] No waiting events found dispatching network-vif-unplugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:30.516015 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f2453324-f10a-4190-9254-3980a8717f3e req-1139be9b-847c-41f2-a912-a813e2c571f6 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Received event network-vif-unplugged-f1428b8e-46c9-4f64-ac65-4993a29661e9 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:09:30.516202 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f2453324-f10a-4190-9254-3980a8717f3e req-1139be9b-847c-41f2-a912-a813e2c571f6 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Received event network-vif-deleted-f1428b8e-46c9-4f64-ac65-4993a29661e9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:30.516412 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-f2453324-f10a-4190-9254-3980a8717f3e req-1139be9b-847c-41f2-a912-a813e2c571f6 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Neutron deleted interface f1428b8e-46c9-4f64-ac65-4993a29661e9; detaching it from the instance and deleting it from the info cache
May 27 23:09:30.517734 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f2453324-f10a-4190-9254-3980a8717f3e req-1139be9b-847c-41f2-a912-a813e2c571f6 service nova] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Detach interface failed, port_id=f1428b8e-46c9-4f64-ac65-4993a29661e9, reason: Instance 1f6b0265-a79e-4b95-91d7-f9c5c81a9594 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:09:30.585689 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:30.598904 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:09:30.599936 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:09:30.600515 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Creating image(s)
May 27 23:09:30.601016 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "/opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:30.601226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "/opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:30.601681 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "/opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:30.601955 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "2211cc8ac7b73454bc388649a151ac8829665bc5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:30.602256 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "2211cc8ac7b73454bc388649a151ac8829665bc5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:30.769162 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching for a device in session 89 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:09:30.769355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9952761e-515c-464d-9151-a628c54216c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:09:30.933373 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bc01c547-5db2-4c47-a158-352b8568990b req-ba13b911-de5c-44a3-9699-b96b3376cd9f service nova] Releasing lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:09:30.933978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquired lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:09:30.934040 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:09:31.087952 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Took 1.41 seconds to deallocate network for instance.
May 27 23:09:31.376052 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:31.378724 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:31.379027 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5.part --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:31.465962 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5.part --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:31.467011 np0000001565 nova-compute[98289]: DEBUG nova.virt.images [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] e7a03625-b76e-4463-a5a0-3984974b633b was qcow2, converting to raw {{(pid=98289) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 23:09:31.470346 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:09:31.470346 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5.part /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5.converted {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:31.516683 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:09:31.595493 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:31.595702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:31.601977 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Found WWN 330000000c9df99ce for multipath device dm-1 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:09:31.602686 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:31.602866 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '330000000c9df99ce', 'path': '/dev/dm-1', 'multipath_id': '330000000c9df99ce'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:09:31.603077 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c9df99ce', 'path': '/dev/dm-1', 'multipath_id': '330000000c9df99ce'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:09:31.607005 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'flavor' on Instance uuid f6a3b268-ad24-445e-a58c-b1e35a289f56 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:31.633687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5.part /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5.converted" returned: 0 in 0.166s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:31.649722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5.converted --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:31.697504 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:31.734919 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5.converted --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:31.738287 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "2211cc8ac7b73454bc388649a151ac8829665bc5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.133s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:31.738287 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:31.739206 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:31.740404 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:31.823071 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5 --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:31.826349 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "2211cc8ac7b73454bc388649a151ac8829665bc5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:31.826349 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "2211cc8ac7b73454bc388649a151ac8829665bc5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:31.826349 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:31.827299 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:31.827768 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:31.861050 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0028776620001735864 future=<Future at 0x726e601fef60 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:31.862492 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:31.862773 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=11.791993967000053 future=<Future at 0x726e386a5820 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:31.862921 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=11.791800478999903 future=<Future at 0x726e386a5820 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:31.899233 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Updating instance_info_cache with network_info: [{"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:31.920350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5 --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:31.920983 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5,backing_fmt=raw /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:31.975116 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5,backing_fmt=raw /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk 1073741824" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:31.978427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "2211cc8ac7b73454bc388649a151ac8829665bc5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:31.978427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:32.066554 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2211cc8ac7b73454bc388649a151ac8829665bc5 --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:32.067289 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:09:32.067696 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Ensure instance console log exists: /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:09:32.068694 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:32.068694 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:32.068694 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:32.110801 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Attempting to attach volume 9952761e-515c-464d-9151-a628c54216c9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:09:32.116037 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:09:32.116037 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:09:32.116037 np0000001565 nova-compute[98289]:   <alias name="ua-9952761e-515c-464d-9151-a628c54216c9"/>
May 27 23:09:32.116037 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-1"/>
May 27 23:09:32.116037 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:09:32.116037 np0000001565 nova-compute[98289]:   <serial>9952761e-515c-464d-9151-a628c54216c9</serial>
May 27 23:09:32.116037 np0000001565 nova-compute[98289]: </disk>
May 27 23:09:32.116037 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:09:32.139223 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:09:32.139488 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:09:32.402558 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Releasing lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:09:32.403260 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Instance network_info: |[{"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:09:32.404978 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Start _get_guest_xml network_info=[{"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='11a009efe2866110023057e64226ae4c',container_format='bare',created_at=2026-05-27T23:09:16Z,direct_url=<?>,disk_format='qcow2',id=e7a03625-b76e-4463-a5a0-3984974b633b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1577774691',owner='e077b44d61ee49ffbb4b474bd8b6711a',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-27T23:09:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': 'e7a03625-b76e-4463-a5a0-3984974b633b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:09:32.407981 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:09:32.409282 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1284464292', uuid='9caacf98-b127-48ed-ab3e-75fdb2776598'), owner=OwnerMeta(userid='08c42711a5d14870b3f4ebecf1deaeeb', username='tempest-TestStampPattern-893938880-project-member', projectid='e077b44d61ee49ffbb4b474bd8b6711a', projectname='tempest-TestStampPattern-893938880'), image=ImageMeta(id='e7a03625-b76e-4463-a5a0-3984974b633b', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': 'e077b44d61ee49ffbb4b474bd8b6711a'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923372.4088132) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:09:32.410376 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:09:32.410720 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:09:32.411588 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:09:32.411751 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:09:32.412823 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:09:32.413228 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='11a009efe2866110023057e64226ae4c',container_format='bare',created_at=2026-05-27T23:09:16Z,direct_url=<?>,disk_format='qcow2',id=e7a03625-b76e-4463-a5a0-3984974b633b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1577774691',owner='e077b44d61ee49ffbb4b474bd8b6711a',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-27T23:09:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:09:32.413354 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:09:32.413453 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:09:32.413580 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:09:32.413655 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:09:32.413789 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:09:32.414346 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:09:32.414346 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:09:32.414346 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:09:32.414448 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:09:32.414593 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:09:32.426576 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1284464292',display_name='tempest-TestStampPattern-server-1284464292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-teststamppattern-server-1284464292',id=44,image_ref='e7a03625-b76e-4463-a5a0-3984974b633b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuEcu169UlUv7QteA0pyqLa0rS+TCUcqSe/52EzrwkMxCZMxvXkbwYZZ52jOtlT5g4axqhIG+f70+HHRNLCB4B5BkPxo86FW+2QK/hLCWkxS7WEa7mWN+8QeTpUvCGHkQ==',key_name='tempest-TestStampPattern-1547678374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e077b44d61ee49ffbb4b474bd8b6711a',ramdisk_id='',reservation_id='r-1l9eopu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='92ea712d-1f47-4313-8c9f-6c7a4a5b3c46',image_min_disk='1',image_min_ram='0',image_owner_id='e077b44d61ee49ffbb4b474bd8b6711a',image_owner_project_name='tempest-TestStampPattern-893938880',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-893938880-project-member',image_user_id='08c42711a5d14870b3f4ebecf1deaeeb',network_allocated='True',owner_project_name='tempest-TestStampPattern-893938880',owner_user_name='tempest-TestStampPattern-893938880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:09:30Z,user_data=None,user_id='08c42711a5d14870b3f4ebecf1deaeeb',uuid=9caacf98-b127-48ed-ab3e-75fdb2776598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:09:32.426784 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converting VIF {"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:32.427465 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:4f:f1,bridge_name='br-int',has_traffic_filtering=True,id=86ad7902-8e2c-46df-abf0-8c14e0f72ce8,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ad7902-8e') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:32.428065 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lazy-loading 'pci_devices' on Instance uuid 9caacf98-b127-48ed-ab3e-75fdb2776598 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:32.642431 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:09:32.930611 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] End _get_guest_xml xml=<domain type="qemu">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <uuid>9caacf98-b127-48ed-ab3e-75fdb2776598</uuid>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <name>instance-0000002c</name>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestStampPattern-server-1284464292</nova:name>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:09:32</nova:creationTime>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:           <nova:property name="img_owner_id">e077b44d61ee49ffbb4b474bd8b6711a</nova:property>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:user uuid="08c42711a5d14870b3f4ebecf1deaeeb">tempest-TestStampPattern-893938880-project-member</nova:user>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:project uuid="e077b44d61ee49ffbb4b474bd8b6711a">tempest-TestStampPattern-893938880</nova:project>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         <nova:port uuid="86ad7902-8e2c-46df-abf0-8c14e0f72ce8">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <system>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <entry name="serial">9caacf98-b127-48ed-ab3e-75fdb2776598</entry>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <entry name="uuid">9caacf98-b127-48ed-ab3e-75fdb2776598</entry>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     </system>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <os>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   </os>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <features>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   </features>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   <devices>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     </disk>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk.config"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     </disk>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:50:4f:f1"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <target dev="tap86ad7902-8e"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     </interface>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/console.log" append="off"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     </serial>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <video>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     </video>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     </rng>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:   </devices>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]: </domain>
May 27 23:09:32.930611 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Preparing to wait for external event network-vif-plugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1284464292',display_name='tempest-TestStampPattern-server-1284464292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-teststamppattern-server-1284464292',id=44,image_ref='e7a03625-b76e-4463-a5a0-3984974b633b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuEcu169UlUv7QteA0pyqLa0rS+TCUcqSe/52EzrwkMxCZMxvXkbwYZZ52jOtlT5g4axqhIG+f70+HHRNLCB4B5BkPxo86FW+2QK/hLCWkxS7WEa7mWN+8QeTpUvCGHkQ==',key_name='tempest-TestStampPattern-1547678374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e077b44d61ee49ffbb4b474bd8b6711a',ramdisk_id='',reservation_id='r-1l9eopu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='92ea712d-1f47-4313-8c9f-6c7a4a5b3c46',image_min_disk='1',image_min_ram='0',image_owner_id='e077b44d61ee49ffbb4b474bd8b6711a',image_owner_project_name='tempest-TestStampPattern-893938880',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-893938880-project-member',image_user_id='08c42711a5d14870b3f4ebecf1deaeeb',network_allocated='True',owner_project_name='tempest-TestStampPattern-893938880',owner_user_name='tempest-TestStampPattern-893938880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:09:30Z,user_data=None,user_id='08c42711a5d14870b3f4ebecf1deaeeb',uuid=9caacf98-b127-48ed-ab3e-75fdb2776598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converting VIF {"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:4f:f1,bridge_name='br-int',has_traffic_filtering=True,id=86ad7902-8e2c-46df-abf0-8c14e0f72ce8,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ad7902-8e') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:4f:f1,bridge_name='br-int',has_traffic_filtering=True,id=86ad7902-8e2c-46df-abf0-8c14e0f72ce8,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ad7902-8e') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:09:32.934556 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:32.935071 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '465af973-5b67-5924-9c58-c78533b59084', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:32.935730 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:32.937495 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:32.939429 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:32.939669 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86ad7902-8e, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:32.940243 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86ad7902-8e, col_values=(('qos', UUID('46ab0638-856a-48bd-8365-160df568aa60')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:32.940510 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86ad7902-8e, col_values=(('external_ids', {'iface-id': '86ad7902-8e2c-46df-abf0-8c14e0f72ce8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:4f:f1', 'vm-uuid': '9caacf98-b127-48ed-ab3e-75fdb2776598'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:32.944825 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:32.946376 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:32.947202 np0000001565 nova-compute[98289]: INFO os_vif [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:4f:f1,bridge_name='br-int',has_traffic_filtering=True,id=86ad7902-8e2c-46df-abf0-8c14e0f72ce8,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ad7902-8e')
May 27 23:09:32.978013 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:32.978380 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:33.149086 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.553s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:33.194412 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Deleted allocations for instance 1f6b0265-a79e-4b95-91d7-f9c5c81a9594
May 27 23:09:33.481144 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:33.730835 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:33.774878 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:33.775165 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:33.775165 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:33.775324 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No VIF found with MAC fa:16:3e:19:13:72, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:09:34.202017 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3735ffa8-d666-4031-9a93-8e34a91197f5 tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Lock "1f6b0265-a79e-4b95-91d7-f9c5c81a9594" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.411s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:34.465966 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:34.465966 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:34.465966 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No VIF found with MAC fa:16:3e:50:4f:f1, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:09:34.465966 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Using config drive
May 27 23:09:34.486627 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:34.972845 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:35.134502 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Creating config drive at /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk.config
May 27 23:09:35.137997 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpekc3z3go {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:35.187657 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpekc3z3go" returned: 0 in 0.049s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:35.323590 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6f218e78-e649-495d-9d14-e935eee79d0a tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.457s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:35.596580 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:35.597048 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:35.598124 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Attaching volume bd6a5488-3824-4767-9879-bfd2c7abef0e to /dev/vdb
May 27 23:09:35.657288 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:09:35.672675 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:09:35.698670 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:35.699706 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:35.726903 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:35.762589 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:09:35.762589 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:09:35.775594 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:09:35.775960 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe48:f47', 'fe80::fc5d:41ff:fe1a:3ede', 'fe80::fc16:3eff:fe19:1372', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fe5f:f9a9', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::fc16:3eff:fece:1a11', 'fe80::3cbc:9fff:fe13:5e69', 'fe80::fc16:3eff:fe8a:26c4', 'fe80::70b0:20ff:fe1f:52b3', 'fe80::fc16:3eff:fe50:4ff1'] 
May 27 23:09:35.776084 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:09:35.776164 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:09:35.776415 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:09:35.776885 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating existing volume attachment record: e0810884-d78e-439d-ac45-6bf773b193fd {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:09:35.831848 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:35.924945 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:35.926550 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:36.032615 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-18042470-5ab7-423b-ab27-62b293de64bd req-ecef9cc7-5ca3-4eaf-bb93-fd02a8c7f991 service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Received event network-vif-plugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:36.033894 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-18042470-5ab7-423b-ab27-62b293de64bd req-ecef9cc7-5ca3-4eaf-bb93-fd02a8c7f991 service nova] Acquiring lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:36.034282 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-18042470-5ab7-423b-ab27-62b293de64bd req-ecef9cc7-5ca3-4eaf-bb93-fd02a8c7f991 service nova] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:36.034282 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-18042470-5ab7-423b-ab27-62b293de64bd req-ecef9cc7-5ca3-4eaf-bb93-fd02a8c7f991 service nova] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:36.034432 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-18042470-5ab7-423b-ab27-62b293de64bd req-ecef9cc7-5ca3-4eaf-bb93-fd02a8c7f991 service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Processing event network-vif-plugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:09:36.388028 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'cae297ad-de9f-4adf-9e00-20b1f926df45', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'serial': 'bd6a5488-3824-4767-9879-bfd2c7abef0e'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:09:36.392905 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:09:36.393325 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:09:36.393522 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:36.393960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:36.394250 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:09:36.407501 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:36.408165 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:36.408714 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:36.408912 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:09:36.409340 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:36.409550 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:09:36.421863 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:09:36.421863 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:36.427907 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:09:36.427907 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:36.434734 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e] added
May 27 23:09:36.434734 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:09:36.434734 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:36.434734 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:36.434734 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:36.434734 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:36.434734 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:36.434935 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:09:36.435087 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:09:36.435231 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:09:36.447507 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e] added
May 27 23:09:36.447507 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:09:36.447507 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:36.447507 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:36.447507 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:09:36.447507 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:09:36.447507 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:36.447688 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:09:36.447803 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0382(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:09:36.447924 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:09:36.557768 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923376.5574234, 9caacf98-b127-48ed-ab3e-75fdb2776598 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:36.558361 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:09:36.558517 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] VM Started (Lifecycle Event)
May 27 23:09:36.562927 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:09:36.564557 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Instance spawned successfully.
May 27 23:09:36.564874 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:09:36.567572 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:36.567881 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:37.065264 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:37.071356 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:09:37.076214 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Took 6.48 seconds to spawn the instance on the hypervisor.
May 27 23:09:37.076491 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:37.435596 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:09:37.447060 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:09:37.447060 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:37.449447 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:09:37.464729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:09:37.471233 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:09:37.471233 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:37.481610 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.481610 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.481610 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.481610 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.481610 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:37.481610 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.481610 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.481610 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.481610 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.481610 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:37.482662 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:37.503700 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.503700 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.503700 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.503700 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.503700 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:37.503907 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.503907 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.503907 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.503907 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.503907 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:37.513836 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260]
May 27 23:09:37.513836 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260] successful.
May 27 23:09:37.513836 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:37.523629 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:37.540290 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.540290 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.540290 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.540290 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.540290 np0000001565 nova-compute[98289]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:37.540290 np0000001565 nova-compute[98289]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:37.540290 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:37.540633 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.540633 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.540633 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.540633 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.540633 np0000001565 nova-compute[98289]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:37.540633 np0000001565 nova-compute[98289]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:37.540633 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:37.540970 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:37.541519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260]
May 27 23:09:37.541519 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260] successful.
May 27 23:09:37.541519 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:37.542603 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:09:37.545652 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('11', '-', '-', 0) found on session 90 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:09:37.545892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:09:37.555362 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:37.568675 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 90 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:09:37.568843 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:09:37.573945 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:09:37.574256 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923377.5740545, 9caacf98-b127-48ed-ab3e-75fdb2776598 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:37.574425 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] VM Paused (Lifecycle Event)
May 27 23:09:37.578734 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.578734 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.578734 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.578734 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.578734 np0000001565 nova-compute[98289]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:37.578734 np0000001565 nova-compute[98289]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:37.578734 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:37.578919 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.578919 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:37.578919 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.578919 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:37.578919 np0000001565 nova-compute[98289]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:37.578919 np0000001565 nova-compute[98289]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:37.578919 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:37.579141 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:37.579257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:09:37.580215 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('12', '-', '-', 0) found on session 91 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:09:37.580324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:09:37.592945 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Took 11.94 seconds to build instance.
May 27 23:09:37.604801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 91 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:09:37.604801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:09:37.741442 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "044cb49c-ae45-4a08-ba7a-1717134060e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:37.745141 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:37.942420 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:38.080451 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:38.082499 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923378.0822654, 9caacf98-b127-48ed-ab3e-75fdb2776598 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:38.082654 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] VM Resumed (Lifecycle Event)
May 27 23:09:38.095994 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-51ff9722-0031-47d5-93df-67381be0415e req-1844b9b9-0d01-42d1-aaf8-8453e624da1d service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Received event network-vif-plugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:38.095994 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-51ff9722-0031-47d5-93df-67381be0415e req-1844b9b9-0d01-42d1-aaf8-8453e624da1d service nova] Acquiring lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:38.095994 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-51ff9722-0031-47d5-93df-67381be0415e req-1844b9b9-0d01-42d1-aaf8-8453e624da1d service nova] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:38.095994 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-51ff9722-0031-47d5-93df-67381be0415e req-1844b9b9-0d01-42d1-aaf8-8453e624da1d service nova] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:38.095994 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-51ff9722-0031-47d5-93df-67381be0415e req-1844b9b9-0d01-42d1-aaf8-8453e624da1d service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] No waiting events found dispatching network-vif-plugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:38.095994 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-51ff9722-0031-47d5-93df-67381be0415e req-1844b9b9-0d01-42d1-aaf8-8453e624da1d service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Received unexpected event network-vif-plugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 for instance with vm_state active and task_state None.
May 27 23:09:38.095994 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.446s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:38.250371 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:09:38.410393 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:09:38.585254 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:38.587317 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:09:38.746912 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:38.813788 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:38.814082 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:38.817210 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:09:38.817417 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Claim successful on node np0000001565
May 27 23:09:39.427050 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found WWN 330000000b6712bdb for multipath device dm-4 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:09:39.427884 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:39.429440 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000b6712bdb', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000b6712bdb'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:09:39.429440 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b6712bdb', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000b6712bdb'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:09:39.431062 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:09:39.432540 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:09:39.432540 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:09:39.450369 np0000001565 nova-compute[98289]: WARNING os_brick.encryptors.luks [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 23:09:39.451873 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:09:39.451873 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:09:39.451873 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:09:39.451873 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x726e386c5310>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': 'cae297ad-de9f-4adf-9e00-20b1f926df45', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'serial': 'bd6a5488-3824-4767-9879-bfd2c7abef0e'} {{(pid=98289) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 23:09:39.451873 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] formatting encrypted volume /dev/dm-4 {{(pid=98289) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 27 23:09:39.808641 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0d2e1c31-3200-4a0a-9cea-7aa6d06e063e req-ccba0a16-d4d6-4d16-8fbd-e5d33bf9842c service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Received event network-changed-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:39.809807 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0d2e1c31-3200-4a0a-9cea-7aa6d06e063e req-ccba0a16-d4d6-4d16-8fbd-e5d33bf9842c service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Refreshing instance network info cache due to event network-changed-86ad7902-8e2c-46df-abf0-8c14e0f72ce8. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:09:39.811395 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0d2e1c31-3200-4a0a-9cea-7aa6d06e063e req-ccba0a16-d4d6-4d16-8fbd-e5d33bf9842c service nova] Acquiring lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:09:39.811395 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0d2e1c31-3200-4a0a-9cea-7aa6d06e063e req-ccba0a16-d4d6-4d16-8fbd-e5d33bf9842c service nova] Acquired lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:09:39.811395 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0d2e1c31-3200-4a0a-9cea-7aa6d06e063e req-ccba0a16-d4d6-4d16-8fbd-e5d33bf9842c service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Refreshing network info cache for port 86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:09:40.236382 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:09:40.236734 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:09:40.314264 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-0d2e1c31-3200-4a0a-9cea-7aa6d06e063e req-ccba0a16-d4d6-4d16-8fbd-e5d33bf9842c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:40.525090 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0781f600-175e-4db4-8d34-04879ca192d6 req-217796b4-6815-46b0-918d-9e75d7a92273 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-changed-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:40.525945 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0781f600-175e-4db4-8d34-04879ca192d6 req-217796b4-6815-46b0-918d-9e75d7a92273 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Refreshing instance network info cache due to event network-changed-0ec6133d-baba-415d-82ec-9cbe8dfb935f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:09:40.525945 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0781f600-175e-4db4-8d34-04879ca192d6 req-217796b4-6815-46b0-918d-9e75d7a92273 service nova] Acquiring lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:09:40.525945 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0781f600-175e-4db4-8d34-04879ca192d6 req-217796b4-6815-46b0-918d-9e75d7a92273 service nova] Acquired lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:09:40.526174 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0781f600-175e-4db4-8d34-04879ca192d6 req-217796b4-6815-46b0-918d-9e75d7a92273 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Refreshing network info cache for port 0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:09:40.740752 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-0d2e1c31-3200-4a0a-9cea-7aa6d06e063e req-ccba0a16-d4d6-4d16-8fbd-e5d33bf9842c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:40.743717 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:09:40.914501 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0d2e1c31-3200-4a0a-9cea-7aa6d06e063e req-ccba0a16-d4d6-4d16-8fbd-e5d33bf9842c service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Updated VIF entry in instance network info cache for port 86ad7902-8e2c-46df-abf0-8c14e0f72ce8. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:09:40.914778 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0d2e1c31-3200-4a0a-9cea-7aa6d06e063e req-ccba0a16-d4d6-4d16-8fbd-e5d33bf9842c service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Updating instance_info_cache with network_info: [{"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:41.032467 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-0781f600-175e-4db4-8d34-04879ca192d6 req-217796b4-6815-46b0-918d-9e75d7a92273 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:41.057925 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:41.057925 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:41.058215 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:41.058765 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:41.058909 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:41.061614 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Terminating instance
May 27 23:09:41.252889 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.439s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:41.253717 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:09:41.347247 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-0781f600-175e-4db4-8d34-04879ca192d6 req-217796b4-6815-46b0-918d-9e75d7a92273 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:41.416628 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0d2e1c31-3200-4a0a-9cea-7aa6d06e063e req-ccba0a16-d4d6-4d16-8fbd-e5d33bf9842c service nova] Releasing lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:09:41.478641 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0781f600-175e-4db4-8d34-04879ca192d6 req-217796b4-6815-46b0-918d-9e75d7a92273 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updated VIF entry in instance network info cache for port 0ec6133d-baba-415d-82ec-9cbe8dfb935f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:09:41.478641 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0781f600-175e-4db4-8d34-04879ca192d6 req-217796b4-6815-46b0-918d-9e75d7a92273 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating instance_info_cache with network_info: [{"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:41.565006 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:09:41.586457 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:41.590206 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:41.605924 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:41.615478 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:41.636177 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:41.641382 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:41.764341 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:09:41.764974 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:09:41.765241 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:41.765535 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:41.881367 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9df5f69b62834b2caaf76302e55c9707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cb500558784c258720ab29bf2d40fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:09:41.897952 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999649049999789 future=<Future at 0x726e38642270 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:41.900456 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Instance destroyed successfully.
May 27 23:09:41.900456 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lazy-loading 'resources' on Instance uuid d099633e-fe8f-425b-b486-3f325ce97d12 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:41.979906 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0781f600-175e-4db4-8d34-04879ca192d6 req-217796b4-6815-46b0-918d-9e75d7a92273 service nova] Releasing lock "refresh_cache-d099633e-fe8f-425b-b486-3f325ce97d12" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:09:42.269887 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:09:42.355444 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Successfully created port: cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:09:42.409369 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1892961998',display_name='tempest-TestShelveInstance-server-1892961998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testshelveinstance-server-1892961998',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWCU6efaHvzG5loviLci2EWhflUFzxorLb2dKK8/e4l6LBfmbsuAMiPeTHSpUAakWRl1Yt9Cuh7F6B+3kDbokEdnyEqt/j2SLnkbohJPY+gKSpX+1QSNNHsYyNbdnkWNw==',key_name='tempest-TestShelveInstance-1672332914',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:09:03Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce5d1153ffbc42b5863df7b2db23eaec',ramdisk_id='',reservation_id='r-dl8ft992',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1900497856',owner_user_name='tempest-TestShelveInstance-1900497856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:09:03Z,user_data=None,user_id='e16486bc9a2b451788f9c61df0c20472',uuid=d099633e-fe8f-425b-b486-3f325ce97d12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:09:42.409369 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converting VIF {"id": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "address": "fa:16:3e:ce:1a:11", "network": {"id": "b617b4c3-abf1-4d2e-a75f-b3b97c22a998", "bridge": "br-int", "label": "tempest-TestShelveInstance-1537958522-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce5d1153ffbc42b5863df7b2db23eaec", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ec6133d-ba", "ovs_interfaceid": "0ec6133d-baba-415d-82ec-9cbe8dfb935f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:42.409369 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:42.409369 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:09:42.409369 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:42.410211 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ec6133d-ba, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:42.410490 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:42.411361 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:42.412274 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:42.412415 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cff850e-274e-4be2-a514-eeefb0c44a09) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:42.412878 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:42.413384 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:42.413663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:42.415737 np0000001565 nova-compute[98289]: INFO os_vif [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1a:11,bridge_name='br-int',has_traffic_filtering=True,id=0ec6133d-baba-415d-82ec-9cbe8dfb935f,network=Network(b617b4c3-abf1-4d2e-a75f-b3b97c22a998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ec6133d-ba')
May 27 23:09:42.418213 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:09:42.418213 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:09:42.418213 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:09:42.418213 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:09:42.418213 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc739915-bed4-402d-afff-e7278e2139c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:09:42.418213 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6 (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:09:42.448369 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '91')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '84')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:09:42.448369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6', '85')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:09:42.448995 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e602b36a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'): ({'sdc'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:09:42.449176 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:09:42.449487 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Flush multipath device 33000000053a926ad {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:09:42.508599 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:09:42.545738 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:09:42.586481 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:42.586771 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:42.586771 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:42.586898 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:42.587022 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] No waiting events found dispatching network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:42.587142 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:09:42.587236 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:42.587363 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] Acquiring lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:42.587478 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:42.587617 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] Lock "d099633e-fe8f-425b-b486-3f325ce97d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:42.587702 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] No waiting events found dispatching network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:42.587809 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec9268d0-e00f-4b83-bd07-4f1c8208bf71 req-d2a79c1b-a680-4bcd-85b3-302bcbe3ca05 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-vif-unplugged-0ec6133d-baba-415d-82ec-9cbe8dfb935f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:09:42.593708 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:09:42.593838 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:09:42.594710 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:09:42.605183 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:09:42.605347 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:09:42.620718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:42.655186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.40.100,3260]
May 27 23:09:42.655186 np0000001565 nova-compute[98289]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.40.100,3260] successful.
May 27 23:09:42.655186 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:42.672562 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:42.683687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:42.715343 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.50.100,3260]
May 27 23:09:42.715343 np0000001565 nova-compute[98289]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-cc739915-bed4-402d-afff-e7278e2139c6, portal: 192.168.50.100,3260] successful.
May 27 23:09:42.715343 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:42.737394 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:09:42.737585 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:09:42.737681 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] <== disconnect_volume: return (320ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:09:42.737791 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:09:42.738053 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Deleting instance files /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12_del
May 27 23:09:42.738546 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Deletion of /opt/stack/data/nova/instances/d099633e-fe8f-425b-b486-3f325ce97d12_del complete
May 27 23:09:42.774525 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:09:42.897982 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Successfully updated port: cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:09:42.954589 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2a75876d-a642-4558-8491-5f03b5c1b1fa req-336d6b68-9942-4169-a044-93c46063cb0b service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Received event network-changed-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:42.954712 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2a75876d-a642-4558-8491-5f03b5c1b1fa req-336d6b68-9942-4169-a044-93c46063cb0b service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Refreshing instance network info cache due to event network-changed-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:09:42.955067 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2a75876d-a642-4558-8491-5f03b5c1b1fa req-336d6b68-9942-4169-a044-93c46063cb0b service nova] Acquiring lock "refresh_cache-044cb49c-ae45-4a08-ba7a-1717134060e0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:09:42.955156 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2a75876d-a642-4558-8491-5f03b5c1b1fa req-336d6b68-9942-4169-a044-93c46063cb0b service nova] Acquired lock "refresh_cache-044cb49c-ae45-4a08-ba7a-1717134060e0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:09:42.955260 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2a75876d-a642-4558-8491-5f03b5c1b1fa req-336d6b68-9942-4169-a044-93c46063cb0b service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Refreshing network info cache for port cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:09:43.250747 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Took 1.69 seconds to destroy the instance on the hypervisor.
May 27 23:09:43.251878 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:09:43.253272 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:09:43.253272 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:09:43.253272 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:43.338641 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:43.400052 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "refresh_cache-044cb49c-ae45-4a08-ba7a-1717134060e0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:09:43.457316 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2a75876d-a642-4558-8491-5f03b5c1b1fa req-336d6b68-9942-4169-a044-93c46063cb0b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:43.545771 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2a75876d-a642-4558-8491-5f03b5c1b1fa req-336d6b68-9942-4169-a044-93c46063cb0b service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:09:43.578443 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b22866e4-ebee-4c1b-afae-440838455b99 req-5a2963bc-22e3-46f9-bad2-7f7096df74c3 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Received event network-vif-deleted-0ec6133d-baba-415d-82ec-9cbe8dfb935f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:43.578791 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-b22866e4-ebee-4c1b-afae-440838455b99 req-5a2963bc-22e3-46f9-bad2-7f7096df74c3 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Neutron deleted interface 0ec6133d-baba-415d-82ec-9cbe8dfb935f; detaching it from the instance and deleting it from the info cache
May 27 23:09:43.580021 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b22866e4-ebee-4c1b-afae-440838455b99 req-5a2963bc-22e3-46f9-bad2-7f7096df74c3 service nova] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Detach interface failed, port_id=0ec6133d-baba-415d-82ec-9cbe8dfb935f, reason: Instance d099633e-fe8f-425b-b486-3f325ce97d12 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:09:43.655451 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0005835060001118109 future=<Future at 0x726e386a5820 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:43.655852 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:43.655942 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=13.241647873999682 future=<Future at 0x726e38642270 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:43.655942 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=13.241562397000052 future=<Future at 0x726e38642270 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:43.657705 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Emitting event <LifecycleEvent: 1779923368.6546483, 1f6b0265-a79e-4b95-91d7-f9c5c81a9594 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:43.657705 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] VM Stopped (Lifecycle Event)
May 27 23:09:43.659617 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2a75876d-a642-4558-8491-5f03b5c1b1fa req-336d6b68-9942-4169-a044-93c46063cb0b service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:43.699194 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 23:09:43.699194 np0000001565 nova-compute[98289]:   <usage type="volume">
May 27 23:09:43.699194 np0000001565 nova-compute[98289]:     <volume>bd6a5488-3824-4767-9879-bfd2c7abef0e</volume>
May 27 23:09:43.699194 np0000001565 nova-compute[98289]:   </usage>
May 27 23:09:43.699194 np0000001565 nova-compute[98289]: </secret>
May 27 23:09:43.699194 np0000001565 nova-compute[98289]:  {{(pid=98289) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 23:09:43.703720 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:43.748856 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:43.782082 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:09:43.782979 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:09:43.783248 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Creating image(s)
May 27 23:09:43.783805 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "/opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:43.783951 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "/opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:43.784512 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "/opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:43.785071 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:43.787410 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:43.788476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:43.872900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:43.873548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:43.874089 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:43.874661 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:43.877730 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:09:43.878124 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:43.969290 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.091s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:43.969828 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:44.020150 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk 1073741824" returned: 0 in 0.050s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:44.020824 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:44.021402 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:44.037871 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:44.112170 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.091s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:44.112611 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Checking if we can resize image /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:09:44.112902 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:44.163759 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-930c6a59-2206-43d2-9631-5666abe369f0 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: 1f6b0265-a79e-4b95-91d7-f9c5c81a9594] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:44.163759 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2a75876d-a642-4558-8491-5f03b5c1b1fa req-336d6b68-9942-4169-a044-93c46063cb0b service nova] Releasing lock "refresh_cache-044cb49c-ae45-4a08-ba7a-1717134060e0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:09:44.163759 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquired lock "refresh_cache-044cb49c-ae45-4a08-ba7a-1717134060e0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:09:44.163900 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:09:44.193193 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:44.193497 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Cannot resize image /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:09:44.193976 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:09:44.194138 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Ensure instance console log exists: /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:09:44.194418 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:44.194593 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:44.194716 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:44.207123 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Attempting to attach volume bd6a5488-3824-4767-9879-bfd2c7abef0e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:09:44.208711 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:09:44.208711 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:09:44.208711 np0000001565 nova-compute[98289]:   <alias name="ua-bd6a5488-3824-4767-9879-bfd2c7abef0e"/>
May 27 23:09:44.208711 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 27 23:09:44.208711 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:09:44.208711 np0000001565 nova-compute[98289]:   <serial>bd6a5488-3824-4767-9879-bfd2c7abef0e</serial>
May 27 23:09:44.208711 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:09:44.208711 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="e140f509-0d51-4f3a-8037-fe188c18414a"/>
May 27 23:09:44.208711 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:09:44.208711 np0000001565 nova-compute[98289]: </disk>
May 27 23:09:44.208711 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:09:44.542939 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Took 1.29 seconds to deallocate network for instance.
May 27 23:09:44.727754 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:09:44.877354 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:45.006770 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Updating instance_info_cache with network_info: [{"id": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "address": "fa:16:3e:fe:c3:28", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2fe9c1-9f", "ovs_interfaceid": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:45.114727 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Took 0.57 seconds to detach 1 volumes for instance.
May 27 23:09:45.117098 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Deleting volume: cc739915-bed4-402d-afff-e7278e2139c6 {{(pid=98289) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 23:09:45.509442 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Releasing lock "refresh_cache-044cb49c-ae45-4a08-ba7a-1717134060e0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:09:45.509715 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Instance network_info: |[{"id": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "address": "fa:16:3e:fe:c3:28", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2fe9c1-9f", "ovs_interfaceid": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:09:45.511310 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Start _get_guest_xml network_info=[{"id": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "address": "fa:16:3e:fe:c3:28", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2fe9c1-9f", "ovs_interfaceid": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:09:45.514135 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:09:45.515245 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1924512814', uuid='044cb49c-ae45-4a08-ba7a-1717134060e0'), owner=OwnerMeta(userid='9df5f69b62834b2caaf76302e55c9707', username='tempest-AttachVolumeNegativeTest-1834166666-project-member', projectid='47cb500558784c258720ab29bf2d40fe', projectname='tempest-AttachVolumeNegativeTest-1834166666'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "address": "fa:16:3e:fe:c3:28", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2fe9c1-9f", "ovs_interfaceid": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923385.5149088) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:09:45.516265 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:09:45.516559 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:09:45.517414 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:09:45.517579 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:09:45.518564 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:09:45.518872 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:09:45.519023 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:09:45.519111 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:09:45.519231 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:09:45.519316 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:09:45.519454 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:09:45.519576 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:09:45.519683 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:09:45.519805 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:09:45.519887 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:09:45.520023 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:09:45.529717 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:09:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1924512814',display_name='tempest-AttachVolumeNegativeTest-server-1924512814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1924512814',id=45,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7MYxHK9bvKyiK45ctALWAPnewKm0DoI7oO91eBhGaHtsIP0fIh79csgs3abeYg38Xd3KWUn/gkBikCtt6kZE2XuPBcM7Nng2TnktmqE/S+KJiY8tTep4ZrLrnT4WhYBA==',key_name='tempest-keypair-687440916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-zk71122m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=044cb49c-ae45-4a08-ba7a-1717134060e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "address": "fa:16:3e:fe:c3:28", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2fe9c1-9f", "ovs_interfaceid": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:09:45.529909 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "address": "fa:16:3e:fe:c3:28", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2fe9c1-9f", "ovs_interfaceid": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:45.530425 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c3:28,bridge_name='br-int',has_traffic_filtering=True,id=cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2fe9c1-9f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:45.531202 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'pci_devices' on Instance uuid 044cb49c-ae45-4a08-ba7a-1717134060e0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:45.658820 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:45.659025 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:46.001590 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:09:46.001980 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:09:46.034617 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] End _get_guest_xml xml=<domain type="qemu">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <uuid>044cb49c-ae45-4a08-ba7a-1717134060e0</uuid>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <name>instance-0000002d</name>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1924512814</nova:name>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:09:45</nova:creationTime>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:user uuid="9df5f69b62834b2caaf76302e55c9707">tempest-AttachVolumeNegativeTest-1834166666-project-member</nova:user>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:project uuid="47cb500558784c258720ab29bf2d40fe">tempest-AttachVolumeNegativeTest-1834166666</nova:project>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         <nova:port uuid="cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <system>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <entry name="serial">044cb49c-ae45-4a08-ba7a-1717134060e0</entry>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <entry name="uuid">044cb49c-ae45-4a08-ba7a-1717134060e0</entry>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     </system>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <os>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   </os>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <features>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   </features>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   <devices>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     </disk>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk.config"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     </disk>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:fe:c3:28"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <target dev="tapcf2fe9c1-9f"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     </interface>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/console.log" append="off"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     </serial>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <video>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     </video>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     </rng>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:   </devices>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]: </domain>
May 27 23:09:46.034617 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:09:46.041297 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Preparing to wait for external event network-vif-plugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:09:46.041517 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:46.041730 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:46.041956 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:46.042726 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:09:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1924512814',display_name='tempest-AttachVolumeNegativeTest-server-1924512814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1924512814',id=45,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7MYxHK9bvKyiK45ctALWAPnewKm0DoI7oO91eBhGaHtsIP0fIh79csgs3abeYg38Xd3KWUn/gkBikCtt6kZE2XuPBcM7Nng2TnktmqE/S+KJiY8tTep4ZrLrnT4WhYBA==',key_name='tempest-keypair-687440916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-zk71122m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=044cb49c-ae45-4a08-ba7a-1717134060e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "address": "fa:16:3e:fe:c3:28", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2fe9c1-9f", "ovs_interfaceid": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:09:46.042905 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "address": "fa:16:3e:fe:c3:28", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2fe9c1-9f", "ovs_interfaceid": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:46.043852 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c3:28,bridge_name='br-int',has_traffic_filtering=True,id=cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2fe9c1-9f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:46.044744 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c3:28,bridge_name='br-int',has_traffic_filtering=True,id=cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2fe9c1-9f') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:09:46.045194 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:46.045614 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:46.045948 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:09:46.047703 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:46.047900 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '769d4d83-1552-510a-92ce-26ea5137d83c', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:46.048816 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:46.049635 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:46.051169 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:46.053807 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:46.054056 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf2fe9c1-9f, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:46.054525 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf2fe9c1-9f, col_values=(('qos', UUID('2a2368ec-9d32-42d9-acce-98cb102b0871')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:46.054733 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf2fe9c1-9f, col_values=(('external_ids', {'iface-id': 'cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:c3:28', 'vm-uuid': '044cb49c-ae45-4a08-ba7a-1717134060e0'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:46.055734 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:46.057409 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:46.063458 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:46.064541 np0000001565 nova-compute[98289]: INFO os_vif [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:c3:28,bridge_name='br-int',has_traffic_filtering=True,id=cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2fe9c1-9f')
May 27 23:09:46.504775 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:09:46.821048 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:46.821155 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:46.821202 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:46.821326 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No VIF found with MAC fa:16:3e:5f:f9:a9, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:09:47.010889 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.352s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:47.055738 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Deleted allocations for instance d099633e-fe8f-425b-b486-3f325ce97d12
May 27 23:09:47.124212 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:09:47.582580 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:47.582763 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:09:47.582871 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No VIF found with MAC fa:16:3e:fe:c3:28, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:09:47.583406 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Using config drive
May 27 23:09:47.629237 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:47.629465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:47.629626 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:47.629810 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:09:48.063741 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-266a4ae1-b035-4834-8d8e-217b2d306305 tempest-TestShelveInstance-1900497856 tempest-TestShelveInstance-1900497856-project-member] Lock "d099633e-fe8f-425b-b486-3f325ce97d12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.006s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:48.091094 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:48.257229 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Creating config drive at /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk.config
May 27 23:09:48.261267 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfl97o5b_ {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:48.337026 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfl97o5b_" returned: 0 in 0.075s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:48.392221 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e32d9a81-61e6-403c-b8ef-3aa88a0c967a tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.793s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:48.665599 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:48.754108 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:48.754678 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:48.767550 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:48.856350 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:48.871608 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:48.879454 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:48.885080 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:48.986636 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:49.014567 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:49.014567 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:49.067471 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:49.122870 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:49.130016 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:49.230079 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:49.231305 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:49.261199 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3bb3db69-9bcb-44b6-acdb-a24c55b3f2ea req-7d38e903-de76-455a-a2a6-46f9a9ef7ce6 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Received event network-vif-plugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:49.261658 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bb3db69-9bcb-44b6-acdb-a24c55b3f2ea req-7d38e903-de76-455a-a2a6-46f9a9ef7ce6 service nova] Acquiring lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:49.262012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bb3db69-9bcb-44b6-acdb-a24c55b3f2ea req-7d38e903-de76-455a-a2a6-46f9a9ef7ce6 service nova] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:49.262236 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3bb3db69-9bcb-44b6-acdb-a24c55b3f2ea req-7d38e903-de76-455a-a2a6-46f9a9ef7ce6 service nova] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:49.262436 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3bb3db69-9bcb-44b6-acdb-a24c55b3f2ea req-7d38e903-de76-455a-a2a6-46f9a9ef7ce6 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Processing event network-vif-plugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:09:49.376996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:49.383540 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:49.496528 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:49.497036 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:49.596044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:49.596452 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:09:49.605541 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:49.715702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:49.716192 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:49.727825 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:49.806077 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:49.806726 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-4 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:09:49.811538 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:49.855727 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923389.8544958, 044cb49c-ae45-4a08-ba7a-1717134060e0 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:49.856201 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] VM Started (Lifecycle Event)
May 27 23:09:49.859559 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:09:49.862739 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:09:49.865361 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Instance spawned successfully.
May 27 23:09:49.866588 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:09:49.910261 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:49.913921 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:50.006009 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:50.013940 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:09:50.017387 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:09:50.064551 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:09:50.065943 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=12252MB free_disk=73.74161911010742GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:09:50.066397 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:50.066839 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:50.087999 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:50.088346 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:50.089122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:50.089122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:50.089122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:50.091322 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Terminating instance
May 27 23:09:50.362058 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:50.364806 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:09:50.376223 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:50.376342 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:50.376622 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:50.376817 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:50.377053 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:50.377274 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:09:50.597373 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:09:50.617138 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:50.620429 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:50.624409 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Stashing vm_state: active {{(pid=98289) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 27 23:09:50.641353 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:50.643224 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:50.668244 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:50.866940 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:09:50.867274 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923390.8670259, 044cb49c-ae45-4a08-ba7a-1717134060e0 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:50.867379 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] VM Paused (Lifecycle Event)
May 27 23:09:50.884028 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Took 7.10 seconds to spawn the instance on the hypervisor.
May 27 23:09:50.884405 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:50.949660 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9f87d810-17de-4531-8bbd-d75e0b76c0f7 req-4479bf2a-342f-4fd8-b432-2731e3fcb14b service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:50.949840 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f87d810-17de-4531-8bbd-d75e0b76c0f7 req-4479bf2a-342f-4fd8-b432-2731e3fcb14b service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:50.950051 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f87d810-17de-4531-8bbd-d75e0b76c0f7 req-4479bf2a-342f-4fd8-b432-2731e3fcb14b service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:50.950116 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f87d810-17de-4531-8bbd-d75e0b76c0f7 req-4479bf2a-342f-4fd8-b432-2731e3fcb14b service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:50.950281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9f87d810-17de-4531-8bbd-d75e0b76c0f7 req-4479bf2a-342f-4fd8-b432-2731e3fcb14b service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] No waiting events found dispatching network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:50.950484 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9f87d810-17de-4531-8bbd-d75e0b76c0f7 req-4479bf2a-342f-4fd8-b432-2731e3fcb14b service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:09:50.951998 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Instance destroyed successfully.
May 27 23:09:50.953438 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'resources' on Instance uuid 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:09:51.057204 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:51.083925 np0000001565 nova-compute[98289]: INFO nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating resource usage from migration 26318316-265f-414f-8f73-d5e906197906
May 27 23:09:51.145551 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:09:51.145869 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:09:51.145869 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance f6a3b268-ad24-445e-a58c-b1e35a289f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:09:51.145869 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 9caacf98-b127-48ed-ab3e-75fdb2776598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:09:51.146011 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 044cb49c-ae45-4a08-ba7a-1717134060e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:09:51.146011 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Migration 26318316-265f-414f-8f73-d5e906197906 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 27 23:09:51.146087 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance cae297ad-de9f-4adf-9e00-20b1f926df45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:09:51.146257 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:09:51.146394 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:09:50 up 38 min,  2 users,  load average: 6.19, 6.66, 4.27\n', 'num_instances': '6', 'num_vm_active': '5', 'num_task_deleting': '1', 'num_os_type_None': '6', 'num_proj_996f2d92ddf941fab9c407482cbb534e': '1', 'io_workload': '2', 'num_task_None': '3', 'num_proj_e077b44d61ee49ffbb4b474bd8b6711a': '2', 'num_proj_47cb500558784c258720ab29bf2d40fe': '2', 'num_task_resize_prep': '1', 'num_proj_8b69ef10bedf41b48b1455ae48aa534e': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:09:51.206347 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:51.322120 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-176a6894-2645-431c-9570-3bf200087ccf req-1d6da1c1-cee4-4e39-9f40-5efe1d03cc96 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Received event network-vif-plugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:51.322623 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-176a6894-2645-431c-9570-3bf200087ccf req-1d6da1c1-cee4-4e39-9f40-5efe1d03cc96 service nova] Acquiring lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:51.322830 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-176a6894-2645-431c-9570-3bf200087ccf req-1d6da1c1-cee4-4e39-9f40-5efe1d03cc96 service nova] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:51.323013 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-176a6894-2645-431c-9570-3bf200087ccf req-1d6da1c1-cee4-4e39-9f40-5efe1d03cc96 service nova] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:51.323180 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-176a6894-2645-431c-9570-3bf200087ccf req-1d6da1c1-cee4-4e39-9f40-5efe1d03cc96 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] No waiting events found dispatching network-vif-plugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:51.324052 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-176a6894-2645-431c-9570-3bf200087ccf req-1d6da1c1-cee4-4e39-9f40-5efe1d03cc96 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Received unexpected event network-vif-plugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d for instance with vm_state active and task_state None.
May 27 23:09:51.373253 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:51.375733 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923391.3754776, 044cb49c-ae45-4a08-ba7a-1717134060e0 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:51.375993 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] VM Resumed (Lifecycle Event)
May 27 23:09:51.406507 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Took 12.65 seconds to build instance.
May 27 23:09:51.456033 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-238721078',display_name='tempest-AttachVolumeTestJSON-server-238721078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-238721078',id=37,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Qq0763SlHFA9VpZwsMi86ZEUPb6ApCeF8QACBJQZv1Rp1P7LElgDkrzQ2GQCg/z1bU9PMQyrWIL6JBPLYXYJUrkv+/pKYLhHsqJZtKFBBSXjOqDTK9LJJtTBA4xSw+w==',key_name='tempest-keypair-2072419759',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:07:27Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-rnai6jvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:09:51.456305 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "address": "fa:16:3e:8a:26:c4", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda08a446-87", "ovs_interfaceid": "da08a446-879f-4bdd-9ac4-5d3d736fc30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:51.457183 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:51.457522 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:09:51.461741 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:51.462029 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda08a446-87, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:51.464076 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:51.465110 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:51.467587 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:51.468423 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:51.468585 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b82be2b4-9c9b-4625-8d10-6c5fd4672ba5) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:51.469093 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:51.469661 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:51.470194 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:51.473619 np0000001565 nova-compute[98289]: INFO os_vif [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:26:c4,bridge_name='br-int',has_traffic_filtering=True,id=da08a446-879f-4bdd-9ac4-5d3d736fc30b,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda08a446-87')
May 27 23:09:51.474303 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Deleting instance files /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6_del
May 27 23:09:51.475051 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Deletion of /opt/stack/data/nova/instances/4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6_del complete
May 27 23:09:51.593908 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:09:51.594091 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:09:51.827729 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:51.878606 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:51.881484 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:09:51.907704 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d4e7aa5b-50c2-4a13-b2ff-2eeaf2229309 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.164s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:51.980865 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 23:09:51.981400 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:09:51.981720 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:09:51.981849 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:09:51.982125 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:52.099350 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:09:52.219985 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:52.288725 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:52.384977 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99961144200006 future=<Future at 0x726e60440560 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:52.608872 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:09:52.609190 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.542s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:52.609653 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:09:52.609653 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.404s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:52.842178 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ff4db4c8-ba8f-4542-8958-15ed0f5074b4 req-fe4163ee-e1ea-467a-afd8-0ceaba73f8da service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-deleted-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:52.842382 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-ff4db4c8-ba8f-4542-8958-15ed0f5074b4 req-fe4163ee-e1ea-467a-afd8-0ceaba73f8da service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Neutron deleted interface da08a446-879f-4bdd-9ac4-5d3d736fc30b; detaching it from the instance and deleting it from the info cache
May 27 23:09:52.843918 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ff4db4c8-ba8f-4542-8958-15ed0f5074b4 req-fe4163ee-e1ea-467a-afd8-0ceaba73f8da service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Detach interface failed, port_id=da08a446-879f-4bdd-9ac4-5d3d736fc30b, reason: Instance 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:09:53.025635 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:53.027303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] Acquiring lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:53.027903 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:53.030982 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:53.031365 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] No waiting events found dispatching network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:09:53.031545 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Received event network-vif-unplugged-da08a446-879f-4bdd-9ac4-5d3d736fc30b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:09:53.032207 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Received event network-changed-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:09:53.032346 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Refreshing instance network info cache due to event network-changed-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:09:53.032723 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] Acquiring lock "refresh_cache-044cb49c-ae45-4a08-ba7a-1717134060e0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:09:53.033001 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] Acquired lock "refresh_cache-044cb49c-ae45-4a08-ba7a-1717134060e0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:09:53.033268 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Refreshing network info cache for port cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:09:53.115587 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:09:53.115730 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Claim successful on node np0000001565
May 27 23:09:53.293724 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:53.534867 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:53.620778 np0000001565 nova-compute[98289]: INFO nova.compute.resource_tracker [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating resource usage from migration 26318316-265f-414f-8f73-d5e906197906
May 27 23:09:53.765349 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:53.795834 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Took 1.81 seconds to deallocate network for instance.
May 27 23:09:53.923611 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:54.093823 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:09:54.094037 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:09:54.312398 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:09:54.540155 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Updated VIF entry in instance network info cache for port cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:09:54.540444 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Updating instance_info_cache with network_info: [{"id": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "address": "fa:16:3e:fe:c3:28", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2fe9c1-9f", "ovs_interfaceid": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:54.599945 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:09:54.670026 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:55.042418 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dbb4722a-a474-45cc-88bf-df33cb2e504b req-6f648fda-e533-4546-bdd3-d3f47e5a7080 service nova] Releasing lock "refresh_cache-044cb49c-ae45-4a08-ba7a-1717134060e0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:09:55.115986 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.506s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:55.116224 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Migrating
May 27 23:09:55.117026 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.804s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:09:55.117026 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:09:55.576612 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:09:55.576612 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:09:55.635646 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:09:55.635849 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquired lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:09:55.635949 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:09:56.079580 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:09:56.140386 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:56.469959 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:56.474050 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:09:56.588169 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.472s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:56.620720 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating instance_info_cache with network_info: [{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:09:56.666626 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Deleted allocations for instance 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6
May 27 23:09:56.898107 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.000515935000294121 future=<Future at 0x726e38642270 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:56.898735 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Emitting event <LifecycleEvent: 1779923381.8974593, d099633e-fe8f-425b-b486-3f325ce97d12 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:09:56.898980 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:56.899201 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] VM Stopped (Lifecycle Event)
May 27 23:09:56.899324 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.485261909999736 future=<Future at 0x726e60440560 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:56.900523 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.484065540999836 future=<Future at 0x726e60440560 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:57.122931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Releasing lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:09:57.403447 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: d099633e-fe8f-425b-b486-3f325ce97d12] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:09:57.514120 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:57.603611 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:09:57.603611 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:09:57.603611 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:09:57.604024 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:09:57.604024 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:09:57.604199 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:09:57.604378 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:09:57.604489 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:09:57.604734 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.52 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:09:57.672675 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-444d870e-dcec-4b5a-ba60-2c37b40c0fe2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.584s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:09:58.635402 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Starting migrate_disk_and_power_off {{(pid=98289) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 27 23:09:58.658644 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.682907 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.684624 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.716070 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.716928 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.767016 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.949591 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.982598 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999718448999829 future=<Future at 0x726e387c5cd0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:09:58.983675 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance destroyed successfully.
May 27 23:09:58.984856 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-952310270',display_name='tempest-TestEncryptedCinderVolumes-server-952310270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-952310270',id=42,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeBhqxE20M9Bm677ecVK4Bxso3Be10ZNZMOFKVGpzJiVLkzjgBf1GilnWj8FQLjvLgdCO1az9+IE11uvwD9zV3ZRW3erwfzlyCmPI79SXH2T2Xk/O7n070Zg7gHRisLaQ==',key_name='tempest-keypair-1714797866',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:08:54Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-z0h6rwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:09:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=cae297ad-de9f-4adf-9e00-20b1f926df45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "vif_mac": "fa:16:3e:5f:f9:a9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:09:58.985897 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "vif_mac": "fa:16:3e:5f:f9:a9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:09:58.987146 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:09:58.987146 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:09:58.988468 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.990081 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf03578e3-90, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:58.990081 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.990711 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:58.991818 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.993648 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.994109 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc765a40-5d0f-45ad-b4e4-755ac290b672) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:09:58.994494 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.996061 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:09:58.996061 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:09:58.998012 np0000001565 nova-compute[98289]: INFO os_vif [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90')
May 27 23:09:59.001698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:09:59.002104 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:09:59.002251 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:00.124665 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:10:00.125206 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:10:00.482975 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:00.482975 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:00.560833 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.558s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:00.561229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:10:00.561494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:10:00.588113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:00.588113 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:00.588113 np0000001565 nova-compute[98289]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:00.588113 np0000001565 nova-compute[98289]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:00.588113 np0000001565 nova-compute[98289]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100a437b-a7f2-4962-85bb-244c8c87bcc7 (non-flash)
May 27 23:10:00.588113 np0000001565 nova-compute[98289]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f756ea-5f2a-42ec-a34c-9a5f109f5662 (non-flash)
May 27 23:10:00.588113 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:00.588341 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:00.588341 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:00.588341 np0000001565 nova-compute[98289]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:00.588341 np0000001565 nova-compute[98289]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:00.588341 np0000001565 nova-compute[98289]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100a437b-a7f2-4962-85bb-244c8c87bcc7 (non-flash)
May 27 23:10:00.588341 np0000001565 nova-compute[98289]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f756ea-5f2a-42ec-a34c-9a5f109f5662 (non-flash)
May 27 23:10:00.588341 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:00.588523 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100a437b-a7f2-4962-85bb-244c8c87bcc7', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f756ea-5f2a-42ec-a34c-9a5f109f5662', '93')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:10:00.588668 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '90')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:10:00.589571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '91')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:10:00.590304 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e38708cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:10:00.590543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:10:00.590795 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flush multipath device 330000000b6712bdb {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:10:00.636920 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:10:00.683080 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:10:00.725743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:10:00.726350 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:10:00.727743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:10:00.743418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:10:00.743747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:10:00.757105 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:00.793166 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260]
May 27 23:10:00.793166 np0000001565 nova-compute[98289]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260] successful.
May 27 23:10:00.793166 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:00.809655 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:00.824017 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:00.860351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260]
May 27 23:10:00.860351 np0000001565 nova-compute[98289]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260] successful.
May 27 23:10:00.860351 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:00.875765 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:00.876586 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:00.876719 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== disconnect_volume: return (1874ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:00.876897 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:10:00.879278 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:00.967992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:00.968622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:00.987261 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:10:01.078234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:01.078668 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] skipping disk /dev/disk/by-id/os-brick+dev+dm-4 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:10:01.079288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45_resize/disk /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:01.176223 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "cp -r /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45_resize/disk /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk" returned: 0 in 0.097s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:01.176700 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45_resize/disk.config /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:01.226269 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "cp -r /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45_resize/disk.config /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config" returned: 0 in 0.049s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:01.226968 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45_resize/disk.info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.info {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:01.276180 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "cp -r /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45_resize/disk.info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.info" returned: 0 in 0.049s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:01.567088 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:01.567088 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:01.572428 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:10:01.572775 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Claim successful on node np0000001565
May 27 23:10:02.453279 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:02.453680 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:02.535844 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Port f03578e3-9014-4578-b259-d4577bb95e72 binding to destination host np0000001565 is already ACTIVE {{(pid=98289) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 23:10:02.975581 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:10:02.975991 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:10:03.053323 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5354c39b-a7d8-4127-b09e-d1594ebffb93 req-80295cf5-b0f8-4bb7-ae71-402abb2b1553 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:03.053824 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5354c39b-a7d8-4127-b09e-d1594ebffb93 req-80295cf5-b0f8-4bb7-ae71-402abb2b1553 service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:03.054002 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5354c39b-a7d8-4127-b09e-d1594ebffb93 req-80295cf5-b0f8-4bb7-ae71-402abb2b1553 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:03.054151 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5354c39b-a7d8-4127-b09e-d1594ebffb93 req-80295cf5-b0f8-4bb7-ae71-402abb2b1553 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:03.054358 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5354c39b-a7d8-4127-b09e-d1594ebffb93 req-80295cf5-b0f8-4bb7-ae71-402abb2b1553 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] No waiting events found dispatching network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:03.054722 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5354c39b-a7d8-4127-b09e-d1594ebffb93 req-80295cf5-b0f8-4bb7-ae71-402abb2b1553 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received unexpected event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 for instance with vm_state active and task_state resize_migrating.
May 27 23:10:03.481301 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:10:03.548855 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:10:03.584075 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:03.584291 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:03.584472 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:03.770492 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:03.988750 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.422s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:03.989145 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:10:04.003302 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:04.496816 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:10:04.498068 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:10:04.498068 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:04.498068 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:04.568985 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '946d9258fd0841dca06d0184677f7376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f2d92ddf941fab9c407482cbb534e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:10:04.590780 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:04.689765 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:04.689765 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquired lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:04.689765 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:10:04.999524 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:10:05.145504 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-805a5058-2050-44c8-a5ee-b48aaf22371b req-b47ee12d-001d-4bd2-aeb1-903112001304 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:05.145681 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-805a5058-2050-44c8-a5ee-b48aaf22371b req-b47ee12d-001d-4bd2-aeb1-903112001304 service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:05.145833 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-805a5058-2050-44c8-a5ee-b48aaf22371b req-b47ee12d-001d-4bd2-aeb1-903112001304 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:05.145942 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-805a5058-2050-44c8-a5ee-b48aaf22371b req-b47ee12d-001d-4bd2-aeb1-903112001304 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:05.146047 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-805a5058-2050-44c8-a5ee-b48aaf22371b req-b47ee12d-001d-4bd2-aeb1-903112001304 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] No waiting events found dispatching network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:05.146162 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-805a5058-2050-44c8-a5ee-b48aaf22371b req-b47ee12d-001d-4bd2-aeb1-903112001304 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received unexpected event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 for instance with vm_state active and task_state resize_migrated.
May 27 23:10:05.158486 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Successfully created port: 49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:10:05.194366 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:05.504144 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:10:05.522053 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:05.667707 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating instance_info_cache with network_info: [{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:05.767733 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Successfully updated port: 49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:10:05.824529 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e32c60cd-6971-48a2-8fa1-66f163df8d46 req-edab46bd-9c0d-4705-8045-f69cdf01538d service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Received event network-changed-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:05.824688 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e32c60cd-6971-48a2-8fa1-66f163df8d46 req-edab46bd-9c0d-4705-8045-f69cdf01538d service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Refreshing instance network info cache due to event network-changed-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:10:05.824838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e32c60cd-6971-48a2-8fa1-66f163df8d46 req-edab46bd-9c0d-4705-8045-f69cdf01538d service nova] Acquiring lock "refresh_cache-9e557941-9e16-4157-b760-d9eee26e39ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:05.824952 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e32c60cd-6971-48a2-8fa1-66f163df8d46 req-edab46bd-9c0d-4705-8045-f69cdf01538d service nova] Acquired lock "refresh_cache-9e557941-9e16-4157-b760-d9eee26e39ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:05.825069 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e32c60cd-6971-48a2-8fa1-66f163df8d46 req-edab46bd-9c0d-4705-8045-f69cdf01538d service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Refreshing network info cache for port 49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:10:06.170200 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Releasing lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:06.269670 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "refresh_cache-9e557941-9e16-4157-b760-d9eee26e39ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:06.328411 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-e32c60cd-6971-48a2-8fa1-66f163df8d46 req-edab46bd-9c0d-4705-8045-f69cdf01538d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:06.427272 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e32c60cd-6971-48a2-8fa1-66f163df8d46 req-edab46bd-9c0d-4705-8045-f69cdf01538d service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:10:06.523407 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:10:06.524369 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:10:06.524601 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Creating image(s)
May 27 23:10:06.525102 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:06.525248 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "/opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:06.525949 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "/opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:06.526700 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:06.530779 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:06.535800 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:06.620361 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e32c60cd-6971-48a2-8fa1-66f163df8d46 req-edab46bd-9c0d-4705-8045-f69cdf01538d service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:06.653477 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.118s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:06.653935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:06.655557 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:06.655557 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:06.657247 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:06.657786 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:06.690632 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:10:06.715974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:10:06.746842 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:06.794036 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:10:06.794281 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:10:06.805212 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:10:06.806499 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe48:f47', 'fe80::fc5d:41ff:fe1a:3ede', 'fe80::fc16:3eff:fe19:1372', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fe50:4ff1', 'fe80::fc16:3eff:fefe:c328'] 
May 27 23:10:06.810760 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:10:06.810900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:10:06.811236 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:06.817526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.158s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:06.818152 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:06.910749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk 1073741824" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:06.910945 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:06.911361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:07.020090 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.108s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:07.023349 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:10:07.023349 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:07.119113 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:07.119686 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Cannot resize image /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:10:07.120163 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:10:07.120438 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Ensure instance console log exists: /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:10:07.120813 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:07.121864 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e32c60cd-6971-48a2-8fa1-66f163df8d46 req-edab46bd-9c0d-4705-8045-f69cdf01538d service nova] Releasing lock "refresh_cache-9e557941-9e16-4157-b760-d9eee26e39ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:07.122490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:07.122648 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquired lock "refresh_cache-9e557941-9e16-4157-b760-d9eee26e39ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:07.122890 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:07.123013 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:10:07.385102 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00047567900037392974 future=<Future at 0x726e60440560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:07.385750 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] Emitting event <LifecycleEvent: 1779923392.3845074, 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:07.385906 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:07.386081 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] VM Stopped (Lifecycle Event)
May 27 23:10:07.386802 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.595495220999965 future=<Future at 0x726e387c5cd0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:07.387515 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=6.594767797999793 future=<Future at 0x726e387c5cd0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:07.707236 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:10:07.866112 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:07.889991 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5c5e2f97-5718-4a0b-8eee-2603930c794a tempest-VolumesActionsTest-1984000371 tempest-VolumesActionsTest-1984000371-project-member] [instance: 4c0a5ae8-23c2-47f4-8d2a-c18c9d4ef6c6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:08.009217 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Updating instance_info_cache with network_info: [{"id": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "address": "fa:16:3e:04:f5:be", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a75c3c-cd", "ovs_interfaceid": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:08.017312 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Starting finish_migration {{(pid=98289) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 27 23:10:08.018740 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance directory exists: not creating {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 23:10:08.018969 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Creating image(s)
May 27 23:10:08.019842 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:08.137657 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.118s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:08.138033 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:10:08.138673 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:08.252957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:08.254357 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Cannot resize image /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:10:08.511523 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Releasing lock "refresh_cache-9e557941-9e16-4157-b760-d9eee26e39ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:08.511955 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Instance network_info: |[{"id": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "address": "fa:16:3e:04:f5:be", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a75c3c-cd", "ovs_interfaceid": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:10:08.515552 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Start _get_guest_xml network_info=[{"id": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "address": "fa:16:3e:04:f5:be", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a75c3c-cd", "ovs_interfaceid": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:10:08.521546 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:10:08.522954 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-517241571', uuid='9e557941-9e16-4157-b760-d9eee26e39ec'), owner=OwnerMeta(userid='946d9258fd0841dca06d0184677f7376', username='tempest-AttachVolumeTestJSON-849627440-project-member', projectid='996f2d92ddf941fab9c407482cbb534e', projectname='tempest-AttachVolumeTestJSON-849627440'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "address": "fa:16:3e:04:f5:be", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a75c3c-cd", "ovs_interfaceid": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923408.5225925) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:10:08.523881 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:10:08.524226 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:10:08.525017 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:10:08.525183 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:10:08.526123 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:10:08.526421 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:10:08.526600 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:10:08.526721 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:10:08.526880 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:10:08.526999 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:10:08.527134 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:10:08.527375 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:10:08.527560 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:10:08.527736 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:10:08.527890 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:10:08.528067 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:10:08.538690 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-517241571',display_name='tempest-AttachVolumeTestJSON-server-517241571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-517241571',id=46,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu3Hy4n1Qe3drZc8BKjC3ofE4AAzB7ZsO2Mr8aOGpvFm8OD7BrAAXnFyNEf1eUeAZPTPOy/I74/GlMLq6IWAUfi75wTIC1Yq67Nta3lr5J6oUi23mt7H4t8iazoTJ9BEw==',key_name='tempest-keypair-1545727976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-7f8run0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=9e557941-9e16-4157-b760-d9eee26e39ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "address": "fa:16:3e:04:f5:be", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a75c3c-cd", "ovs_interfaceid": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:10:08.539119 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "address": "fa:16:3e:04:f5:be", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a75c3c-cd", "ovs_interfaceid": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:08.539808 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f5:be,bridge_name='br-int',has_traffic_filtering=True,id=49a75c3c-cddc-4e3a-a67f-2c443a3bebf4,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a75c3c-cd') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:08.540461 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e557941-9e16-4157-b760-d9eee26e39ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:08.754918 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:10:08.761802 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:10:08.761882 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Ensure instance console log exists: /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:10:08.762185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:08.762376 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:08.762501 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:08.764609 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Start _get_guest_xml network_info=[{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "vif_mac": "fa:16:3e:5f:f9:a9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3a4ae8ca-de7f-4a4a-9dce-c9f68349c317', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'cae297ad-de9f-4adf-9e00-20b1f926df45', 'attached_at': '2026-05-27T23:10:07.000000', 'detached_at': '', 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'serial': 'bd6a5488-3824-4767-9879-bfd2c7abef0e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:10:08.767119 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:10:08.767986 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-952310270', uuid='cae297ad-de9f-4adf-9e00-20b1f926df45'), owner=OwnerMeta(userid='1e15e4b45c874974b28db7f3448a3945', username='tempest-TestEncryptedCinderVolumes-762189049-project-member', projectid='8b69ef10bedf41b48b1455ae48aa534e', projectname='tempest-TestEncryptedCinderVolumes-762189049'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='tempest-1966209894', flavorid='5997ce0f-57b9-4d6d-a5f7-dab708a94dd0', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={}, swap=0), network_info=[{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "vif_mac": "fa:16:3e:5f:f9:a9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923408.76776) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:10:08.768802 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:10:08.769095 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:10:08.770815 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:08.772829 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:10:08.773042 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:10:08.773841 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:10:08.774441 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T23:09:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='5997ce0f-57b9-4d6d-a5f7-dab708a94dd0',id=13,is_public=True,memory_mb=192,name='tempest-1966209894',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:10:08.774606 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:10:08.774710 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:10:08.774893 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:10:08.774979 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:10:08.775068 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:10:08.775303 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:10:08.775422 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:10:08.775527 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:10:08.775655 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:10:08.775760 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:10:08.788658 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:09.012267 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:09.044352 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] End _get_guest_xml xml=<domain type="qemu">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <uuid>9e557941-9e16-4157-b760-d9eee26e39ec</uuid>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <name>instance-0000002e</name>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeTestJSON-server-517241571</nova:name>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:10:08</nova:creationTime>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:user uuid="946d9258fd0841dca06d0184677f7376">tempest-AttachVolumeTestJSON-849627440-project-member</nova:user>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:project uuid="996f2d92ddf941fab9c407482cbb534e">tempest-AttachVolumeTestJSON-849627440</nova:project>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         <nova:port uuid="49a75c3c-cddc-4e3a-a67f-2c443a3bebf4">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <system>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <entry name="serial">9e557941-9e16-4157-b760-d9eee26e39ec</entry>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <entry name="uuid">9e557941-9e16-4157-b760-d9eee26e39ec</entry>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     </system>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <os>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   </os>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <features>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   </features>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   <devices>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk.config"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:04:f5:be"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <target dev="tap49a75c3c-cd"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     </interface>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/console.log" append="off"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     </serial>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <video>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     </video>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     </rng>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:   </devices>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]: </domain>
May 27 23:10:09.044352 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:10:09.047651 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Preparing to wait for external event network-vif-plugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:10:09.047651 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:09.047651 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:09.047651 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:09.047651 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-517241571',display_name='tempest-AttachVolumeTestJSON-server-517241571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-517241571',id=46,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu3Hy4n1Qe3drZc8BKjC3ofE4AAzB7ZsO2Mr8aOGpvFm8OD7BrAAXnFyNEf1eUeAZPTPOy/I74/GlMLq6IWAUfi75wTIC1Yq67Nta3lr5J6oUi23mt7H4t8iazoTJ9BEw==',key_name='tempest-keypair-1545727976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-7f8run0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=9e557941-9e16-4157-b760-d9eee26e39ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "address": "fa:16:3e:04:f5:be", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a75c3c-cd", "ovs_interfaceid": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:10:09.047651 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "address": "fa:16:3e:04:f5:be", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a75c3c-cd", "ovs_interfaceid": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:09.047651 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f5:be,bridge_name='br-int',has_traffic_filtering=True,id=49a75c3c-cddc-4e3a-a67f-2c443a3bebf4,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a75c3c-cd') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:09.048282 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f5:be,bridge_name='br-int',has_traffic_filtering=True,id=49a75c3c-cddc-4e3a-a67f-2c443a3bebf4,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a75c3c-cd') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:10:09.049152 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:09.049856 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:09.050750 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:10:09.051261 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config --force-share --output=json" returned: 0 in 0.263s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:09.052518 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:09.053238 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:09.053413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:09.054235 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e3715e3-caba-5757-8d9c-7ac5df8e3b3e', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:09.054492 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:09.056256 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:10:09.056704 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:10:09.056862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:09.057698 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:09.058247 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:09.058369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:10:09.060121 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:09.065617 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:09.066345 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49a75c3c-cd, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:09.066678 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49a75c3c-cd, col_values=(('qos', UUID('ab9e8754-d1b2-4a8f-9632-04a53f011d45')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:09.066972 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49a75c3c-cd, col_values=(('external_ids', {'iface-id': '49a75c3c-cddc-4e3a-a67f-2c443a3bebf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:f5:be', 'vm-uuid': '9e557941-9e16-4157-b760-d9eee26e39ec'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:09.068500 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:09.070072 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:09.080255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:09.083768 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:09.084349 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:09.085949 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:09.086125 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:10:09.086593 np0000001565 nova-compute[98289]: INFO os_vif [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f5:be,bridge_name='br-int',has_traffic_filtering=True,id=49a75c3c-cddc-4e3a-a67f-2c443a3bebf4,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a75c3c-cd')
May 27 23:10:09.087828 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:09.088761 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:10:09.099416 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:10:09.099416 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:09.112102 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:10:09.112102 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:09.113065 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e] added
May 27 23:10:09.113065 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:10:09.113065 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:09.113065 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:09.113065 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:09.113065 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:09.113065 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:09.113351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:10:09.113416 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:10:09.113580 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:10:09.132381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e] added
May 27 23:10:09.132381 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:10:09.132381 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:09.132381 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:09.132381 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:09.132381 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:09.132381 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:09.132626 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:10:09.132839 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0446(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:10:09.133018 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:10:10.114100 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:10:10.126393 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:10:10.126393 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:10.133596 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:10:10.135266 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:10:10.144917 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:10:10.144917 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:10.151270 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.151270 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.151270 np0000001565 nova-compute[98289]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100a437b-a7f2-4962-85bb-244c8c87bcc7 (non-flash)
May 27 23:10:10.151270 np0000001565 nova-compute[98289]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f756ea-5f2a-42ec-a34c-9a5f109f5662 (non-flash)
May 27 23:10:10.151270 np0000001565 nova-compute[98289]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e1979cb-2eaf-41d6-9dee-72e4b8f5fe4b (non-flash)
May 27 23:10:10.151270 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:10.151462 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.151462 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.151462 np0000001565 nova-compute[98289]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100a437b-a7f2-4962-85bb-244c8c87bcc7 (non-flash)
May 27 23:10:10.151462 np0000001565 nova-compute[98289]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f756ea-5f2a-42ec-a34c-9a5f109f5662 (non-flash)
May 27 23:10:10.151462 np0000001565 nova-compute[98289]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e1979cb-2eaf-41d6-9dee-72e4b8f5fe4b (non-flash)
May 27 23:10:10.151462 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:10.156915 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:10.172008 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.172008 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.172008 np0000001565 nova-compute[98289]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100a437b-a7f2-4962-85bb-244c8c87bcc7 (non-flash)
May 27 23:10:10.172008 np0000001565 nova-compute[98289]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f756ea-5f2a-42ec-a34c-9a5f109f5662 (non-flash)
May 27 23:10:10.172008 np0000001565 nova-compute[98289]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e1979cb-2eaf-41d6-9dee-72e4b8f5fe4b (non-flash)
May 27 23:10:10.172008 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:10.172188 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.172188 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.172188 np0000001565 nova-compute[98289]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100a437b-a7f2-4962-85bb-244c8c87bcc7 (non-flash)
May 27 23:10:10.172188 np0000001565 nova-compute[98289]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f756ea-5f2a-42ec-a34c-9a5f109f5662 (non-flash)
May 27 23:10:10.172188 np0000001565 nova-compute[98289]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e1979cb-2eaf-41d6-9dee-72e4b8f5fe4b (non-flash)
May 27 23:10:10.172188 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:10.189047 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260]
May 27 23:10:10.189047 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260] successful.
May 27 23:10:10.189047 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:10.201908 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:10.217740 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260]
May 27 23:10:10.217740 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260] successful.
May 27 23:10:10.217740 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100a437b-a7f2-4962-85bb-244c8c87bcc7 (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f756ea-5f2a-42ec-a34c-9a5f109f5662 (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e1979cb-2eaf-41d6-9dee-72e4b8f5fe4b (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100a437b-a7f2-4962-85bb-244c8c87bcc7 (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f756ea-5f2a-42ec-a34c-9a5f109f5662 (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e1979cb-2eaf-41d6-9dee-72e4b8f5fe4b (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:10.224547 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:10.224923 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:10.224923 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:10:10.225676 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('12', '-', '-', 0) found on session 95 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:10:10.225783 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:10:10.232885 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:10.252643 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 95 and hctl ['12', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:10:10.255015 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.255015 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.255015 np0000001565 nova-compute[98289]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100a437b-a7f2-4962-85bb-244c8c87bcc7 (non-flash)
May 27 23:10:10.255015 np0000001565 nova-compute[98289]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f756ea-5f2a-42ec-a34c-9a5f109f5662 (non-flash)
May 27 23:10:10.255015 np0000001565 nova-compute[98289]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e1979cb-2eaf-41d6-9dee-72e4b8f5fe4b (non-flash)
May 27 23:10:10.255015 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:10.255015 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:10.255015 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:10.255237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.255237 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:10.255237 np0000001565 nova-compute[98289]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100a437b-a7f2-4962-85bb-244c8c87bcc7 (non-flash)
May 27 23:10:10.255237 np0000001565 nova-compute[98289]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f756ea-5f2a-42ec-a34c-9a5f109f5662 (non-flash)
May 27 23:10:10.255237 np0000001565 nova-compute[98289]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e1979cb-2eaf-41d6-9dee-72e4b8f5fe4b (non-flash)
May 27 23:10:10.255237 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:10.255237 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:10.255237 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:10.255495 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:10.255655 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:10:10.257113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('13', '-', '-', 0) found on session 96 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:10:10.257113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:10:10.278193 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 96 and hctl ['13', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:10:10.617102 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:10.617238 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:10.617346 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No VIF found with MAC fa:16:3e:04:f5:be, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:10:10.617785 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Using config drive
May 27 23:10:11.124570 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:11.240741 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Creating config drive at /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk.config
May 27 23:10:11.244230 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb4o75q21 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:11.257351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 95 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:10:11.257824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:10:11.278543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 96 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:10:11.278735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:10:11.292903 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb4o75q21" returned: 0 in 0.049s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:11.725813 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:11.749199 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:11.859606 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:11.912372 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3d7d81b0-cf1c-41a8-8df3-9a55e22308d1 req-9175462b-fbd6-4051-96f2-82c4701dce35 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Received event network-vif-plugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:11.912637 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3d7d81b0-cf1c-41a8-8df3-9a55e22308d1 req-9175462b-fbd6-4051-96f2-82c4701dce35 service nova] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:11.912873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3d7d81b0-cf1c-41a8-8df3-9a55e22308d1 req-9175462b-fbd6-4051-96f2-82c4701dce35 service nova] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:11.913038 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3d7d81b0-cf1c-41a8-8df3-9a55e22308d1 req-9175462b-fbd6-4051-96f2-82c4701dce35 service nova] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:11.913249 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3d7d81b0-cf1c-41a8-8df3-9a55e22308d1 req-9175462b-fbd6-4051-96f2-82c4701dce35 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Processing event network-vif-plugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:10:12.085862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:10:12.112007 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:12.118774 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:12.137309 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:12.532280 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:10:12.532669 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923412.5322757, 9e557941-9e16-4157-b760-d9eee26e39ec => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:12.532908 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] VM Started (Lifecycle Event)
May 27 23:10:12.534493 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:10:12.537612 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Instance spawned successfully.
May 27 23:10:12.537971 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:10:13.035858 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:13.037697 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:13.042616 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:13.042724 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:13.042981 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:13.043221 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:13.043514 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:13.043746 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:13.103770 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found WWN 330000000b6712bdb for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:10:13.104126 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.046s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:13.105025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== connect_volume: return (4048ms) {'type': 'block', 'scsi_wwn': '330000000b6712bdb', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b6712bdb'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:13.105516 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b6712bdb', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b6712bdb'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:10:13.134962 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'attaching', 'instance': 'cae297ad-de9f-4adf-9e00-20b1f926df45', 'attached_at': '2026-05-27T23:10:07.000000', 'detached_at': '', 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'serial': 'bd6a5488-3824-4767-9879-bfd2c7abef0e'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:10:13.136034 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:10:13.136247 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:10:13.136442 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:10:13.150768 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 23:10:13.150768 np0000001565 nova-compute[98289]:   <usage type="volume">
May 27 23:10:13.150768 np0000001565 nova-compute[98289]:     <volume>bd6a5488-3824-4767-9879-bfd2c7abef0e</volume>
May 27 23:10:13.150768 np0000001565 nova-compute[98289]:   </usage>
May 27 23:10:13.150768 np0000001565 nova-compute[98289]: </secret>
May 27 23:10:13.150768 np0000001565 nova-compute[98289]:  {{(pid=98289) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 23:10:13.542013 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:10:13.542218 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923413.5419805, 9e557941-9e16-4157-b760-d9eee26e39ec => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:13.542789 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] VM Paused (Lifecycle Event)
May 27 23:10:13.549046 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Took 7.03 seconds to spawn the instance on the hypervisor.
May 27 23:10:13.549216 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:13.658426 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-952310270',display_name='tempest-TestEncryptedCinderVolumes-server-952310270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-952310270',id=42,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeBhqxE20M9Bm677ecVK4Bxso3Be10ZNZMOFKVGpzJiVLkzjgBf1GilnWj8FQLjvLgdCO1az9+IE11uvwD9zV3ZRW3erwfzlyCmPI79SXH2T2Xk/O7n070Zg7gHRisLaQ==',key_name='tempest-keypair-1714797866',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:08:54Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-z0h6rwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=cae297ad-de9f-4adf-9e00-20b1f926df45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "vif_mac": "fa:16:3e:5f:f9:a9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:10:13.658693 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "vif_mac": "fa:16:3e:5f:f9:a9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:13.659517 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:13.662008 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] End _get_guest_xml xml=<domain type="qemu">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <uuid>cae297ad-de9f-4adf-9e00-20b1f926df45</uuid>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <name>instance-0000002a</name>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-952310270</nova:name>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:10:08</nova:creationTime>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <nova:flavor name="tempest-1966209894" id="5997ce0f-57b9-4d6d-a5f7-dab708a94dd0">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:extraSpecs/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:user uuid="1e15e4b45c874974b28db7f3448a3945">tempest-TestEncryptedCinderVolumes-762189049-project-member</nova:user>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:project uuid="8b69ef10bedf41b48b1455ae48aa534e">tempest-TestEncryptedCinderVolumes-762189049</nova:project>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <nova:port uuid="f03578e3-9014-4578-b259-d4577bb95e72">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <system>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <entry name="serial">cae297ad-de9f-4adf-9e00-20b1f926df45</entry>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <entry name="uuid">cae297ad-de9f-4adf-9e00-20b1f926df45</entry>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     </system>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <os>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   </os>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <features>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   </features>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   <devices>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <alias name="ua-bd6a5488-3824-4767-9879-bfd2c7abef0e"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <serial>bd6a5488-3824-4767-9879-bfd2c7abef0e</serial>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <encryption format="luks">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:         <secret type="passphrase" uuid="c9c7b878-aab6-4621-a756-4ae387200179"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       </encryption>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:5f:f9:a9"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <target dev="tapf03578e3-90"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     </interface>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/console.log" append="off"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     </serial>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <video>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     </video>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     </rng>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:   </devices>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]: </domain>
May 27 23:10:13.662008 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:10:13.666132 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-952310270',display_name='tempest-TestEncryptedCinderVolumes-server-952310270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-952310270',id=42,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeBhqxE20M9Bm677ecVK4Bxso3Be10ZNZMOFKVGpzJiVLkzjgBf1GilnWj8FQLjvLgdCO1az9+IE11uvwD9zV3ZRW3erwfzlyCmPI79SXH2T2Xk/O7n070Zg7gHRisLaQ==',key_name='tempest-keypair-1714797866',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:08:54Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-z0h6rwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=cae297ad-de9f-4adf-9e00-20b1f926df45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "vif_mac": "fa:16:3e:5f:f9:a9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:10:13.666132 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "vif_mac": "fa:16:3e:5f:f9:a9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:13.666132 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:13.666536 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:10:13.667600 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:13.667600 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:13.668110 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:10:13.668984 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:13.669199 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a573e56f-7106-5031-941e-84225418f961', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:13.670368 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:13.673316 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:13.675671 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:13.675802 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf03578e3-90, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:13.676128 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf03578e3-90, col_values=(('qos', UUID('33b78e93-a56c-475c-b1b8-dcbcabe23b23')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:13.676438 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf03578e3-90, col_values=(('external_ids', {'iface-id': 'f03578e3-9014-4578-b259-d4577bb95e72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:f9:a9', 'vm-uuid': 'cae297ad-de9f-4adf-9e00-20b1f926df45'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:13.677207 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:13.682602 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:13.684144 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:13.685051 np0000001565 nova-compute[98289]: INFO os_vif [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90')
May 27 23:10:13.774563 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:13.974146 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-077b8374-8d45-4cb0-b498-f6d609fe06d2 req-b0548d2d-6295-4b2d-8f6f-8b2700c4edb6 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Received event network-vif-plugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:13.974303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-077b8374-8d45-4cb0-b498-f6d609fe06d2 req-b0548d2d-6295-4b2d-8f6f-8b2700c4edb6 service nova] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:13.974468 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-077b8374-8d45-4cb0-b498-f6d609fe06d2 req-b0548d2d-6295-4b2d-8f6f-8b2700c4edb6 service nova] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:13.974605 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-077b8374-8d45-4cb0-b498-f6d609fe06d2 req-b0548d2d-6295-4b2d-8f6f-8b2700c4edb6 service nova] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:13.974729 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-077b8374-8d45-4cb0-b498-f6d609fe06d2 req-b0548d2d-6295-4b2d-8f6f-8b2700c4edb6 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] No waiting events found dispatching network-vif-plugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:13.974831 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-077b8374-8d45-4cb0-b498-f6d609fe06d2 req-b0548d2d-6295-4b2d-8f6f-8b2700c4edb6 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Received unexpected event network-vif-plugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 for instance with vm_state active and task_state None.
May 27 23:10:13.982853 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004474350002965366 future=<Future at 0x726e387c5cd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:13.984220 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Emitting event <LifecycleEvent: 1779923398.982219, cae297ad-de9f-4adf-9e00-20b1f926df45 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:13.984220 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] VM Stopped (Lifecycle Event)
May 27 23:10:13.984391 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:14.052287 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:14.057314 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923414.0569847, 9e557941-9e16-4157-b760-d9eee26e39ec => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:14.057396 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] VM Resumed (Lifecycle Event)
May 27 23:10:14.062704 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Took 12.57 seconds to build instance.
May 27 23:10:14.486071 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:14.491102 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:14.560261 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:14.561609 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:14.564201 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.082s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:14.993536 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-62b4adf7-f3eb-4922-bff6-3b56c6390c55 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 27 23:10:15.032434 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-788976f9-fd2f-45ae-ae73-90cfd6171aaa req-459522f7-a8f5-46d1-8c62-fca6f068788f service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Received event network-changed-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:15.032874 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-788976f9-fd2f-45ae-ae73-90cfd6171aaa req-459522f7-a8f5-46d1-8c62-fca6f068788f service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Refreshing instance network info cache due to event network-changed-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:10:15.033192 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-788976f9-fd2f-45ae-ae73-90cfd6171aaa req-459522f7-a8f5-46d1-8c62-fca6f068788f service nova] Acquiring lock "refresh_cache-9e557941-9e16-4157-b760-d9eee26e39ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:15.033445 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-788976f9-fd2f-45ae-ae73-90cfd6171aaa req-459522f7-a8f5-46d1-8c62-fca6f068788f service nova] Acquired lock "refresh_cache-9e557941-9e16-4157-b760-d9eee26e39ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:15.033513 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-788976f9-fd2f-45ae-ae73-90cfd6171aaa req-459522f7-a8f5-46d1-8c62-fca6f068788f service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Refreshing network info cache for port 49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:10:15.213873 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:15.213873 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:15.213873 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:15.213873 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] No VIF found with MAC fa:16:3e:5f:f9:a9, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:10:15.213873 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Using config drive
May 27 23:10:15.539253 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-788976f9-fd2f-45ae-ae73-90cfd6171aaa req-459522f7-a8f5-46d1-8c62-fca6f068788f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:15.664388 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:15.698953 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:15.702902 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:15.800231 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:15.982533 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-788976f9-fd2f-45ae-ae73-90cfd6171aaa req-459522f7-a8f5-46d1-8c62-fca6f068788f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:16.021646 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:16.067894 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:16.092053 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:16.186740 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-788976f9-fd2f-45ae-ae73-90cfd6171aaa req-459522f7-a8f5-46d1-8c62-fca6f068788f service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Updated VIF entry in instance network info cache for port 49a75c3c-cddc-4e3a-a67f-2c443a3bebf4. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:10:16.187736 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-788976f9-fd2f-45ae-ae73-90cfd6171aaa req-459522f7-a8f5-46d1-8c62-fca6f068788f service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Updating instance_info_cache with network_info: [{"id": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "address": "fa:16:3e:04:f5:be", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a75c3c-cd", "ovs_interfaceid": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:16.517580 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "9caacf98-b127-48ed-ab3e-75fdb2776598" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:16.517727 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:16.691228 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-788976f9-fd2f-45ae-ae73-90cfd6171aaa req-459522f7-a8f5-46d1-8c62-fca6f068788f service nova] Releasing lock "refresh_cache-9e557941-9e16-4157-b760-d9eee26e39ec" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:17.021004 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lazy-loading 'flavor' on Instance uuid 9caacf98-b127-48ed-ab3e-75fdb2776598 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:17.125658 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:17.125658 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:17.125961 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:17.125961 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:17.126088 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] No waiting events found dispatching network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:17.126174 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received unexpected event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 for instance with vm_state active and task_state resize_finish.
May 27 23:10:17.126307 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:17.126375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:17.126521 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:17.126622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:17.126797 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] No waiting events found dispatching network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:17.126797 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-a885a3b3-c8b2-437b-b1ef-f7c30a036414 req-a9fb65cc-3a5e-4ed4-b406-d9688ce42de8 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received unexpected event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 for instance with vm_state active and task_state resize_finish.
May 27 23:10:17.726480 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923417.7260633, cae297ad-de9f-4adf-9e00-20b1f926df45 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:17.726899 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance event wait completed in 0 seconds for  {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:10:17.727202 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] VM Resumed (Lifecycle Event)
May 27 23:10:17.730904 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance running successfully.
May 27 23:10:17.736137 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Failed to set time: agent not configured {{(pid=98289) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 27 23:10:17.736261 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-74ac68df-714e-4ef2-be81-5ca598ba1191 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] finish_migration finished successfully. {{(pid=98289) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 27 23:10:18.027384 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:18.230235 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:18.234386 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:18.678443 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:18.738468 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 27 23:10:18.738894 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923418.7385488, cae297ad-de9f-4adf-9e00-20b1f926df45 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:18.738974 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] VM Started (Lifecycle Event)
May 27 23:10:18.777707 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:19.110447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "9caacf98-b127-48ed-ab3e-75fdb2776598" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:19.110447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:19.110447 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Attaching volume 9fb3217e-6b7e-4623-a0e8-5a8b8d752541 to /dev/vdb
May 27 23:10:19.164881 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:10:19.182938 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:10:19.211414 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:19.244142 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:19.252235 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:19.259869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:10:19.261625 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:10:19.271425 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:10:19.272387 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe48:f47', 'fe80::fc5d:41ff:fe1a:3ede', 'fe80::fc16:3eff:fe19:1372', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fe50:4ff1', 'fe80::fc16:3eff:fefe:c328', 'fe80::fc16:3eff:fe04:f5be', 'fe80::70b0:20ff:fe1f:52b3', 'fe80::fc16:3eff:fe5f:f9a9', 'fe80::4cb6:a6ff:feaf:184a'] 
May 27 23:10:19.272387 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:10:19.272668 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:10:19.272986 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:19.273819 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Updating existing volume attachment record: 2b4321bd-a400-4976-bde9-7c4ea6dcfc51 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:10:19.846523 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:10:19.846523 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:10:19.846523 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:19.847095 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:19.847131 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:10:19.861002 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:19.862213 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:19.864142 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:19.864432 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:10:19.867704 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:19.867704 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:10:19.881543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:10:19.881543 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:19.891004 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:10:19.891004 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:19.897475 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:19.901650 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541] added
May 27 23:10:19.901650 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:10:19.901650 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:19.901650 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:19.901650 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:19.901650 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:19.901650 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:19.902028 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:10:19.902064 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:10:19.902251 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:10:19.909884 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541] added
May 27 23:10:19.909884 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:10:19.909884 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:19.909884 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:19.909884 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:19.909884 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:19.909884 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:19.910441 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:10:19.910441 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.045(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:10:19.910441 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:10:20.083596 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:20.084808 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:20.084808 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:20.197568 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Port f03578e3-9014-4578-b259-d4577bb95e72 binding to destination host np0000001565 is already ACTIVE {{(pid=98289) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 23:10:20.197841 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:20.197945 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquired lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:20.198200 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:10:20.701020 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:20.902808 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:10:20.910789 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:10:20.928066 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:10:20.928066 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:10:20.932559 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:10:20.932559 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:20.942557 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:20.948513 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:20.960171 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:20.960171 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:20.960171 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:20.960171 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:20.960171 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:20.960518 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:20.960518 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:20.960518 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:20.960518 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:20.960518 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:20.968734 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:20.968734 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:20.968734 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:20.968734 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:20.968734 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:20.969051 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:20.969051 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:20.969051 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:20.969051 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:20.969051 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:21.003886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541, portal: 192.168.50.100,3260]
May 27 23:10:21.003886 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541, portal: 192.168.50.100,3260] successful.
May 27 23:10:21.003886 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:21.018817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:21.032809 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541, portal: 192.168.40.100,3260]
May 27 23:10:21.032809 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541, portal: 192.168.40.100,3260] successful.
May 27 23:10:21.032809 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:21.039571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:21.039571 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:21.039571 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:21.039571 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:21.039571 np0000001565 nova-compute[98289]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:21.039571 np0000001565 nova-compute[98289]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:21.039571 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:21.039796 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:21.039796 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:21.039796 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:21.039796 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:21.039796 np0000001565 nova-compute[98289]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:21.039796 np0000001565 nova-compute[98289]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:21.039796 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:21.040047 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:21.040175 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:10:21.041160 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] HCTL ('7', '-', '-', 0) found on session 97 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:10:21.041264 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:10:21.050924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:21.076722 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:21.076722 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:21.076722 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:21.076722 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:21.076722 np0000001565 nova-compute[98289]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:21.076722 np0000001565 nova-compute[98289]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:21.076722 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:21.076934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:21.076934 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:21.076934 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:21.076934 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:21.076934 np0000001565 nova-compute[98289]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:21.076934 np0000001565 nova-compute[98289]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:21.076934 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:21.077456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:21.077456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:10:21.080361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] HCTL ('8', '-', '-', 0) found on session 98 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:10:21.080361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:10:21.080361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Searching for a device in session 97 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:10:21.080361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:10:21.107642 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Searching for a device in session 98 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:10:21.107642 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:10:21.123366 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:21.311025 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating instance_info_cache with network_info: [{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:21.813363 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:21.814071 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Releasing lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:21.863245 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:10:22.317138 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Creating tmpfile /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/tmpkidlxqbm to verify with other compute node that the instance is on the same shared storage. {{(pid=98289) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 27 23:10:22.317565 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:10:22.859224 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:22.862388 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:22.886715 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:22.887231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Found WWN 330000000bf9e2aea for multipath device dm-2 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:10:22.887589 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:22.887780 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000bf9e2aea', 'path': '/dev/dm-2', 'multipath_id': '330000000bf9e2aea'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:22.887963 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bf9e2aea', 'path': '/dev/dm-2', 'multipath_id': '330000000bf9e2aea'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:10:22.899195 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lazy-loading 'flavor' on Instance uuid 9caacf98-b127-48ed-ab3e-75fdb2776598 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:22.917379 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:23.066016 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-27ff1355-1b9b-4b80-a09c-d8e0dacec80f req-f1a1085d-f7ff-412e-bee3-4ccade7d9267 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:23.069790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-27ff1355-1b9b-4b80-a09c-d8e0dacec80f req-f1a1085d-f7ff-412e-bee3-4ccade7d9267 service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:23.069790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-27ff1355-1b9b-4b80-a09c-d8e0dacec80f req-f1a1085d-f7ff-412e-bee3-4ccade7d9267 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:23.071386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-27ff1355-1b9b-4b80-a09c-d8e0dacec80f req-f1a1085d-f7ff-412e-bee3-4ccade7d9267 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:23.071534 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-27ff1355-1b9b-4b80-a09c-d8e0dacec80f req-f1a1085d-f7ff-412e-bee3-4ccade7d9267 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] No waiting events found dispatching network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:23.071707 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-27ff1355-1b9b-4b80-a09c-d8e0dacec80f req-f1a1085d-f7ff-412e-bee3-4ccade7d9267 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received unexpected event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 for instance with vm_state resized and task_state resize_reverting.
May 27 23:10:23.177999 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999694756999816 future=<Future at 0x726e602ae990 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:23.180548 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.997145386999819 future=<Future at 0x726e602ae990 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:23.180981 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.996929750000163 future=<Future at 0x726e602ae990 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:23.183443 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance destroyed successfully.
May 27 23:10:23.184020 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'resources' on Instance uuid cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:23.401896 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Attempting to attach volume 9fb3217e-6b7e-4623-a0e8-5a8b8d752541 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:10:23.403130 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:10:23.403130 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:10:23.403130 np0000001565 nova-compute[98289]:   <alias name="ua-9fb3217e-6b7e-4623-a0e8-5a8b8d752541"/>
May 27 23:10:23.403130 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:10:23.403130 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:10:23.403130 np0000001565 nova-compute[98289]:   <serial>9fb3217e-6b7e-4623-a0e8-5a8b8d752541</serial>
May 27 23:10:23.403130 np0000001565 nova-compute[98289]: </disk>
May 27 23:10:23.403130 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:10:23.530406 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:23.679599 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:23.686518 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-952310270',display_name='tempest-TestEncryptedCinderVolumes-server-952310270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-952310270',id=42,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeBhqxE20M9Bm677ecVK4Bxso3Be10ZNZMOFKVGpzJiVLkzjgBf1GilnWj8FQLjvLgdCO1az9+IE11uvwD9zV3ZRW3erwfzlyCmPI79SXH2T2Xk/O7n070Zg7gHRisLaQ==',key_name='tempest-keypair-1714797866',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:10:18Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=Flavor(13),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-z0h6rwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:10:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=cae297ad-de9f-4adf-9e00-20b1f926df45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:10:23.686748 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:23.687411 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:23.687711 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:10:23.688943 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:23.689147 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf03578e3-90, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:23.691282 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:23.692143 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:23.693698 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:23.693698 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33b78e93-a56c-475c-b1b8-dcbcabe23b23) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:23.693906 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:23.695008 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:23.698625 np0000001565 nova-compute[98289]: INFO os_vif [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90')
May 27 23:10:23.701674 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:10:23.702080 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:10:23.702289 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:23.702775 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:23.703181 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:10:23.703392 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:10:23.734174 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:23.734174 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:23.734174 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:23.734174 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:23.734174 np0000001565 nova-compute[98289]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:23.734174 np0000001565 nova-compute[98289]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:23.734174 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:23.734473 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:23.734473 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:23.734473 np0000001565 nova-compute[98289]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:23.734473 np0000001565 nova-compute[98289]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:23.734473 np0000001565 nova-compute[98289]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:23.734473 np0000001565 nova-compute[98289]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:23.734473 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:23.734473 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', '98')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:10:23.734680 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '95')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:10:23.735557 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '96')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:10:23.736425 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e386142c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'): ({'sdh'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:10:23.736657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Removing multipathed devices sdh, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:10:23.736906 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flush multipath device 330000000b6712bdb {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:10:23.776643 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:10:23.778003 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:23.823925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:10:23.880587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:10:23.880587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:10:23.881431 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:10:23.899796 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:10:23.900122 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:10:23.915553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:23.955534 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260]
May 27 23:10:23.955534 np0000001565 nova-compute[98289]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260] successful.
May 27 23:10:23.955534 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:23.971792 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:23.985564 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:24.019611 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260]
May 27 23:10:24.019611 np0000001565 nova-compute[98289]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260] successful.
May 27 23:10:24.019611 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:24.040192 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:24.047548 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:24.047548 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== disconnect_volume: return (341ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:24.047548 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:10:25.080722 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:25.081054 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:25.081054 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:25.081054 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] No VIF found with MAC fa:16:3e:50:4f:f1, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:10:25.179705 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8cb0b999-ed90-4f05-98fc-a85464d9b746 req-daadae41-4622-4389-97ac-31aac82be61a service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:25.181350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8cb0b999-ed90-4f05-98fc-a85464d9b746 req-daadae41-4622-4389-97ac-31aac82be61a service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:25.181350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8cb0b999-ed90-4f05-98fc-a85464d9b746 req-daadae41-4622-4389-97ac-31aac82be61a service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:25.181350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8cb0b999-ed90-4f05-98fc-a85464d9b746 req-daadae41-4622-4389-97ac-31aac82be61a service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:25.181350 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8cb0b999-ed90-4f05-98fc-a85464d9b746 req-daadae41-4622-4389-97ac-31aac82be61a service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] No waiting events found dispatching network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:25.181350 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-8cb0b999-ed90-4f05-98fc-a85464d9b746 req-daadae41-4622-4389-97ac-31aac82be61a service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received unexpected event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 for instance with vm_state resized and task_state resize_reverting.
May 27 23:10:25.202658 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:25.202824 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:25.706718 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'migration_context' on Instance uuid cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:26.098953 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:26.100608 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "adac29fa-1144-4721-9ab5-0901535cd08e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:26.100876 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:26.210405 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Object Instance<cae297ad-de9f-4adf-9e00-20b1f926df45> lazy-loaded attributes: resources,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:10:26.602835 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:10:26.617355 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:10:26.617617 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:10:26.641525 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c28ad725-dbe6-4002-8eeb-3fc24db2413a tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.534s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:27.120490 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:10:27.163708 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:28.132861 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 2.930s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:28.134120 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.970s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:28.134120 np0000001565 nova-compute[98289]: DEBUG nova.compute.rpcapi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98289) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 23:10:28.143675 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:10:28.145149 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Claim successful on node np0000001565
May 27 23:10:28.382673 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:28.705070 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:28.779916 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:29.534823 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "9caacf98-b127-48ed-ab3e-75fdb2776598" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:29.535295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:29.568715 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "044cb49c-ae45-4a08-ba7a-1717134060e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:29.568971 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:29.569228 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:29.569442 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:29.569618 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:29.571838 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Terminating instance
May 27 23:10:29.608109 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:10:29.608402 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:10:29.712963 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Swapping old allocation on dict_keys(['6afc4609-00ff-4946-93f6-3f759c4c1e43']) held by migration 26318316-265f-414f-8f73-d5e906197906 for instance
May 27 23:10:29.802469 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Overwriting current allocation {'allocations': {'6afc4609-00ff-4946-93f6-3f759c4c1e43': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 66}}, 'project_id': '8b69ef10bedf41b48b1455ae48aa534e', 'user_id': '1e15e4b45c874974b28db7f3448a3945', 'consumer_generation': 1} on consumer cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 27 23:10:29.931470 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:30.037293 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Detaching volume 9fb3217e-6b7e-4623-a0e8-5a8b8d752541
May 27 23:10:30.075401 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:10:30.092399 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Attempting to driver detach volume 9fb3217e-6b7e-4623-a0e8-5a8b8d752541 from mountpoint /dev/vdb
May 27 23:10:30.092925 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.095812 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.102605 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Found disk vdb by alias ua-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:10:30.106014 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Found disk vdb by alias ua-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:10:30.106185 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Attempting to detach device vdb from instance 9caacf98-b127-48ed-ab3e-75fdb2776598 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:10:30.106533 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:10:30.106533 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:10:30.106533 np0000001565 nova-compute[98289]:   <alias name="ua-9fb3217e-6b7e-4623-a0e8-5a8b8d752541"/>
May 27 23:10:30.106533 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:10:30.106533 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:10:30.106533 np0000001565 nova-compute[98289]:   <serial>9fb3217e-6b7e-4623-a0e8-5a8b8d752541</serial>
May 27 23:10:30.106533 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:10:30.106533 np0000001565 nova-compute[98289]: </disk>
May 27 23:10:30.106533 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:10:30.111311 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:10:30.123308 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.130029 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Successfully detached device vdb from instance 9caacf98-b127-48ed-ab3e-75fdb2776598 from the persistent domain config.
May 27 23:10:30.130528 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] (1/8): Attempting to detach device vdb with device alias ua-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 from instance 9caacf98-b127-48ed-ab3e-75fdb2776598 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:10:30.130819 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:10:30.130819 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:10:30.130819 np0000001565 nova-compute[98289]:   <alias name="ua-9fb3217e-6b7e-4623-a0e8-5a8b8d752541"/>
May 27 23:10:30.130819 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:10:30.130819 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:10:30.130819 np0000001565 nova-compute[98289]:   <serial>9fb3217e-6b7e-4623-a0e8-5a8b8d752541</serial>
May 27 23:10:30.130819 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:10:30.130819 np0000001565 nova-compute[98289]: </disk>
May 27 23:10:30.130819 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:10:30.209877 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:30.210005 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquired lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:30.210194 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:10:30.280239 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.286727 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.299154 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5afff2db-7bdd-40b4-9bcc-8a2e1108cdf9 req-15c6b3ee-3e27-4454-8854-a9882706e5dd service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Received event network-vif-unplugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:30.299507 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5afff2db-7bdd-40b4-9bcc-8a2e1108cdf9 req-15c6b3ee-3e27-4454-8854-a9882706e5dd service nova] Acquiring lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:30.299682 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5afff2db-7bdd-40b4-9bcc-8a2e1108cdf9 req-15c6b3ee-3e27-4454-8854-a9882706e5dd service nova] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:30.299803 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5afff2db-7bdd-40b4-9bcc-8a2e1108cdf9 req-15c6b3ee-3e27-4454-8854-a9882706e5dd service nova] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:30.299932 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5afff2db-7bdd-40b4-9bcc-8a2e1108cdf9 req-15c6b3ee-3e27-4454-8854-a9882706e5dd service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] No waiting events found dispatching network-vif-unplugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:30.300047 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5afff2db-7bdd-40b4-9bcc-8a2e1108cdf9 req-15c6b3ee-3e27-4454-8854-a9882706e5dd service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Received event network-vif-unplugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:10:30.382281 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.387919 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.406962 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999747894999928 future=<Future at 0x726e38640a40 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:30.409529 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Instance destroyed successfully.
May 27 23:10:30.409983 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'resources' on Instance uuid 044cb49c-ae45-4a08-ba7a-1717134060e0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:30.625015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.492s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:30.625616 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:10:30.643136 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923430.6427157, 9caacf98-b127-48ed-ab3e-75fdb2776598 => ua-9fb3217e-6b7e-4623-a0e8-5a8b8d752541> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:10:30.644922 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 for instance 9caacf98-b127-48ed-ab3e-75fdb2776598 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:10:30.647479 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Successfully detached device vdb from instance 9caacf98-b127-48ed-ab3e-75fdb2776598 from the live domain config.
May 27 23:10:30.650056 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:10:30.650185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:10:30.650390 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:30.650807 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:30.650962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:10:30.651196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:10:30.674038 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:30.674038 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:30.674038 np0000001565 nova-compute[98289]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:30.674038 np0000001565 nova-compute[98289]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:30.674038 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:30.675048 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:30.675048 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:30.675048 np0000001565 nova-compute[98289]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:30.675048 np0000001565 nova-compute[98289]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541 (non-flash)
May 27 23:10:30.675048 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:30.675048 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', '98')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:10:30.675048 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', '98')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:10:30.677373 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541', '97')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:10:30.677569 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e5874f4c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541'): ({'sdb'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:10:30.677750 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:10:30.678033 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Flush multipath device 330000000bf9e2aea {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:10:30.712502 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:30.714661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:10:30.747796 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:10:30.784687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:10:30.784873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:10:30.785841 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:10:30.797945 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:10:30.798214 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:10:30.810002 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:30.843814 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541, portal: 192.168.40.100,3260]
May 27 23:10:30.843814 np0000001565 nova-compute[98289]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541, portal: 192.168.40.100,3260] successful.
May 27 23:10:30.843814 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:30.860313 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:30.875584 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:30.901892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541, portal: 192.168.50.100,3260]
May 27 23:10:30.901892 np0000001565 nova-compute[98289]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-9fb3217e-6b7e-4623-a0e8-5a8b8d752541, portal: 192.168.50.100,3260] successful.
May 27 23:10:30.901892 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:30.913457 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:30.913687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:30.913817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] <== disconnect_volume: return (263ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:30.913937 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:10:30.914779 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:09:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1924512814',display_name='tempest-AttachVolumeNegativeTest-server-1924512814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1924512814',id=45,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7MYxHK9bvKyiK45ctALWAPnewKm0DoI7oO91eBhGaHtsIP0fIh79csgs3abeYg38Xd3KWUn/gkBikCtt6kZE2XuPBcM7Nng2TnktmqE/S+KJiY8tTep4ZrLrnT4WhYBA==',key_name='tempest-keypair-687440916',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:09:50Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-zk71122m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:09:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=044cb49c-ae45-4a08-ba7a-1717134060e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "address": "fa:16:3e:fe:c3:28", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2fe9c1-9f", "ovs_interfaceid": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:10:30.916751 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "address": "fa:16:3e:fe:c3:28", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2fe9c1-9f", "ovs_interfaceid": "cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:30.919665 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:c3:28,bridge_name='br-int',has_traffic_filtering=True,id=cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2fe9c1-9f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:30.919976 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:c3:28,bridge_name='br-int',has_traffic_filtering=True,id=cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2fe9c1-9f') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:10:30.920992 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.921212 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf2fe9c1-9f, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:30.932077 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.933242 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:30.933242 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.933733 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.933868 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a2368ec-9d32-42d9-acce-98cb102b0871) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:30.934264 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.934684 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:30.935011 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:30.936353 np0000001565 nova-compute[98289]: INFO os_vif [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:c3:28,bridge_name='br-int',has_traffic_filtering=True,id=cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2fe9c1-9f')
May 27 23:10:30.936617 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Deleting instance files /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0_del
May 27 23:10:30.937280 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Deletion of /opt/stack/data/nova/instances/044cb49c-ae45-4a08-ba7a-1717134060e0_del complete
May 27 23:10:31.019482 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:31.135275 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:10:31.135275 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:10:31.135275 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:31.135275 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:31.158316 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating instance_info_cache with network_info: [{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:31.203725 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12335b63d21044a6bc1d970ab66c8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eceb76118ffc41a281af4ce737b19b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:10:31.290771 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:31.443040 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Took 1.37 seconds to destroy the instance on the hypervisor.
May 27 23:10:31.444065 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:10:31.444438 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:10:31.444594 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:10:31.444769 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:31.480688 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lazy-loading 'flavor' on Instance uuid 9caacf98-b127-48ed-ab3e-75fdb2776598 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:31.549551 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:31.636635 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:10:31.660345 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Releasing lock "refresh_cache-cae297ad-de9f-4adf-9e00-20b1f926df45" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:31.660622 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:10:31.671748 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:10:31.694415 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:31.753263 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:10:31.753502 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:10:31.761660 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:10:31.762752 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe48:f47', 'fe80::fc5d:41ff:fe1a:3ede', 'fe80::fc16:3eff:fe19:1372', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fe50:4ff1', 'fe80::fc16:3eff:fe04:f5be', 'fe80::70b0:20ff:fe1f:52b3'] 
May 27 23:10:31.762882 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:10:31.762993 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:10:31.763351 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:31.994055 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Successfully created port: 9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:10:32.057217 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e6c60a16-eec8-4f70-93b2-bf92e96803c3 req-4b1be00f-f562-4150-9fe0-7d67c9234494 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Received event network-vif-deleted-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:32.057489 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-e6c60a16-eec8-4f70-93b2-bf92e96803c3 req-4b1be00f-f562-4150-9fe0-7d67c9234494 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Neutron deleted interface cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d; detaching it from the instance and deleting it from the info cache
May 27 23:10:32.062210 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e6c60a16-eec8-4f70-93b2-bf92e96803c3 req-4b1be00f-f562-4150-9fe0-7d67c9234494 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Detach interface failed, port_id=cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d, reason: Instance 044cb49c-ae45-4a08-ba7a-1717134060e0 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:10:32.140062 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:10:32.376882 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ea1b1e74-13fc-42ac-8448-d21a947f1517 req-63845833-9597-47fa-913a-9665d3547d93 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Received event network-vif-unplugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:32.377260 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ea1b1e74-13fc-42ac-8448-d21a947f1517 req-63845833-9597-47fa-913a-9665d3547d93 service nova] Acquiring lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:32.378346 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ea1b1e74-13fc-42ac-8448-d21a947f1517 req-63845833-9597-47fa-913a-9665d3547d93 service nova] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:32.378448 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ea1b1e74-13fc-42ac-8448-d21a947f1517 req-63845833-9597-47fa-913a-9665d3547d93 service nova] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:32.378572 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ea1b1e74-13fc-42ac-8448-d21a947f1517 req-63845833-9597-47fa-913a-9665d3547d93 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] No waiting events found dispatching network-vif-unplugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:32.378697 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ea1b1e74-13fc-42ac-8448-d21a947f1517 req-63845833-9597-47fa-913a-9665d3547d93 service nova] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Received event network-vif-unplugged-cf2fe9c1-9faa-4729-8d0b-c8bc35c7af6d for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:10:32.479142 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:32.497563 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fcbd08c4-8239-4878-9191-d3a9af40860c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.962s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:32.510758 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Successfully updated port: 9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:10:32.803262 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:32.872050 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Starting finish_revert_migration {{(pid=98289) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 27 23:10:32.884062 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Start _get_guest_xml network_info=[{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '126e4bec-e145-4524-99bc-f023c86e035a', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'cae297ad-de9f-4adf-9e00-20b1f926df45', 'attached_at': '2026-05-27T23:10:32.000000', 'detached_at': '', 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'serial': 'bd6a5488-3824-4767-9879-bfd2c7abef0e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:10:32.886087 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:10:32.887201 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-952310270', uuid='cae297ad-de9f-4adf-9e00-20b1f926df45'), owner=OwnerMeta(userid='1e15e4b45c874974b28db7f3448a3945', username='tempest-TestEncryptedCinderVolumes-762189049-project-member', projectid='8b69ef10bedf41b48b1455ae48aa534e', projectname='tempest-TestEncryptedCinderVolumes-762189049'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923432.8868537) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:10:32.888086 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:10:32.888549 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:10:32.889240 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:10:32.889448 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:10:32.890462 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:10:32.890720 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:10:32.894518 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:10:32.894518 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:10:32.894518 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:10:32.894518 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:10:32.894518 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:10:32.894518 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:10:32.894518 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:10:32.894518 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:10:32.894518 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:10:32.894518 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:10:32.894916 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'vcpu_model' on Instance uuid cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:32.981005 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Took 1.54 seconds to deallocate network for instance.
May 27 23:10:33.013200 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "refresh_cache-adac29fa-1144-4721-9ab5-0901535cd08e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:33.013300 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquired lock "refresh_cache-adac29fa-1144-4721-9ab5-0901535cd08e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:33.013697 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:10:33.149879 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:10:33.150922 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:10:33.151025 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Creating image(s)
May 27 23:10:33.151743 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "/opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:33.151743 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "/opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:33.152286 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "/opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:33.152771 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:33.156722 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:33.157686 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:33.223874 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:33.224095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:33.241581 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:33.241947 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:33.242404 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:33.242902 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:33.246320 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:33.246713 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:33.330695 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:33.331414 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:33.381450 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk 1073741824" returned: 0 in 0.050s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:33.382138 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.140s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:33.382369 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:33.414236 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:33.457350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "9caacf98-b127-48ed-ab3e-75fdb2776598" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:33.457783 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:33.458139 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:33.458341 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:33.459814 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:33.463974 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Terminating instance
May 27 23:10:33.473030 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.091s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:33.473846 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:10:33.473846 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:33.499677 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:33.500046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:33.517981 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config --force-share --output=json" returned: 0 in 0.104s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:33.518495 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:33.518688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:33.519586 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:33.520093 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:10:33.520688 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:10:33.520845 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:33.521340 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:33.521589 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:10:33.533158 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:33.533666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:33.533850 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:10:33.534573 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:33.535062 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:33.535305 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:10:33.546236 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:10:33.546236 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:33.549496 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:10:33.549496 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:33.557352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e] added
May 27 23:10:33.557352 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:10:33.557352 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:33.557352 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:33.557352 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:33.557352 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:33.557352 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:33.557352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:10:33.557352 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0233(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:10:33.557352 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:10:33.562824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e] added
May 27 23:10:33.562824 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:10:33.562824 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:33.562824 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:33.562824 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:33.562824 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:33.562824 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:33.563018 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:10:33.563107 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0278(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:10:33.563246 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:10:33.568793 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:33.569173 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Cannot resize image /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:10:33.569670 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:10:33.569887 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Ensure instance console log exists: /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:10:33.570212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:33.570465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:33.570669 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:33.588646 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:10:33.726693 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:10:33.743663 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:33.781286 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:33.902428 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Updating instance_info_cache with network_info: [{"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:33.954373 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:10:33.954620 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:10:33.968533 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:10:33.984634 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:33.988643 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.011621 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.119681 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-364ad0a7-748b-49d0-a612-e38e23c6579d req-c92ab0f7-258d-437b-b0f4-9f82c04bc451 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Received event network-changed-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:34.119871 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-364ad0a7-748b-49d0-a612-e38e23c6579d req-c92ab0f7-258d-437b-b0f4-9f82c04bc451 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Refreshing instance network info cache due to event network-changed-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:10:34.120046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-364ad0a7-748b-49d0-a612-e38e23c6579d req-c92ab0f7-258d-437b-b0f4-9f82c04bc451 service nova] Acquiring lock "refresh_cache-adac29fa-1144-4721-9ab5-0901535cd08e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:34.161286 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.166444 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.265976 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.280017 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:34.293661 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99958965299993 future=<Future at 0x726e601ea090 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:34.295326 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.298986 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Instance destroyed successfully.
May 27 23:10:34.299471 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lazy-loading 'resources' on Instance uuid 9caacf98-b127-48ed-ab3e-75fdb2776598 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:34.404341 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Releasing lock "refresh_cache-adac29fa-1144-4721-9ab5-0901535cd08e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:34.404545 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Instance network_info: |[{"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:10:34.406190 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Start _get_guest_xml network_info=[{"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:10:34.406504 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-364ad0a7-748b-49d0-a612-e38e23c6579d req-c92ab0f7-258d-437b-b0f4-9f82c04bc451 service nova] Acquired lock "refresh_cache-adac29fa-1144-4721-9ab5-0901535cd08e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:34.406736 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-364ad0a7-748b-49d0-a612-e38e23c6579d req-c92ab0f7-258d-437b-b0f4-9f82c04bc451 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Refreshing network info cache for port 9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:10:34.409306 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:10:34.410407 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1949104133', uuid='adac29fa-1144-4721-9ab5-0901535cd08e'), owner=OwnerMeta(userid='12335b63d21044a6bc1d970ab66c8292', username='tempest-VolumesSnapshotTestJSON-1830020059-project-member', projectid='eceb76118ffc41a281af4ce737b19b88', projectname='tempest-VolumesSnapshotTestJSON-1830020059'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923434.410098) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:10:34.411627 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:10:34.411942 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:10:34.412868 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:10:34.413003 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:10:34.413800 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:10:34.414470 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:10:34.414470 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:10:34.414682 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:10:34.414682 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:10:34.414790 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:10:34.415069 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.415675 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:10:34.415843 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:10:34.415950 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:10:34.416261 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:10:34.416635 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:10:34.416782 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:10:34.424451 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.428286 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1949104133',display_name='tempest-VolumesSnapshotTestJSON-instance-1949104133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumessnapshottestjson-instance-1949104133',id=47,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPFgEp4HYwdrGNENA6wGmAi1NAhzBRZbmBEbMVYXxfDsIeW8f8EHNjhHW8ekGSh4VC4Um5c5jX/hEgn6XetnX7LaP/fZJqYtsTsLr4cJld3F3njNYflidHK4wpzpe28HQ==',key_name='tempest-keypair-1154421445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eceb76118ffc41a281af4ce737b19b88',ramdisk_id='',reservation_id='r-y94td6xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1830020059',owner_user_name='tempest-VolumesSnapshotTestJSON-1830020059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12335b63d21044a6bc1d970ab66c8292',uuid=adac29fa-1144-4721-9ab5-0901535cd08e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:10:34.428477 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converting VIF {"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:34.429000 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:5e:ff,bridge_name='br-int',has_traffic_filtering=True,id=9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc2b2cb-ab') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:34.429531 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lazy-loading 'pci_devices' on Instance uuid adac29fa-1144-4721-9ab5-0901535cd08e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:34.458285 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:10:34.557821 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:10:34.563713 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:10:34.572993 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:10:34.572993 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:34.584547 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4733dd39-ccdd-424f-906e-141dd7c691a9 req-4059d0f9-6c20-49cb-952d-dd4fb0103d17 service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Received event network-changed-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:34.586531 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4733dd39-ccdd-424f-906e-141dd7c691a9 req-4059d0f9-6c20-49cb-952d-dd4fb0103d17 service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Refreshing instance network info cache due to event network-changed-86ad7902-8e2c-46df-abf0-8c14e0f72ce8. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:10:34.587097 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4733dd39-ccdd-424f-906e-141dd7c691a9 req-4059d0f9-6c20-49cb-952d-dd4fb0103d17 service nova] Acquiring lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:34.587097 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4733dd39-ccdd-424f-906e-141dd7c691a9 req-4059d0f9-6c20-49cb-952d-dd4fb0103d17 service nova] Acquired lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:34.587097 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4733dd39-ccdd-424f-906e-141dd7c691a9 req-4059d0f9-6c20-49cb-952d-dd4fb0103d17 service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Refreshing network info cache for port 86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:10:34.590571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:10:34.598285 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:10:34.598285 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:34.600464 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.601785 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.607461 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.607461 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.607461 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:34.607641 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.607641 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.607641 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:34.614196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:34.636677 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260]
May 27 23:10:34.636677 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260] successful.
May 27 23:10:34.636677 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:34.639312 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.639312 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.639312 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:34.639312 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:34.639312 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.639312 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.639312 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:34.639312 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:34.648721 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:34.661188 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.661188 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.661188 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:34.661188 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:34.661399 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.661399 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.661399 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:34.661399 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:34.661551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:34.661683 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:10:34.662272 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('7', '-', '-', 0) found on session 99 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:10:34.662395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:10:34.670552 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260]
May 27 23:10:34.670552 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260] successful.
May 27 23:10:34.670552 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:34.677972 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 99 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:10:34.678120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:10:34.680378 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:34.692723 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:34.692723 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.692723 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.692723 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:34.692723 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:34.692995 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:34.692995 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.692995 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:34.692995 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:34.692995 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:34.693307 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:34.693474 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:10:34.694161 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] HCTL ('8', '-', '-', 0) found on session 100 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:10:34.694304 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:10:34.706157 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Searching for a device in session 100 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:10:34.706157 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:10:34.802160 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1284464292',display_name='tempest-TestStampPattern-server-1284464292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-teststamppattern-server-1284464292',id=44,image_ref='e7a03625-b76e-4463-a5a0-3984974b633b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuEcu169UlUv7QteA0pyqLa0rS+TCUcqSe/52EzrwkMxCZMxvXkbwYZZ52jOtlT5g4axqhIG+f70+HHRNLCB4B5BkPxo86FW+2QK/hLCWkxS7WEa7mWN+8QeTpUvCGHkQ==',key_name='tempest-TestStampPattern-1547678374',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:09:37Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e077b44d61ee49ffbb4b474bd8b6711a',ramdisk_id='',reservation_id='r-1l9eopu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='92ea712d-1f47-4313-8c9f-6c7a4a5b3c46',image_min_disk='1',image_min_ram='0',image_owner_id='e077b44d61ee49ffbb4b474bd8b6711a',image_owner_project_name='tempest-TestStampPattern-893938880',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-893938880-project-member',image_user_id='08c42711a5d14870b3f4ebecf1deaeeb',owner_project_name='tempest-TestStampPattern-893938880',owner_user_name='tempest-TestStampPattern-893938880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:09:37Z,user_data=None,user_id='08c42711a5d14870b3f4ebecf1deaeeb',uuid=9caacf98-b127-48ed-ab3e-75fdb2776598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:10:34.802324 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converting VIF {"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:34.802840 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:4f:f1,bridge_name='br-int',has_traffic_filtering=True,id=86ad7902-8e2c-46df-abf0-8c14e0f72ce8,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ad7902-8e') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:34.803054 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:4f:f1,bridge_name='br-int',has_traffic_filtering=True,id=86ad7902-8e2c-46df-abf0-8c14e0f72ce8,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ad7902-8e') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:10:34.804285 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.804540 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86ad7902-8e, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:34.805626 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.807302 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:34.807302 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.807427 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.807471 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46ab0638-856a-48bd-8365-160df568aa60) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:34.807916 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.808305 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:34.808796 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.811021 np0000001565 nova-compute[98289]: INFO os_vif [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:4f:f1,bridge_name='br-int',has_traffic_filtering=True,id=86ad7902-8e2c-46df-abf0-8c14e0f72ce8,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ad7902-8e')
May 27 23:10:34.811318 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Deleting instance files /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598_del
May 27 23:10:34.811975 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Deletion of /opt/stack/data/nova/instances/9caacf98-b127-48ed-ab3e-75fdb2776598_del complete
May 27 23:10:34.908848 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-364ad0a7-748b-49d0-a612-e38e23c6579d req-c92ab0f7-258d-437b-b0f4-9f82c04bc451 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:34.934123 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] End _get_guest_xml xml=<domain type="qemu">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <uuid>adac29fa-1144-4721-9ab5-0901535cd08e</uuid>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <name>instance-0000002f</name>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1949104133</nova:name>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:10:34</nova:creationTime>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:user uuid="12335b63d21044a6bc1d970ab66c8292">tempest-VolumesSnapshotTestJSON-1830020059-project-member</nova:user>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:project uuid="eceb76118ffc41a281af4ce737b19b88">tempest-VolumesSnapshotTestJSON-1830020059</nova:project>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         <nova:port uuid="9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <system>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <entry name="serial">adac29fa-1144-4721-9ab5-0901535cd08e</entry>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <entry name="uuid">adac29fa-1144-4721-9ab5-0901535cd08e</entry>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     </system>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <os>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   </os>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <features>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   </features>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   <devices>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk.config"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:65:5e:ff"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <target dev="tap9cc2b2cb-ab"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     </interface>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/console.log" append="off"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     </serial>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <video>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     </video>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     </rng>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:   </devices>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]: </domain>
May 27 23:10:34.934123 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:10:34.934123 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Preparing to wait for external event network-vif-plugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:10:34.934123 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:34.934123 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:34.934123 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:34.934123 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1949104133',display_name='tempest-VolumesSnapshotTestJSON-instance-1949104133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumessnapshottestjson-instance-1949104133',id=47,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPFgEp4HYwdrGNENA6wGmAi1NAhzBRZbmBEbMVYXxfDsIeW8f8EHNjhHW8ekGSh4VC4Um5c5jX/hEgn6XetnX7LaP/fZJqYtsTsLr4cJld3F3njNYflidHK4wpzpe28HQ==',key_name='tempest-keypair-1154421445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eceb76118ffc41a281af4ce737b19b88',ramdisk_id='',reservation_id='r-y94td6xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1830020059',owner_user_name='tempest-VolumesSnapshotTestJSON-1830020059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12335b63d21044a6bc1d970ab66c8292',uuid=adac29fa-1144-4721-9ab5-0901535cd08e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:10:34.934123 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converting VIF {"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:34.934123 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:5e:ff,bridge_name='br-int',has_traffic_filtering=True,id=9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc2b2cb-ab') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:34.934123 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5e:ff,bridge_name='br-int',has_traffic_filtering=True,id=9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc2b2cb-ab') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:10:34.936416 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.936416 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:34.936416 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:10:34.937182 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.937374 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a1131b5-4f07-5c32-bcf6-25e478c5cb22', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:34.938205 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.939066 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:34.939604 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.941034 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.941194 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cc2b2cb-ab, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:34.941505 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cc2b2cb-ab, col_values=(('qos', UUID('a5f183f7-78bf-4c46-bcaf-5fd50f517615')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:34.941657 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cc2b2cb-ab, col_values=(('external_ids', {'iface-id': '9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:5e:ff', 'vm-uuid': 'adac29fa-1144-4721-9ab5-0901535cd08e'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:34.942836 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.944093 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:34.953857 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:34.955055 np0000001565 nova-compute[98289]: INFO os_vif [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5e:ff,bridge_name='br-int',has_traffic_filtering=True,id=9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc2b2cb-ab')
May 27 23:10:34.968935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.469s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:34.972633 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.693s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:34.976094 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:10:34.976378 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Claim successful on node np0000001565
May 27 23:10:35.053100 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Deleted allocations for instance 044cb49c-ae45-4a08-ba7a-1717134060e0
May 27 23:10:35.089820 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4733dd39-ccdd-424f-906e-141dd7c691a9 req-4059d0f9-6c20-49cb-952d-dd4fb0103d17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:35.260487 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-364ad0a7-748b-49d0-a612-e38e23c6579d req-c92ab0f7-258d-437b-b0f4-9f82c04bc451 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:35.322793 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Took 1.35 seconds to destroy the instance on the hypervisor.
May 27 23:10:35.324054 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:10:35.328366 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:10:35.328366 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:10:35.328366 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:35.423595 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:35.439048 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-364ad0a7-748b-49d0-a612-e38e23c6579d req-c92ab0f7-258d-437b-b0f4-9f82c04bc451 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Updated VIF entry in instance network info cache for port 9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:10:35.439729 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-364ad0a7-748b-49d0-a612-e38e23c6579d req-c92ab0f7-258d-437b-b0f4-9f82c04bc451 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Updating instance_info_cache with network_info: [{"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:35.442588 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4733dd39-ccdd-424f-906e-141dd7c691a9 req-4059d0f9-6c20-49cb-952d-dd4fb0103d17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:35.535845 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:10:35.618724 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4733dd39-ccdd-424f-906e-141dd7c691a9 req-4059d0f9-6c20-49cb-952d-dd4fb0103d17 service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Updated VIF entry in instance network info cache for port 86ad7902-8e2c-46df-abf0-8c14e0f72ce8. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:10:35.619948 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4733dd39-ccdd-424f-906e-141dd7c691a9 req-4059d0f9-6c20-49cb-952d-dd4fb0103d17 service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Updating instance_info_cache with network_info: [{"id": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "address": "fa:16:3e:50:4f:f1", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ad7902-8e", "ovs_interfaceid": "86ad7902-8e2c-46df-abf0-8c14e0f72ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:35.846362 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:35.946352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-364ad0a7-748b-49d0-a612-e38e23c6579d req-c92ab0f7-258d-437b-b0f4-9f82c04bc451 service nova] Releasing lock "refresh_cache-adac29fa-1144-4721-9ab5-0901535cd08e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:36.061668 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0a89c15e-e746-4199-b18c-ac53e16833e6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "044cb49c-ae45-4a08-ba7a-1717134060e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.493s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:36.120976 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4733dd39-ccdd-424f-906e-141dd7c691a9 req-4059d0f9-6c20-49cb-952d-dd4fb0103d17 service nova] Releasing lock "refresh_cache-9caacf98-b127-48ed-ab3e-75fdb2776598" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:36.181781 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:36.190928 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Received event network-vif-unplugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:36.191288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] Acquiring lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:36.191475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:36.191617 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:36.191792 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] No waiting events found dispatching network-vif-unplugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:36.191953 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Received event network-vif-unplugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:10:36.192106 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Received event network-vif-unplugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:36.192289 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] Acquiring lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:36.192507 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:36.192671 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:36.192847 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] No waiting events found dispatching network-vif-unplugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:36.193023 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3162d7e0-1df3-48e7-9230-2c6b7eec8197 req-dd519aaf-ad55-47bf-8e84-e04e4f2beccf service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Received event network-vif-unplugged-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:10:36.353962 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:10:36.354174 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:10:36.481802 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:36.481950 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:36.482035 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No VIF found with MAC fa:16:3e:65:5e:ff, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:10:36.482511 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Using config drive
May 27 23:10:36.558766 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found WWN 330000000b6712bdb for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:10:36.559093 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:36.560221 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000b6712bdb', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b6712bdb'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:36.560430 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b6712bdb', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b6712bdb'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:10:36.615662 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'attaching', 'instance': 'cae297ad-de9f-4adf-9e00-20b1f926df45', 'attached_at': '2026-05-27T23:10:32.000000', 'detached_at': '', 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'serial': 'bd6a5488-3824-4767-9879-bfd2c7abef0e'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:10:36.616245 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:10:36.616534 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:10:36.616713 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:10:36.641114 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 23:10:36.641114 np0000001565 nova-compute[98289]:   <usage type="volume">
May 27 23:10:36.641114 np0000001565 nova-compute[98289]:     <volume>bd6a5488-3824-4767-9879-bfd2c7abef0e</volume>
May 27 23:10:36.641114 np0000001565 nova-compute[98289]:   </usage>
May 27 23:10:36.641114 np0000001565 nova-compute[98289]: </secret>
May 27 23:10:36.641114 np0000001565 nova-compute[98289]:  {{(pid=98289) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 23:10:36.673457 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-621f7a9f-0da3-45ff-9c7e-ba7e52144f7f req-af0a2b0d-6229-48a5-b853-be187a0595c4 service nova] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Received event network-vif-deleted-86ad7902-8e2c-46df-abf0-8c14e0f72ce8 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:36.686013 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Took 1.36 seconds to deallocate network for instance.
May 27 23:10:36.857758 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:10:36.989261 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:37.127008 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Creating config drive at /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk.config
May 27 23:10:37.130995 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpedt4ha7x {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:37.156505 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-952310270',display_name='tempest-TestEncryptedCinderVolumes-server-952310270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-952310270',id=42,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeBhqxE20M9Bm677ecVK4Bxso3Be10ZNZMOFKVGpzJiVLkzjgBf1GilnWj8FQLjvLgdCO1az9+IE11uvwD9zV3ZRW3erwfzlyCmPI79SXH2T2Xk/O7n070Zg7gHRisLaQ==',key_name='tempest-keypair-1714797866',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:10:18Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-z0h6rwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:10:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=cae297ad-de9f-4adf-9e00-20b1f926df45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:10:37.156776 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:37.157907 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:37.161594 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] End _get_guest_xml xml=<domain type="qemu">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <uuid>cae297ad-de9f-4adf-9e00-20b1f926df45</uuid>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <name>instance-0000002a</name>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-952310270</nova:name>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:10:32</nova:creationTime>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:user uuid="1e15e4b45c874974b28db7f3448a3945">tempest-TestEncryptedCinderVolumes-762189049-project-member</nova:user>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:project uuid="8b69ef10bedf41b48b1455ae48aa534e">tempest-TestEncryptedCinderVolumes-762189049</nova:project>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <nova:port uuid="f03578e3-9014-4578-b259-d4577bb95e72">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <system>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <entry name="serial">cae297ad-de9f-4adf-9e00-20b1f926df45</entry>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <entry name="uuid">cae297ad-de9f-4adf-9e00-20b1f926df45</entry>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     </system>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <os>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   </os>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <features>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   </features>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   <devices>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk.config"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <alias name="ua-bd6a5488-3824-4767-9879-bfd2c7abef0e"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <serial>bd6a5488-3824-4767-9879-bfd2c7abef0e</serial>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <encryption format="luks">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:         <secret type="passphrase" uuid="224d9f97-66ea-40d1-8786-34fd710e5815"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       </encryption>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:5f:f9:a9"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <target dev="tapf03578e3-90"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     </interface>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/console.log" append="off"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     </serial>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <video>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     </video>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     </rng>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:   </devices>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]: </domain>
May 27 23:10:37.161594 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:10:37.164519 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Preparing to wait for external event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:10:37.164519 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:37.164519 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:37.164519 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:37.164519 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-952310270',display_name='tempest-TestEncryptedCinderVolumes-server-952310270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-952310270',id=42,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeBhqxE20M9Bm677ecVK4Bxso3Be10ZNZMOFKVGpzJiVLkzjgBf1GilnWj8FQLjvLgdCO1az9+IE11uvwD9zV3ZRW3erwfzlyCmPI79SXH2T2Xk/O7n070Zg7gHRisLaQ==',key_name='tempest-keypair-1714797866',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:10:18Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001565',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-z0h6rwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:10:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=cae297ad-de9f-4adf-9e00-20b1f926df45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:10:37.164519 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:37.164519 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:37.164519 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:10:37.165252 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:37.165724 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:37.166293 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:10:37.167464 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:37.167665 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a573e56f-7106-5031-941e-84225418f961', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:37.169618 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:37.170552 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:37.176640 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:37.180454 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:37.180749 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf03578e3-90, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:37.181202 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf03578e3-90, col_values=(('qos', UUID('12fa0e41-8e49-4609-9877-3773f256e5b0')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:37.181429 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf03578e3-90, col_values=(('external_ids', {'iface-id': 'f03578e3-9014-4578-b259-d4577bb95e72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:f9:a9', 'vm-uuid': 'cae297ad-de9f-4adf-9e00-20b1f926df45'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:37.182450 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:37.183866 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:37.185730 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpedt4ha7x" returned: 0 in 0.055s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:37.194041 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:37.195338 np0000001565 nova-compute[98289]: INFO os_vif [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90')
May 27 23:10:37.200516 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:37.368245 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.396s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:37.368715 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:10:37.371277 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.171s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:37.434211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:37.440024 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.006s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:37.737631 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:10:37.737631 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:10:37.875933 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:10:37.876688 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:10:37.876989 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:37.877499 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:37.949419 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Detaching volume 9952761e-515c-464d-9151-a628c54216c9
May 27 23:10:37.968375 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4d70d6d0d1c49ad9a7544e9c6df08e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199fc687f9c94d22899ca4964c2ea250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:10:37.999401 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Attempting to driver detach volume 9952761e-515c-464d-9151-a628c54216c9 from mountpoint /dev/vdb
May 27 23:10:38.001653 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.022014 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Found disk vdb by alias ua-9952761e-515c-464d-9151-a628c54216c9 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:10:38.023756 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Found disk vdb by alias ua-9952761e-515c-464d-9151-a628c54216c9 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:10:38.023756 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Attempting to detach device vdb from instance f6a3b268-ad24-445e-a58c-b1e35a289f56 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:10:38.023756 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:10:38.023756 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:10:38.023756 np0000001565 nova-compute[98289]:   <alias name="ua-9952761e-515c-464d-9151-a628c54216c9"/>
May 27 23:10:38.023756 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-1"/>
May 27 23:10:38.023756 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:10:38.023756 np0000001565 nova-compute[98289]:   <serial>9952761e-515c-464d-9151-a628c54216c9</serial>
May 27 23:10:38.023756 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:10:38.023756 np0000001565 nova-compute[98289]: </disk>
May 27 23:10:38.023756 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:10:38.031287 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully detached device vdb from instance f6a3b268-ad24-445e-a58c-b1e35a289f56 from the persistent domain config.
May 27 23:10:38.031483 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] (1/8): Attempting to detach device vdb with device alias ua-9952761e-515c-464d-9151-a628c54216c9 from instance f6a3b268-ad24-445e-a58c-b1e35a289f56 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:10:38.031718 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:10:38.031718 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:10:38.031718 np0000001565 nova-compute[98289]:   <alias name="ua-9952761e-515c-464d-9151-a628c54216c9"/>
May 27 23:10:38.031718 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-1"/>
May 27 23:10:38.031718 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:10:38.031718 np0000001565 nova-compute[98289]:   <serial>9952761e-515c-464d-9151-a628c54216c9</serial>
May 27 23:10:38.031718 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:10:38.031718 np0000001565 nova-compute[98289]: </disk>
May 27 23:10:38.031718 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:10:38.053635 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.121959 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.178114 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00042865900013566716 future=<Future at 0x726e602ae990 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:38.178207 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:38.178411 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=7.228365561999908 future=<Future at 0x726e38640a40 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:38.178845 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=7.2279629109998496 future=<Future at 0x726e38640a40 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:38.179744 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Emitting event <LifecycleEvent: 1779923423.177578, cae297ad-de9f-4adf-9e00-20b1f926df45 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:38.180054 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] VM Stopped (Lifecycle Event)
May 27 23:10:38.222498 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.240169 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:10:38.310452 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-469ef1fc-b4a3-4268-bfaf-9bd6090b656e req-b66195a2-98f0-47d0-8cfe-e98612f20ed3 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Received event network-vif-plugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:38.312861 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-469ef1fc-b4a3-4268-bfaf-9bd6090b656e req-b66195a2-98f0-47d0-8cfe-e98612f20ed3 service nova] Acquiring lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:38.313266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-469ef1fc-b4a3-4268-bfaf-9bd6090b656e req-b66195a2-98f0-47d0-8cfe-e98612f20ed3 service nova] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:38.313678 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-469ef1fc-b4a3-4268-bfaf-9bd6090b656e req-b66195a2-98f0-47d0-8cfe-e98612f20ed3 service nova] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:38.314071 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-469ef1fc-b4a3-4268-bfaf-9bd6090b656e req-b66195a2-98f0-47d0-8cfe-e98612f20ed3 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Processing event network-vif-plugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:10:38.377725 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:10:38.424666 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.426819 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.428776 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.431423 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.452910 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.507788 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Successfully created port: fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:10:38.529751 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923438.529037, f6a3b268-ad24-445e-a58c-b1e35a289f56 => ua-9952761e-515c-464d-9151-a628c54216c9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:10:38.534317 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9952761e-515c-464d-9151-a628c54216c9 for instance f6a3b268-ad24-445e-a58c-b1e35a289f56 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:10:38.540916 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully detached device vdb from instance f6a3b268-ad24-445e-a58c-b1e35a289f56 from the live domain config.
May 27 23:10:38.543196 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:10:38.544144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9952761e-515c-464d-9151-a628c54216c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:10:38.544144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:38.544536 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:38.545124 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9952761e-515c-464d-9151-a628c54216c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:10:38.545124 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:10:38.581916 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:38.581916 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:38.581916 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:38.581916 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:38.581916 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:38.582139 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:38.582139 np0000001565 nova-compute[98289]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:38.582139 np0000001565 nova-compute[98289]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9 (non-flash)
May 27 23:10:38.582139 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:38.582139 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:38.582294 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '99')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:10:38.582401 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '88')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:10:38.583327 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9', '89')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:10:38.584125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3870b4c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:10:38.584375 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Removing multipathed devices sdd, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:10:38.584611 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Flush multipath device 330000000c9df99ce {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:10:38.617894 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:10:38.661085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:10:38.683220 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bd58f82b-f401-4cfb-af30-8cfdeb36e94d tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:38.707419 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:10:38.707419 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:10:38.708078 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:10:38.723874 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:10:38.724127 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:10:38.735750 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:38.750949 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.380s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:38.767077 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9, portal: 192.168.40.100,3260]
May 27 23:10:38.767077 np0000001565 nova-compute[98289]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9, portal: 192.168.40.100,3260] successful.
May 27 23:10:38.767077 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:38.785065 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:38.786041 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.795805 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:38.816980 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Deleted allocations for instance 9caacf98-b127-48ed-ab3e-75fdb2776598
May 27 23:10:38.831646 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9, portal: 192.168.50.100,3260]
May 27 23:10:38.831646 np0000001565 nova-compute[98289]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-9952761e-515c-464d-9151-a628c54216c9, portal: 192.168.50.100,3260] successful.
May 27 23:10:38.831646 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:38.846984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:38.846984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:38.846984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] <== disconnect_volume: return (302ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:38.846984 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:10:38.885080 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:10:38.908921 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.910402 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.913903 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.937882 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:38.940159 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:39.076453 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923439.0761132, adac29fa-1144-4721-9ab5-0901535cd08e => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:39.076950 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:10:39.077177 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] VM Started (Lifecycle Event)
May 27 23:10:39.080139 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:10:39.084152 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Instance spawned successfully.
May 27 23:10:39.084550 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:10:39.088792 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Successfully updated port: fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:10:39.402887 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'flavor' on Instance uuid f6a3b268-ad24-445e-a58c-b1e35a289f56 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:39.600915 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:39.604729 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "refresh_cache-b930b00c-9e48-4185-ac6c-cbbcd61682e8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:39.604903 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquired lock "refresh_cache-b930b00c-9e48-4185-ac6c-cbbcd61682e8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:39.605402 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:10:39.611641 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:39.611768 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:39.612106 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:39.612706 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:39.612706 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:39.612884 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:39.615956 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:39.825042 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57525d2c-d7ba-493f-a387-b3c630b69609 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "9caacf98-b127-48ed-ab3e-75fdb2776598" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.367s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:39.895491 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:10:39.895491 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:10:39.895491 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Creating image(s)
May 27 23:10:39.898158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "/opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:39.898158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "/opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:39.898158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "/opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:39.898158 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:39.901783 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:39.902852 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:40.021244 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.116s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:40.021244 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:40.021244 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:40.021244 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:40.022649 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:40.023113 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:40.106476 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:40.119741 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Took 6.97 seconds to spawn the instance on the hypervisor.
May 27 23:10:40.120973 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:10:40.120973 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:40.122137 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923440.1210535, adac29fa-1144-4721-9ab5-0901535cd08e => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:40.122137 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] VM Paused (Lifecycle Event)
May 27 23:10:40.142716 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.119s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:40.144408 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:40.193951 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk 1073741824" returned: 0 in 0.051s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:40.194356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:40.194641 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:40.213638 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:10:40.283152 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:40.283523 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:10:40.283727 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:40.377288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:40.377727 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Cannot resize image /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:10:40.378519 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:10:40.378691 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Ensure instance console log exists: /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:10:40.378949 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:40.379152 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:40.379273 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:40.389425 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Received event network-vif-plugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:40.389608 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] Acquiring lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:40.389783 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:40.389904 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:40.390051 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] No waiting events found dispatching network-vif-plugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:40.391018 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Received unexpected event network-vif-plugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 for instance with vm_state active and task_state None.
May 27 23:10:40.391132 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Received event network-changed-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:40.391239 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Refreshing instance network info cache due to event network-changed-fac3e57b-733e-42a5-81a9-b5720d244659. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:10:40.392879 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] Acquiring lock "refresh_cache-b930b00c-9e48-4185-ac6c-cbbcd61682e8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:40.406919 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:40.434236 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-056f1103-84ed-433f-9297-6a729ce056ba tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.993s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:40.538943 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Updating instance_info_cache with network_info: [{"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:40.638665 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:40.639684 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Took 13.53 seconds to build instance.
May 27 23:10:40.643671 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923440.6433764, adac29fa-1144-4721-9ab5-0901535cd08e => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:40.643839 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] VM Resumed (Lifecycle Event)
May 27 23:10:40.739518 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:40.739676 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:40.739838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:40.739972 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:40.740095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:40.741846 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Terminating instance
May 27 23:10:41.045186 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Releasing lock "refresh_cache-b930b00c-9e48-4185-ac6c-cbbcd61682e8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:41.045732 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Instance network_info: |[{"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:10:41.048286 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Start _get_guest_xml network_info=[{"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:10:41.048956 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] Acquired lock "refresh_cache-b930b00c-9e48-4185-ac6c-cbbcd61682e8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:41.049300 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Refreshing network info cache for port fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:10:41.055147 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:10:41.056823 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-1794877486', uuid='b930b00c-9e48-4185-ac6c-cbbcd61682e8'), owner=OwnerMeta(userid='f4d70d6d0d1c49ad9a7544e9c6df08e9', username='tempest-VolumesExtendAttachedTest-527819065-project-member', projectid='199fc687f9c94d22899ca4964c2ea250', projectname='tempest-VolumesExtendAttachedTest-527819065'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923441.0564458) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:10:41.058428 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:10:41.058909 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:10:41.060024 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:10:41.060290 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:10:41.062723 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:10:41.062830 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:10:41.064990 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:10:41.065472 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:10:41.065691 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:10:41.069033 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:10:41.072208 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:10:41.072856 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:10:41.073051 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:10:41.073241 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:10:41.073400 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:10:41.073534 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:10:41.089765 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1794877486',display_name='tempest-VolumesExtendAttachedTest-instance-1794877486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesextendattachedtest-instance-1794877486',id=48,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUyfp8YHlL3eeigTQXIL7Z52NuZQFKaArICXAcUN+VxNaLiyaZB1/7Q8EQhKpvJW4zoHfseEslHp2kf4P2mBZe8fIKM739CvAGjpJgxRcFt8tQWjIvjAy/Xr9WWqE+BHA==',key_name='tempest-keypair-1933711445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='199fc687f9c94d22899ca4964c2ea250',ramdisk_id='',reservation_id='r-dfukxqce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-527819065',owner_user_name='tempest-VolumesExtendAttachedTest-527819065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4d70d6d0d1c49ad9a7544e9c6df08e9',uuid=b930b00c-9e48-4185-ac6c-cbbcd61682e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:10:41.089988 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Converting VIF {"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:41.090464 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:07:2e,bridge_name='br-int',has_traffic_filtering=True,id=fac3e57b-733e-42a5-81a9-b5720d244659,network=Network(b29c1e55-a7c7-4138-a79d-35dc3c7b75c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac3e57b-73') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:41.091390 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lazy-loading 'pci_devices' on Instance uuid b930b00c-9e48-4185-ac6c-cbbcd61682e8 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:41.141089 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.040s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:41.146592 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:41.150224 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:41.244440 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:10:41.261781 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:41.264817 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:41.305408 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:41.308077 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:41.335470 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:41.551864 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:41.588079 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Instance destroyed successfully.
May 27 23:10:41.588079 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'resources' on Instance uuid f6a3b268-ad24-445e-a58c-b1e35a289f56 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:41.596996 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] End _get_guest_xml xml=<domain type="qemu">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <uuid>b930b00c-9e48-4185-ac6c-cbbcd61682e8</uuid>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <name>instance-00000030</name>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-1794877486</nova:name>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:10:41</nova:creationTime>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:user uuid="f4d70d6d0d1c49ad9a7544e9c6df08e9">tempest-VolumesExtendAttachedTest-527819065-project-member</nova:user>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:project uuid="199fc687f9c94d22899ca4964c2ea250">tempest-VolumesExtendAttachedTest-527819065</nova:project>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         <nova:port uuid="fac3e57b-733e-42a5-81a9-b5720d244659">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <system>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <entry name="serial">b930b00c-9e48-4185-ac6c-cbbcd61682e8</entry>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <entry name="uuid">b930b00c-9e48-4185-ac6c-cbbcd61682e8</entry>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     </system>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <os>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   </os>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <features>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   </features>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   <devices>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk.config"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:5d:07:2e"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <target dev="tapfac3e57b-73"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     </interface>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/console.log" append="off"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     </serial>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <video>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     </video>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     </rng>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:   </devices>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]: </domain>
May 27 23:10:41.596996 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:10:41.596996 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Preparing to wait for external event network-vif-plugged-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:10:41.596996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:41.596996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:41.596996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:41.596996 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1794877486',display_name='tempest-VolumesExtendAttachedTest-instance-1794877486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesextendattachedtest-instance-1794877486',id=48,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUyfp8YHlL3eeigTQXIL7Z52NuZQFKaArICXAcUN+VxNaLiyaZB1/7Q8EQhKpvJW4zoHfseEslHp2kf4P2mBZe8fIKM739CvAGjpJgxRcFt8tQWjIvjAy/Xr9WWqE+BHA==',key_name='tempest-keypair-1933711445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='199fc687f9c94d22899ca4964c2ea250',ramdisk_id='',reservation_id='r-dfukxqce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-527819065',owner_user_name='tempest-VolumesExtendAttachedTest-527819065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4d70d6d0d1c49ad9a7544e9c6df08e9',uuid=b930b00c-9e48-4185-ac6c-cbbcd61682e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:10:41.596996 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Converting VIF {"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:41.596996 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:07:2e,bridge_name='br-int',has_traffic_filtering=True,id=fac3e57b-733e-42a5-81a9-b5720d244659,network=Network(b29c1e55-a7c7-4138-a79d-35dc3c7b75c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac3e57b-73') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:41.596996 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:07:2e,bridge_name='br-int',has_traffic_filtering=True,id=fac3e57b-733e-42a5-81a9-b5720d244659,network=Network(b29c1e55-a7c7-4138-a79d-35dc3c7b75c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac3e57b-73') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:10:41.599150 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:41.599150 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:41.599150 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:10:41.599980 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:41.600229 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6659e54-9579-58dd-94e5-c56d3307f8e2', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:41.601862 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:41.607040 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:41.611229 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:41.611469 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfac3e57b-73, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:41.611800 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfac3e57b-73, col_values=(('qos', UUID('23739f5f-8cef-4ba3-b727-5e31278fcfec')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:41.612052 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfac3e57b-73, col_values=(('external_ids', {'iface-id': 'fac3e57b-733e-42a5-81a9-b5720d244659', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:07:2e', 'vm-uuid': 'b930b00c-9e48-4185-ac6c-cbbcd61682e8'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:41.613030 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:41.615209 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:41.625300 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:41.626350 np0000001565 nova-compute[98289]: INFO os_vif [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:07:2e,bridge_name='br-int',has_traffic_filtering=True,id=fac3e57b-733e-42a5-81a9-b5720d244659,network=Network(b29c1e55-a7c7-4138-a79d-35dc3c7b75c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac3e57b-73')
May 27 23:10:41.653072 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923441.652767, cae297ad-de9f-4adf-9e00-20b1f926df45 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:41.653221 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] VM Started (Lifecycle Event)
May 27 23:10:41.896234 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:42.022387 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Updated VIF entry in instance network info cache for port fac3e57b-733e-42a5-81a9-b5720d244659. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:10:42.022609 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Updating instance_info_cache with network_info: [{"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:42.094643 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1592918536',display_name='tempest-AttachVolumeNegativeTest-server-1592918536',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1592918536',id=41,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZfx0Zf4i6q1AY6g6YrvtRS8TcDci8yjBmSFKz4SDY2PPFSG8gbzOC87NBlOGkIBDijEPWVIq833Upg3c1gMqLWHGz1RR3Ml2pfm5Md57TXJ0VwV08x4MVwjJQizx9Kaw==',key_name='tempest-keypair-995744843',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:08:45Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-5n46wwwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=f6a3b268-ad24-445e-a58c-b1e35a289f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:10:42.094941 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "address": "fa:16:3e:19:13:72", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d9e625-52", "ovs_interfaceid": "d2d9e625-52c4-4ee3-a7cb-5608d369222f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:42.095405 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:13:72,bridge_name='br-int',has_traffic_filtering=True,id=d2d9e625-52c4-4ee3-a7cb-5608d369222f,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d9e625-52') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:42.095616 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:13:72,bridge_name='br-int',has_traffic_filtering=True,id=d2d9e625-52c4-4ee3-a7cb-5608d369222f,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d9e625-52') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:10:42.097190 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:42.097467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2d9e625-52, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:42.099866 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:42.100643 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:42.104861 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:42.105643 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:42.105789 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd6e05a1-048e-4135-84be-d17c43c492f3) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:42.106745 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:42.111449 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:42.113258 np0000001565 nova-compute[98289]: INFO os_vif [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:13:72,bridge_name='br-int',has_traffic_filtering=True,id=d2d9e625-52c4-4ee3-a7cb-5608d369222f,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d9e625-52')
May 27 23:10:42.113544 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Deleting instance files /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56_del
May 27 23:10:42.114210 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Deletion of /opt/stack/data/nova/instances/f6a3b268-ad24-445e-a58c-b1e35a289f56_del complete
May 27 23:10:42.156482 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:42.162425 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923442.1621926, cae297ad-de9f-4adf-9e00-20b1f926df45 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:42.162544 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] VM Paused (Lifecycle Event)
May 27 23:10:42.443733 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f696415f-081c-41f8-8125-0cd890548191 req-2d594868-1f72-4c64-922f-7d08c79fab9f service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Received event network-changed-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:42.444245 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f696415f-081c-41f8-8125-0cd890548191 req-2d594868-1f72-4c64-922f-7d08c79fab9f service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Refreshing instance network info cache due to event network-changed-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:10:42.444570 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f696415f-081c-41f8-8125-0cd890548191 req-2d594868-1f72-4c64-922f-7d08c79fab9f service nova] Acquiring lock "refresh_cache-adac29fa-1144-4721-9ab5-0901535cd08e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:42.445074 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f696415f-081c-41f8-8125-0cd890548191 req-2d594868-1f72-4c64-922f-7d08c79fab9f service nova] Acquired lock "refresh_cache-adac29fa-1144-4721-9ab5-0901535cd08e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:42.445213 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f696415f-081c-41f8-8125-0cd890548191 req-2d594868-1f72-4c64-922f-7d08c79fab9f service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Refreshing network info cache for port 9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:10:42.525382 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-72e31e56-8c42-4633-8125-72e2c4e0ba2a req-ddf87a6d-ae30-4033-be64-27955c970762 service nova] Releasing lock "refresh_cache-b930b00c-9e48-4185-ac6c-cbbcd61682e8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:42.626089 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 23:10:42.626504 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:10:42.626665 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:10:42.626831 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:10:42.629217 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:42.667448 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:42.672740 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 3 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:42.738926 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:42.947270 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f696415f-081c-41f8-8125-0cd890548191 req-2d594868-1f72-4c64-922f-7d08c79fab9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:43.153182 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:43.153376 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:43.153742 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] No VIF found with MAC fa:16:3e:5d:07:2e, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:10:43.153812 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Using config drive
May 27 23:10:43.157157 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f3336ecf-7be3-4542-83a6-011487ce74de req-b89a313b-acb9-4aaa-b4fc-740b6c942d11 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Received event network-changed-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:43.157568 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f3336ecf-7be3-4542-83a6-011487ce74de req-b89a313b-acb9-4aaa-b4fc-740b6c942d11 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Refreshing instance network info cache due to event network-changed-8ca731b3-122c-49a9-aea1-75b46d5644e1. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:10:43.157568 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f3336ecf-7be3-4542-83a6-011487ce74de req-b89a313b-acb9-4aaa-b4fc-740b6c942d11 service nova] Acquiring lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:43.157568 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f3336ecf-7be3-4542-83a6-011487ce74de req-b89a313b-acb9-4aaa-b4fc-740b6c942d11 service nova] Acquired lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:43.157659 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f3336ecf-7be3-4542-83a6-011487ce74de req-b89a313b-acb9-4aaa-b4fc-740b6c942d11 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Refreshing network info cache for port 8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:10:43.173804 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 27 23:10:43.174169 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999825739000244 future=<Future at 0x726e605779e0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:43.202289 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-68675bb8-a860-40cc-ab76-bce1f72ca64a req-cb807a82-d7eb-4e8c-a12a-467dd34f2a0e service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Received event network-vif-deleted-d2d9e625-52c4-4ee3-a7cb-5608d369222f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:43.202510 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-68675bb8-a860-40cc-ab76-bce1f72ca64a req-cb807a82-d7eb-4e8c-a12a-467dd34f2a0e service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Neutron deleted interface d2d9e625-52c4-4ee3-a7cb-5608d369222f; detaching it from the instance and deleting it from the info cache
May 27 23:10:43.208608 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-68675bb8-a860-40cc-ab76-bce1f72ca64a req-cb807a82-d7eb-4e8c-a12a-467dd34f2a0e service nova] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Detach interface failed, port_id=d2d9e625-52c4-4ee3-a7cb-5608d369222f, reason: Instance f6a3b268-ad24-445e-a58c-b1e35a289f56 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:10:43.322040 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f696415f-081c-41f8-8125-0cd890548191 req-2d594868-1f72-4c64-922f-7d08c79fab9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:43.462642 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f696415f-081c-41f8-8125-0cd890548191 req-2d594868-1f72-4c64-922f-7d08c79fab9f service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Updated VIF entry in instance network info cache for port 9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:10:43.462917 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f696415f-081c-41f8-8125-0cd890548191 req-2d594868-1f72-4c64-922f-7d08c79fab9f service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Updating instance_info_cache with network_info: [{"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:43.602882 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:43.631910 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:43.632092 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:43.664320 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:43.666360 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f3336ecf-7be3-4542-83a6-011487ce74de req-b89a313b-acb9-4aaa-b4fc-740b6c942d11 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:43.708324 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:43.708536 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:43.708735 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:43.708922 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:43.709085 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:43.711558 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Terminating instance
May 27 23:10:43.801505 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:43.822354 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Creating config drive at /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk.config
May 27 23:10:43.826210 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf2x_a5fl {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:43.900477 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf2x_a5fl" returned: 0 in 0.074s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:43.965694 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f696415f-081c-41f8-8125-0cd890548191 req-2d594868-1f72-4c64-922f-7d08c79fab9f service nova] Releasing lock "refresh_cache-adac29fa-1144-4721-9ab5-0901535cd08e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:43.991032 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f3336ecf-7be3-4542-83a6-011487ce74de req-b89a313b-acb9-4aaa-b4fc-740b6c942d11 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:44.105346 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Took 1.48 seconds to deallocate network for instance.
May 27 23:10:44.133678 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:10:44.146128 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f3336ecf-7be3-4542-83a6-011487ce74de req-b89a313b-acb9-4aaa-b4fc-740b6c942d11 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Updated VIF entry in instance network info cache for port 8ca731b3-122c-49a9-aea1-75b46d5644e1. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:10:44.146511 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f3336ecf-7be3-4542-83a6-011487ce74de req-b89a313b-acb9-4aaa-b4fc-740b6c942d11 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Updating instance_info_cache with network_info: [{"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:44.214712 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:10:44.235916 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.238127 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.262166 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.272552 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.295216 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.305407 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.377722 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.411057 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.507304 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.592466 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.599064 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.617481 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:44.617676 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:44.635615 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999672596999972 future=<Future at 0x726e582132c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:44.637893 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Instance destroyed successfully.
May 27 23:10:44.638407 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lazy-loading 'resources' on Instance uuid 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:44.650834 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f3336ecf-7be3-4542-83a6-011487ce74de req-b89a313b-acb9-4aaa-b4fc-740b6c942d11 service nova] Releasing lock "refresh_cache-92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:44.698810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:44.774115 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.782817 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.785305 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.812442 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:44.820464 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:45.057950 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:10:45.058356 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:10:45.142565 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1438533498',display_name='tempest-TestStampPattern-server-1438533498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-teststamppattern-server-1438533498',id=40,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuEcu169UlUv7QteA0pyqLa0rS+TCUcqSe/52EzrwkMxCZMxvXkbwYZZ52jOtlT5g4axqhIG+f70+HHRNLCB4B5BkPxo86FW+2QK/hLCWkxS7WEa7mWN+8QeTpUvCGHkQ==',key_name='tempest-TestStampPattern-1547678374',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:08:23Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e077b44d61ee49ffbb4b474bd8b6711a',ramdisk_id='',reservation_id='r-fhl04ehz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-893938880',owner_user_name='tempest-TestStampPattern-893938880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:09:23Z,user_data=None,user_id='08c42711a5d14870b3f4ebecf1deaeeb',uuid=92ea712d-1f47-4313-8c9f-6c7a4a5b3c46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:10:45.142772 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converting VIF {"id": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "address": "fa:16:3e:48:0f:47", "network": {"id": "c8049ce3-2431-4852-9860-5caab4ae969f", "bridge": "br-int", "label": "tempest-TestStampPattern-254291498-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e077b44d61ee49ffbb4b474bd8b6711a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca731b3-12", "ovs_interfaceid": "8ca731b3-122c-49a9-aea1-75b46d5644e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:45.143350 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:0f:47,bridge_name='br-int',has_traffic_filtering=True,id=8ca731b3-122c-49a9-aea1-75b46d5644e1,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca731b3-12') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:45.143613 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0f:47,bridge_name='br-int',has_traffic_filtering=True,id=8ca731b3-122c-49a9-aea1-75b46d5644e1,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca731b3-12') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:10:45.147401 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:45.147716 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ca731b3-12, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:45.151648 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:45.152286 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:45.152463 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46c22b6f-536b-4b1e-b21b-d5906f66d24c) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:45.155400 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:45.156240 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:45.157839 np0000001565 nova-compute[98289]: INFO os_vif [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0f:47,bridge_name='br-int',has_traffic_filtering=True,id=8ca731b3-122c-49a9-aea1-75b46d5644e1,network=Network(c8049ce3-2431-4852-9860-5caab4ae969f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca731b3-12')
May 27 23:10:45.158194 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Deleting instance files /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46_del
May 27 23:10:45.159039 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Deletion of /opt/stack/data/nova/instances/92ea712d-1f47-4313-8c9f-6c7a4a5b3c46_del complete
May 27 23:10:45.228037 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Received event network-vif-unplugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:45.228514 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:45.228514 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:45.228514 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:45.228674 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] No waiting events found dispatching network-vif-unplugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:45.228721 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Received event network-vif-unplugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:10:45.228918 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Received event network-vif-unplugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:45.228974 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] Acquiring lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:45.229090 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:45.229179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:45.229282 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] No waiting events found dispatching network-vif-unplugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:45.229733 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fe507c4b-520a-4e24-8d8d-eb390fc86b8c req-dc490ab5-96ff-4a40-aeac-14852fc96dd7 service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Received event network-vif-unplugged-8ca731b3-122c-49a9-aea1-75b46d5644e1 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:10:45.284896 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8e44b7f4-12a2-49f3-8d57-63c2425d5db4 req-1b50501c-1ed4-4527-b10a-bf63a289da1f service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:45.285039 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8e44b7f4-12a2-49f3-8d57-63c2425d5db4 req-1b50501c-1ed4-4527-b10a-bf63a289da1f service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:45.285185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8e44b7f4-12a2-49f3-8d57-63c2425d5db4 req-1b50501c-1ed4-4527-b10a-bf63a289da1f service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:45.285309 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8e44b7f4-12a2-49f3-8d57-63c2425d5db4 req-1b50501c-1ed4-4527-b10a-bf63a289da1f service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:45.288429 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8e44b7f4-12a2-49f3-8d57-63c2425d5db4 req-1b50501c-1ed4-4527-b10a-bf63a289da1f service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Processing event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:10:45.288594 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8e44b7f4-12a2-49f3-8d57-63c2425d5db4 req-1b50501c-1ed4-4527-b10a-bf63a289da1f service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:45.289244 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:10:45.289466 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8e44b7f4-12a2-49f3-8d57-63c2425d5db4 req-1b50501c-1ed4-4527-b10a-bf63a289da1f service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:45.289609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8e44b7f4-12a2-49f3-8d57-63c2425d5db4 req-1b50501c-1ed4-4527-b10a-bf63a289da1f service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:45.289721 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8e44b7f4-12a2-49f3-8d57-63c2425d5db4 req-1b50501c-1ed4-4527-b10a-bf63a289da1f service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:45.289825 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8e44b7f4-12a2-49f3-8d57-63c2425d5db4 req-1b50501c-1ed4-4527-b10a-bf63a289da1f service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] No waiting events found dispatching network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:45.289996 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-8e44b7f4-12a2-49f3-8d57-63c2425d5db4 req-1b50501c-1ed4-4527-b10a-bf63a289da1f service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received unexpected event network-vif-plugged-f03578e3-9014-4578-b259-d4577bb95e72 for instance with vm_state resized and task_state resize_reverting.
May 27 23:10:45.293484 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923445.2931442, cae297ad-de9f-4adf-9e00-20b1f926df45 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:45.293621 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] VM Resumed (Lifecycle Event)
May 27 23:10:45.298632 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance running successfully.
May 27 23:10:45.298785 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] finish_revert_migration finished successfully. {{(pid=98289) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 27 23:10:45.407297 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004814200001419522 future=<Future at 0x726e38640a40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:45.409504 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Emitting event <LifecycleEvent: 1779923430.4066184, 044cb49c-ae45-4a08-ba7a-1717134060e0 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:45.409623 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:45.409763 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.88309332200015 future=<Future at 0x726e601ea090 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:45.409861 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=3.88298017399984 future=<Future at 0x726e601ea090 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:45.411053 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] VM Stopped (Lifecycle Event)
May 27 23:10:45.456112 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ab4d672-f8d5-40da-b738-3551767fb2c9 req-e1f899e2-f8a6-48e0-a4d8-49ba99b10aec service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Received event network-vif-plugged-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:45.456530 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ab4d672-f8d5-40da-b738-3551767fb2c9 req-e1f899e2-f8a6-48e0-a4d8-49ba99b10aec service nova] Acquiring lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:45.456708 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ab4d672-f8d5-40da-b738-3551767fb2c9 req-e1f899e2-f8a6-48e0-a4d8-49ba99b10aec service nova] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:45.456840 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ab4d672-f8d5-40da-b738-3551767fb2c9 req-e1f899e2-f8a6-48e0-a4d8-49ba99b10aec service nova] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:45.456985 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ab4d672-f8d5-40da-b738-3551767fb2c9 req-e1f899e2-f8a6-48e0-a4d8-49ba99b10aec service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Processing event network-vif-plugged-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:10:45.457744 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:10:45.461485 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:10:45.464895 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Instance spawned successfully.
May 27 23:10:45.465281 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:10:45.561621 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:10:45.666782 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Took 1.45 seconds to destroy the instance on the hypervisor.
May 27 23:10:45.667623 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:10:45.668016 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:10:45.668160 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:10:45.668428 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:45.756051 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:45.797111 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:45.801775 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:45.912665 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: 044cb49c-ae45-4a08-ba7a-1717134060e0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:45.971574 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:45.971722 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:45.971990 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:45.973191 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:45.973191 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:45.973191 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:46.068693 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.450s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:46.071602 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.370s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:46.075944 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:10:46.076366 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Claim successful on node np0000001565
May 27 23:10:46.124136 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Deleted allocations for instance f6a3b268-ad24-445e-a58c-b1e35a289f56
May 27 23:10:46.308804 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 27 23:10:46.309378 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923446.3088953, b930b00c-9e48-4185-ac6c-cbbcd61682e8 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:46.309378 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] VM Started (Lifecycle Event)
May 27 23:10:46.477954 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Took 6.58 seconds to spawn the instance on the hypervisor.
May 27 23:10:46.478163 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:46.532015 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-92c074dd-dce2-4cee-98fd-818c2be90895 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating instance to original state: 'active'
May 27 23:10:46.543992 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:46.811515 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:46.813067 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:46.987740 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Took 12.76 seconds to build instance.
May 27 23:10:47.046179 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Took 1.38 seconds to deallocate network for instance.
May 27 23:10:47.123928 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:10:47.136380 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2342653d-86b4-409f-950b-e182e26d3cb6 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "f6a3b268-ad24-445e-a58c-b1e35a289f56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.397s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:47.317567 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923447.3160288, b930b00c-9e48-4185-ac6c-cbbcd61682e8 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:47.317567 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] VM Paused (Lifecycle Event)
May 27 23:10:47.357082 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c68972ee-84e1-42b7-afd4-ab1788ac76e5 req-1a53c215-8372-46bd-89f8-39a1183e96ac service nova] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Received event network-vif-deleted-8ca731b3-122c-49a9-aea1-75b46d5644e1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:47.421461 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:10:47.421637 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:10:47.489325 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.265s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:47.520707 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d7314dd9-5b86-4572-8f6d-d0fe45e1cb82 req-a5ee6837-52d4-4f39-8762-a4447345a76e service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Received event network-vif-plugged-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:47.521114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d7314dd9-5b86-4572-8f6d-d0fe45e1cb82 req-a5ee6837-52d4-4f39-8762-a4447345a76e service nova] Acquiring lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:47.521296 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d7314dd9-5b86-4572-8f6d-d0fe45e1cb82 req-a5ee6837-52d4-4f39-8762-a4447345a76e service nova] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:47.521463 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d7314dd9-5b86-4572-8f6d-d0fe45e1cb82 req-a5ee6837-52d4-4f39-8762-a4447345a76e service nova] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:47.521772 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d7314dd9-5b86-4572-8f6d-d0fe45e1cb82 req-a5ee6837-52d4-4f39-8762-a4447345a76e service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] No waiting events found dispatching network-vif-plugged-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:47.521772 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-d7314dd9-5b86-4572-8f6d-d0fe45e1cb82 req-a5ee6837-52d4-4f39-8762-a4447345a76e service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Received unexpected event network-vif-plugged-fac3e57b-733e-42a5-81a9-b5720d244659 for instance with vm_state active and task_state None.
May 27 23:10:47.551907 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:47.628723 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:47.811203 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:47.811625 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:47.820925 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:47.823502 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923447.823184, b930b00c-9e48-4185-ac6c-cbbcd61682e8 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:47.823659 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] VM Resumed (Lifecycle Event)
May 27 23:10:47.926759 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:10:48.315105 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Detaching volume bd6a5488-3824-4767-9879-bfd2c7abef0e
May 27 23:10:48.327122 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:48.330061 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:48.358868 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Attempting to driver detach volume bd6a5488-3824-4767-9879-bfd2c7abef0e from mountpoint /dev/vdb
May 27 23:10:48.397659 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'attaching', 'instance': 'cae297ad-de9f-4adf-9e00-20b1f926df45', 'attached_at': '2026-05-27T23:10:32.000000', 'detached_at': '', 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'serial': 'bd6a5488-3824-4767-9879-bfd2c7abef0e'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:10:48.401687 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found disk vdb by alias ua-bd6a5488-3824-4767-9879-bfd2c7abef0e {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:10:48.402829 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found disk vdb by alias ua-bd6a5488-3824-4767-9879-bfd2c7abef0e {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:10:48.403020 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Attempting to detach device vdb from instance cae297ad-de9f-4adf-9e00-20b1f926df45 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:10:48.403237 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:10:48.403237 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:10:48.403237 np0000001565 nova-compute[98289]:   <alias name="ua-bd6a5488-3824-4767-9879-bfd2c7abef0e"/>
May 27 23:10:48.403237 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 27 23:10:48.403237 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:10:48.403237 np0000001565 nova-compute[98289]:   <serial>bd6a5488-3824-4767-9879-bfd2c7abef0e</serial>
May 27 23:10:48.403237 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:10:48.403237 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:10:48.403237 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="224d9f97-66ea-40d1-8786-34fd710e5815"/>
May 27 23:10:48.403237 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:10:48.403237 np0000001565 nova-compute[98289]: </disk>
May 27 23:10:48.403237 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:10:48.410236 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully detached device vdb from instance cae297ad-de9f-4adf-9e00-20b1f926df45 from the persistent domain config.
May 27 23:10:48.410514 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] (1/8): Attempting to detach device vdb with device alias ua-bd6a5488-3824-4767-9879-bfd2c7abef0e from instance cae297ad-de9f-4adf-9e00-20b1f926df45 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:10:48.410862 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:10:48.410862 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:10:48.410862 np0000001565 nova-compute[98289]:   <alias name="ua-bd6a5488-3824-4767-9879-bfd2c7abef0e"/>
May 27 23:10:48.410862 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 27 23:10:48.410862 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:10:48.410862 np0000001565 nova-compute[98289]:   <serial>bd6a5488-3824-4767-9879-bfd2c7abef0e</serial>
May 27 23:10:48.410862 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:10:48.410862 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:10:48.410862 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="224d9f97-66ea-40d1-8786-34fd710e5815"/>
May 27 23:10:48.410862 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:10:48.410862 np0000001565 nova-compute[98289]: </disk>
May 27 23:10:48.410862 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:10:48.432972 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.364s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:48.433485 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.881s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:48.433611 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:10:48.737510 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:10:48.737721 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:10:48.809148 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:48.938694 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:10:48.938921 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:10:48.939126 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:48.939586 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:49.011360 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e7c18085c2d4094a1db01b632006296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec81e9dd2444e1a6d54f579a902212', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:10:49.240094 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:10:49.293355 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004528790000222216 future=<Future at 0x726e601ea090 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:49.294151 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Emitting event <LifecycleEvent: 1779923434.2927644, 9caacf98-b127-48ed-ab3e-75fdb2776598 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:49.294466 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:49.294657 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] VM Stopped (Lifecycle Event)
May 27 23:10:49.295746 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.878244081000048 future=<Future at 0x726e605779e0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:49.295979 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.878023414999916 future=<Future at 0x726e605779e0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:49.443590 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:10:49.449709 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-213c1978-e253-4c37-967e-478b0017087d req-dc8927cc-c993-4b7d-a514-b975181990e7 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Received event network-changed-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:49.449924 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-213c1978-e253-4c37-967e-478b0017087d req-dc8927cc-c993-4b7d-a514-b975181990e7 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Refreshing instance network info cache due to event network-changed-fac3e57b-733e-42a5-81a9-b5720d244659. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:10:49.450083 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-213c1978-e253-4c37-967e-478b0017087d req-dc8927cc-c993-4b7d-a514-b975181990e7 service nova] Acquiring lock "refresh_cache-b930b00c-9e48-4185-ac6c-cbbcd61682e8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:49.450173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-213c1978-e253-4c37-967e-478b0017087d req-dc8927cc-c993-4b7d-a514-b975181990e7 service nova] Acquired lock "refresh_cache-b930b00c-9e48-4185-ac6c-cbbcd61682e8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:49.450284 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-213c1978-e253-4c37-967e-478b0017087d req-dc8927cc-c993-4b7d-a514-b975181990e7 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Refreshing network info cache for port fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:10:49.495875 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Successfully created port: da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:10:49.748441 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.315s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:49.751524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.120s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:49.751524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:49.751524 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:10:49.798300 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bc4474f9-1f75-4178-ace5-57b7510c7306 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9caacf98-b127-48ed-ab3e-75fdb2776598] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:49.806552 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Deleted allocations for instance 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46
May 27 23:10:49.945052 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:10:49.955101 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-213c1978-e253-4c37-967e-478b0017087d req-dc8927cc-c993-4b7d-a514-b975181990e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:50.022295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:50.022427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:50.048481 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Successfully updated port: da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:10:50.155610 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:50.279551 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-213c1978-e253-4c37-967e-478b0017087d req-dc8927cc-c993-4b7d-a514-b975181990e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:50.416218 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-213c1978-e253-4c37-967e-478b0017087d req-dc8927cc-c993-4b7d-a514-b975181990e7 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Updated VIF entry in instance network info cache for port fac3e57b-733e-42a5-81a9-b5720d244659. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:10:50.416604 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-213c1978-e253-4c37-967e-478b0017087d req-dc8927cc-c993-4b7d-a514-b975181990e7 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Updating instance_info_cache with network_info: [{"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:50.524281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:10:50.551294 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "refresh_cache-8eb7e5db-7164-4713-86c9-13ed200502f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:50.551294 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquired lock "refresh_cache-8eb7e5db-7164-4713-86c9-13ed200502f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:50.551294 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:10:50.793458 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:50.829776 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-007572aa-be8a-4d34-a628-8fbceddc4f7c tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Lock "92ea712d-1f47-4313-8c9f-6c7a4a5b3c46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.121s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:50.891159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:50.894401 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:50.920288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-213c1978-e253-4c37-967e-478b0017087d req-dc8927cc-c993-4b7d-a514-b975181990e7 service nova] Releasing lock "refresh_cache-b930b00c-9e48-4185-ac6c-cbbcd61682e8" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:50.956358 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:10:50.956711 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:10:50.957089 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Creating image(s)
May 27 23:10:50.957747 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "/opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:50.958042 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "/opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:50.958589 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "/opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:50.959238 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:50.961966 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:50.963154 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.003968 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.012460 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.090795 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.127s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.092415 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:51.092813 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:51.095355 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:51.098724 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:51.099511 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.130368 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:51.130801 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:51.131739 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.133845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.159744 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:10:51.166684 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:10:51.166949 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Claim successful on node np0000001565
May 27 23:10:51.228188 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.128s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.228951 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.247115 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.265167 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.300461 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk 1073741824" returned: 0 in 0.070s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.303794 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:51.303794 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.354616 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.356492 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.392701 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.393623 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:10:51.394073 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.441725 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:51.445476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.446515 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:10:51.453794 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.512555 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.513528 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Cannot resize image /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:10:51.514045 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:10:51.514089 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Ensure instance console log exists: /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:10:51.515578 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:51.515578 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:51.515578 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:51.530082 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6e7ea584-e019-4dfb-b0e5-c6c60a956992 req-df21f159-e15a-4c47-8b5a-a708f611a726 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Received event network-changed-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:51.530654 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6e7ea584-e019-4dfb-b0e5-c6c60a956992 req-df21f159-e15a-4c47-8b5a-a708f611a726 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Refreshing instance network info cache due to event network-changed-da9eb869-313e-4789-9dd2-c1c0cd327b91. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:10:51.530775 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6e7ea584-e019-4dfb-b0e5-c6c60a956992 req-df21f159-e15a-4c47-8b5a-a708f611a726 service nova] Acquiring lock "refresh_cache-8eb7e5db-7164-4713-86c9-13ed200502f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:51.572999 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.573471 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.640151 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Updating instance_info_cache with network_info: [{"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:51.688758 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.693763 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:10:51.695014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:51.746460 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:51.747168 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=12748MB free_disk=73.78229141235352GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:10:51.747347 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:52.147600 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Releasing lock "refresh_cache-8eb7e5db-7164-4713-86c9-13ed200502f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:52.148090 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Instance network_info: |[{"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:10:52.148636 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6e7ea584-e019-4dfb-b0e5-c6c60a956992 req-df21f159-e15a-4c47-8b5a-a708f611a726 service nova] Acquired lock "refresh_cache-8eb7e5db-7164-4713-86c9-13ed200502f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:52.148893 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6e7ea584-e019-4dfb-b0e5-c6c60a956992 req-df21f159-e15a-4c47-8b5a-a708f611a726 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Refreshing network info cache for port da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:10:52.152061 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Start _get_guest_xml network_info=[{"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:10:52.158296 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:10:52.158296 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-861098346', uuid='8eb7e5db-7164-4713-86c9-13ed200502f6'), owner=OwnerMeta(userid='3e7c18085c2d4094a1db01b632006296', username='tempest-SnapshotDataIntegrityTests-1608231940-project-member', projectid='eaec81e9dd2444e1a6d54f579a902212', projectname='tempest-SnapshotDataIntegrityTests-1608231940'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923452.1578398) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:10:52.159977 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:10:52.160344 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:10:52.164878 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:10:52.175960 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:10:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-861098346',display_name='tempest-SnapshotDataIntegrityTests-server-861098346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-snapshotdataintegritytests-server-861098346',id=49,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtEugPB7K35agCukYtiZDkIOF5umW1btKtXA5Od7BX+LOZfjsS9CwxWAbvc0UoZBFP73KmhsQKPN/5eIoUs7ijMTgQePdBd5m5MenAKKYxEQvwsNk4PZOUfarBt/v5AEw==',key_name='tempest-keypair-1366048519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaec81e9dd2444e1a6d54f579a902212',ramdisk_id='',reservation_id='r-d3o6kamn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1608231940',owner_user_name='tempest-SnapshotDataIntegrityTests-1608231940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7c18085c2d4094a1db01b632006296',uuid=8eb7e5db-7164-4713-86c9-13ed200502f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:10:52.176358 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Converting VIF {"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:52.177042 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:34:97,bridge_name='br-int',has_traffic_filtering=True,id=da9eb869-313e-4789-9dd2-c1c0cd327b91,network=Network(fef5d246-ed72-4e47-bf44-75abb4439875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9eb869-31') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:52.177670 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'pci_devices' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:52.262205 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:52.262376 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:52.548128 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:10:52.548612 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:10:52.653951 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-6e7ea584-e019-4dfb-b0e5-c6c60a956992 req-df21f159-e15a-4c47-8b5a-a708f611a726 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:52.681591 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] End _get_guest_xml xml=<domain type="qemu">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <uuid>8eb7e5db-7164-4713-86c9-13ed200502f6</uuid>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <name>instance-00000031</name>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-861098346</nova:name>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:10:52</nova:creationTime>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:user uuid="3e7c18085c2d4094a1db01b632006296">tempest-SnapshotDataIntegrityTests-1608231940-project-member</nova:user>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:project uuid="eaec81e9dd2444e1a6d54f579a902212">tempest-SnapshotDataIntegrityTests-1608231940</nova:project>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         <nova:port uuid="da9eb869-313e-4789-9dd2-c1c0cd327b91">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <system>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <entry name="serial">8eb7e5db-7164-4713-86c9-13ed200502f6</entry>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <entry name="uuid">8eb7e5db-7164-4713-86c9-13ed200502f6</entry>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     </system>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <os>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   </os>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <features>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   </features>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   <devices>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk.config"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:93:34:97"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <target dev="tapda9eb869-31"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     </interface>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/console.log" append="off"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     </serial>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <video>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     </video>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     </rng>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:   </devices>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]: </domain>
May 27 23:10:52.681591 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:10:52.681591 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Preparing to wait for external event network-vif-plugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:10:52.681591 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:52.688871 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:52.688871 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:52.688871 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:10:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-861098346',display_name='tempest-SnapshotDataIntegrityTests-server-861098346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-snapshotdataintegritytests-server-861098346',id=49,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtEugPB7K35agCukYtiZDkIOF5umW1btKtXA5Od7BX+LOZfjsS9CwxWAbvc0UoZBFP73KmhsQKPN/5eIoUs7ijMTgQePdBd5m5MenAKKYxEQvwsNk4PZOUfarBt/v5AEw==',key_name='tempest-keypair-1366048519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaec81e9dd2444e1a6d54f579a902212',ramdisk_id='',reservation_id='r-d3o6kamn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1608231940',owner_user_name='tempest-SnapshotDataIntegrityTests-1608231940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7c18085c2d4094a1db01b632006296',uuid=8eb7e5db-7164-4713-86c9-13ed200502f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:10:52.688871 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Converting VIF {"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:52.688871 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:34:97,bridge_name='br-int',has_traffic_filtering=True,id=da9eb869-313e-4789-9dd2-c1c0cd327b91,network=Network(fef5d246-ed72-4e47-bf44-75abb4439875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9eb869-31') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:52.688871 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:34:97,bridge_name='br-int',has_traffic_filtering=True,id=da9eb869-313e-4789-9dd2-c1c0cd327b91,network=Network(fef5d246-ed72-4e47-bf44-75abb4439875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9eb869-31') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:10:52.688871 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:52.688871 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:52.688871 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:10:52.697052 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:52.697344 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae556626-1d55-5f23-9864-82d11a797066', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:52.700026 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:52.701297 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:52.703590 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:52.703799 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda9eb869-31, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:52.704590 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda9eb869-31, col_values=(('qos', UUID('1feadb50-8d94-4208-bc42-0b2896ab4759')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:52.704854 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda9eb869-31, col_values=(('external_ids', {'iface-id': 'da9eb869-313e-4789-9dd2-c1c0cd327b91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:34:97', 'vm-uuid': '8eb7e5db-7164-4713-86c9-13ed200502f6'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:52.709774 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:52.715239 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:52.717054 np0000001565 nova-compute[98289]: INFO os_vif [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:34:97,bridge_name='br-int',has_traffic_filtering=True,id=da9eb869-313e-4789-9dd2-c1c0cd327b91,network=Network(fef5d246-ed72-4e47-bf44-75abb4439875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9eb869-31')
May 27 23:10:52.768451 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 9e557941-9e16-4157-b760-d9eee26e39ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:53.006779 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-6e7ea584-e019-4dfb-b0e5-c6c60a956992 req-df21f159-e15a-4c47-8b5a-a708f611a726 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:53.053347 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:10:53.146934 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6e7ea584-e019-4dfb-b0e5-c6c60a956992 req-df21f159-e15a-4c47-8b5a-a708f611a726 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Updated VIF entry in instance network info cache for port da9eb869-313e-4789-9dd2-c1c0cd327b91. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:10:53.147652 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-6e7ea584-e019-4dfb-b0e5-c6c60a956992 req-df21f159-e15a-4c47-8b5a-a708f611a726 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Updating instance_info_cache with network_info: [{"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:53.414510 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bd6a5488-3824-4767-9879-bfd2c7abef0e for instance cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:10:53.560551 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.430s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:53.561242 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:10:53.564370 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.817s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:53.650910 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6e7ea584-e019-4dfb-b0e5-c6c60a956992 req-df21f159-e15a-4c47-8b5a-a708f611a726 service nova] Releasing lock "refresh_cache-8eb7e5db-7164-4713-86c9-13ed200502f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:53.774925 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:53.811059 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:54.069199 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:10:54.070099 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:10:54.070503 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:54.074953 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:54.171580 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9df5f69b62834b2caaf76302e55c9707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cb500558784c258720ab29bf2d40fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:10:54.236805 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:54.237015 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:10:54.237184 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No VIF found with MAC fa:16:3e:93:34:97, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:10:54.237767 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Using config drive
May 27 23:10:54.426119 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:54.577481 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:10:54.663819 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance cae297ad-de9f-4adf-9e00-20b1f926df45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:10:54.663923 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 9e557941-9e16-4157-b760-d9eee26e39ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:10:54.664035 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance adac29fa-1144-4721-9ab5-0901535cd08e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:10:54.664151 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance b930b00c-9e48-4185-ac6c-cbbcd61682e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:10:54.664276 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 8eb7e5db-7164-4713-86c9-13ed200502f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:10:54.666681 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 64b32e51-54ce-40c1-b92a-aa92dd7a5132 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:10:54.666681 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:10:54.667467 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:10:51 up 39 min,  2 users,  load average: 6.58, 6.71, 4.44\n', 'num_instances': '6', 'num_vm_active': '4', 'num_task_None': '5', 'num_os_type_None': '6', 'num_proj_8b69ef10bedf41b48b1455ae48aa534e': '1', 'io_workload': '2', 'num_proj_996f2d92ddf941fab9c407482cbb534e': '1', 'num_proj_eceb76118ffc41a281af4ce737b19b88': '1', 'num_proj_199fc687f9c94d22899ca4964c2ea250': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_eaec81e9dd2444e1a6d54f579a902212': '1', 'num_proj_47cb500558784c258720ab29bf2d40fe': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:10:54.733906 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Successfully created port: a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:10:54.750607 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:54.883422 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:54.883668 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:54.883933 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Attaching volume 02ea7a62-7300-4c12-8101-883ddf5fddb0 to /dev/vdb
May 27 23:10:54.940712 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:10:54.950319 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Creating config drive at /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk.config
May 27 23:10:54.957027 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuy_t64wt {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:54.973261 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:10:55.002605 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:55.018652 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuy_t64wt" returned: 0 in 0.059s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:55.057267 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:10:55.057567 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:10:55.069018 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:10:55.070700 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe04:f5be', 'fe80::70b0:20ff:fe1f:52b3', 'fe80::fc16:3eff:fe5f:f9a9', 'fe80::fc16:3eff:fe65:5eff', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::ceb:9eff:fef9:ea15', 'fe80::fc16:3eff:fe5d:72e', 'fe80::e4eb:faff:fe52:9498'] 
May 27 23:10:55.070916 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:10:55.070956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:10:55.071180 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:55.071460 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Updating existing volume attachment record: 55e582f3-1e84-4ed4-a629-507f3a8d9e32 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:10:55.083658 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:10:55.152092 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:10:55.152444 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:10:55.482359 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:55.507040 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:55.511699 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:55.617625 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:55.646454 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:10:55.647518 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02ea7a62-7300-4c12-8101-883ddf5fddb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:10:55.647518 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:55.648159 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:55.648427 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02ea7a62-7300-4c12-8101-883ddf5fddb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:10:55.656534 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:10:55.667966 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:55.670208 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:10:55.671221 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:55.671664 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:10:55.673381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:10:55.673381 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:10:55.687099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:10:55.687099 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:55.694474 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:10:55.694474 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:55.703821 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0] added
May 27 23:10:55.703821 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:10:55.703821 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:55.703821 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:55.703821 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:55.703821 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:55.703821 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:55.703821 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:10:55.704870 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:10:55.704870 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:10:55.709947 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0] added
May 27 23:10:55.709947 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:10:55.709947 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:55.709947 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:55.709947 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:10:55.709947 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:10:55.709947 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:55.710195 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:10:55.710619 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:10:55.710619 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:10:55.847273 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ba33bfc1-36b6-49f1-bef5-4201f827590f req-5074d4ad-22af-4f27-b32b-9e4d489601c8 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Received event network-vif-plugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:55.847612 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ba33bfc1-36b6-49f1-bef5-4201f827590f req-5074d4ad-22af-4f27-b32b-9e4d489601c8 service nova] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:55.847862 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ba33bfc1-36b6-49f1-bef5-4201f827590f req-5074d4ad-22af-4f27-b32b-9e4d489601c8 service nova] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:55.848023 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ba33bfc1-36b6-49f1-bef5-4201f827590f req-5074d4ad-22af-4f27-b32b-9e4d489601c8 service nova] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:55.848146 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ba33bfc1-36b6-49f1-bef5-4201f827590f req-5074d4ad-22af-4f27-b32b-9e4d489601c8 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Processing event network-vif-plugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:10:55.929442 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:55.934032 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:55.962415 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:56.104352 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:10:56.106434 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:10:56.106434 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Creating image(s)
May 27 23:10:56.106808 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "/opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:56.106988 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "/opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:56.107467 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "/opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:56.108306 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:56.111890 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:56.112998 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:56.175280 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:10:56.176556 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.612s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:56.178273 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:10:56.225603 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.113s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:56.226138 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:56.226594 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:56.228081 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:56.232915 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:10:56.232915 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:56.259683 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Successfully updated port: a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:10:56.341623 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.109s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:56.342856 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:56.402816 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk 1073741824" returned: 0 in 0.059s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:56.403377 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:56.403760 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:56.468445 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923456.466219, 8eb7e5db-7164-4713-86c9-13ed200502f6 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:56.468445 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] VM Started (Lifecycle Event)
May 27 23:10:56.469975 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:10:56.474742 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:10:56.478014 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Instance spawned successfully.
May 27 23:10:56.479402 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:10:56.505760 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:56.508994 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:10:56.508994 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:10:56.623594 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:10:56.625649 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Cannot resize image /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:10:56.625649 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:10:56.625649 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Ensure instance console log exists: /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:10:56.625649 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:56.625649 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:56.625649 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:56.679190 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:56.704500 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:10:56.714311 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:10:56.719575 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:10:56.719575 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:10:56.726696 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:10:56.726696 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:56.735368 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:56.746530 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:56.749262 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.749262 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.749262 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:56.749431 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.749431 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.749431 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:56.762756 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.762756 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.762756 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:56.762931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.762931 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.762931 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:56.764807 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "refresh_cache-64b32e51-54ce-40c1-b92a-aa92dd7a5132" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:56.764963 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquired lock "refresh_cache-64b32e51-54ce-40c1-b92a-aa92dd7a5132" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:56.765167 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:10:56.784737 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0, portal: 192.168.50.100,3260]
May 27 23:10:56.784737 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0, portal: 192.168.50.100,3260] successful.
May 27 23:10:56.784737 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:56.799991 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:56.811115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0, portal: 192.168.40.100,3260]
May 27 23:10:56.811115 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0, portal: 192.168.40.100,3260] successful.
May 27 23:10:56.811115 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:56.816147 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.816147 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:10:56.816147 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:10:56.816147 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.816147 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:56.816370 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.816370 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:10:56.816370 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:10:56.816370 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.816370 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:56.816689 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:56.816816 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:10:56.817442 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] HCTL ('9', '-', '-', 0) found on session 101 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:10:56.817559 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:10:56.823319 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:10:56.832567 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching for a device in session 101 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:10:56.832709 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '02ea7a62-7300-4c12-8101-883ddf5fddb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:10:56.840568 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.840568 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:10:56.840568 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:10:56.840568 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.840568 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:10:56.840764 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.840764 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:10:56.840764 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:10:56.840764 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:10:56.840764 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:10:56.841096 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:56.841256 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:10:56.842031 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] HCTL ('10', '-', '-', 0) found on session 102 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:10:56.842163 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:10:56.857231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching for a device in session 102 and hctl ['10', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:10:56.972225 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:56.976444 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:56.997018 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:56.997194 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:56.997543 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:56.997845 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:56.998148 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:57.002425 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:10:57.352351 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:10:57.478527 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:10:57.480000 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923457.478724, 8eb7e5db-7164-4713-86c9-13ed200502f6 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:57.480000 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] VM Paused (Lifecycle Event)
May 27 23:10:57.503951 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:57.513069 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Took 6.56 seconds to spawn the instance on the hypervisor.
May 27 23:10:57.513235 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:57.631968 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Updating instance_info_cache with network_info: [{"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:57.707297 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:57.856940 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching for a device in session 102 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:10:57.857147 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02ea7a62-7300-4c12-8101-883ddf5fddb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:10:57.939661 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Received event network-vif-plugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:57.939863 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:57.940050 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:57.940161 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:57.940274 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] No waiting events found dispatching network-vif-plugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:10:57.943296 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Received unexpected event network-vif-plugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 for instance with vm_state active and task_state None.
May 27 23:10:57.944091 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Received event network-changed-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:57.944091 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Refreshing instance network info cache due to event network-changed-a8d2504a-e7a3-4528-9a2f-a921c508d088. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:10:57.944091 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] Acquiring lock "refresh_cache-64b32e51-54ce-40c1-b92a-aa92dd7a5132" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:57.981375 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:57.983806 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923457.9835663, 8eb7e5db-7164-4713-86c9-13ed200502f6 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:57.984895 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] VM Resumed (Lifecycle Event)
May 27 23:10:58.027376 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Took 13.38 seconds to build instance.
May 27 23:10:58.135433 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Releasing lock "refresh_cache-64b32e51-54ce-40c1-b92a-aa92dd7a5132" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:58.135695 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Instance network_info: |[{"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:10:58.135932 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] Acquired lock "refresh_cache-64b32e51-54ce-40c1-b92a-aa92dd7a5132" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:58.137604 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Start _get_guest_xml network_info=[{"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:10:58.138091 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Refreshing network info cache for port a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:10:58.143977 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:10:58.145958 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1860480735', uuid='64b32e51-54ce-40c1-b92a-aa92dd7a5132'), owner=OwnerMeta(userid='9df5f69b62834b2caaf76302e55c9707', username='tempest-AttachVolumeNegativeTest-1834166666-project-member', projectid='47cb500558784c258720ab29bf2d40fe', projectname='tempest-AttachVolumeNegativeTest-1834166666'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923458.1450934) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:10:58.146703 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:10:58.147071 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:10:58.148558 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:10:58.148829 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:10:58.149745 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:10:58.150351 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:10:58.150603 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:10:58.150762 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:10:58.150940 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:10:58.151106 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:10:58.151264 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:10:58.153347 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:10:58.153347 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:10:58.153347 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:10:58.153347 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:10:58.153347 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:10:58.167888 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1860480735',display_name='tempest-AttachVolumeNegativeTest-server-1860480735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1860480735',id=50,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJz+qqKyGlu3XXJPcwjJfGVM5RcwasLlUfnxv018X6I95kzTB7fampNOBCvq3lMX9/tTYJo9f20MYGv6XabyFuncWLCWDGH2CsOQjUXKa+vBeCOiLy6BgfZB1W25haEbVQ==',key_name='tempest-keypair-988888742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-ly4pyild',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=64b32e51-54ce-40c1-b92a-aa92dd7a5132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:10:58.170986 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:58.170986 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=a8d2504a-e7a3-4528-9a2f-a921c508d088,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d2504a-e7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:58.170986 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'pci_devices' on Instance uuid 64b32e51-54ce-40c1-b92a-aa92dd7a5132 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:58.174422 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004093369998372509 future=<Future at 0x726e605779e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:58.174503 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:58.174630 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=1.4606467610001346 future=<Future at 0x726e582132c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:58.175003 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=1.4602456630000233 future=<Future at 0x726e582132c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:58.175348 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Emitting event <LifecycleEvent: 1779923443.1739163, f6a3b268-ad24-445e-a58c-b1e35a289f56 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:58.175516 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] VM Stopped (Lifecycle Event)
May 27 23:10:58.487191 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:58.490595 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:10:58.528987 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e7dca5a4-2db8-4f49-bd7c-a732e12e7334 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.897s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:58.640276 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:58.675575 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] End _get_guest_xml xml=<domain type="qemu">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <uuid>64b32e51-54ce-40c1-b92a-aa92dd7a5132</uuid>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <name>instance-00000032</name>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1860480735</nova:name>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:10:58</nova:creationTime>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:user uuid="9df5f69b62834b2caaf76302e55c9707">tempest-AttachVolumeNegativeTest-1834166666-project-member</nova:user>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:project uuid="47cb500558784c258720ab29bf2d40fe">tempest-AttachVolumeNegativeTest-1834166666</nova:project>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         <nova:port uuid="a8d2504a-e7a3-4528-9a2f-a921c508d088">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <system>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <entry name="serial">64b32e51-54ce-40c1-b92a-aa92dd7a5132</entry>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <entry name="uuid">64b32e51-54ce-40c1-b92a-aa92dd7a5132</entry>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     </system>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <os>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   </os>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <features>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   </features>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   <devices>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk.config"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     </disk>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:31:5c:79"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <target dev="tapa8d2504a-e7"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     </interface>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/console.log" append="off"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     </serial>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <video>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     </video>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     </rng>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:   </devices>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]: </domain>
May 27 23:10:58.675575 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:10:58.680185 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Preparing to wait for external event network-vif-plugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:10:58.680185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:10:58.680185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:10:58.680185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:10:58.680185 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1860480735',display_name='tempest-AttachVolumeNegativeTest-server-1860480735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1860480735',id=50,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJz+qqKyGlu3XXJPcwjJfGVM5RcwasLlUfnxv018X6I95kzTB7fampNOBCvq3lMX9/tTYJo9f20MYGv6XabyFuncWLCWDGH2CsOQjUXKa+vBeCOiLy6BgfZB1W25haEbVQ==',key_name='tempest-keypair-988888742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-ly4pyild',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:10:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=64b32e51-54ce-40c1-b92a-aa92dd7a5132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:10:58.681651 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:10:58.681651 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=a8d2504a-e7a3-4528-9a2f-a921c508d088,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d2504a-e7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:10:58.681651 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=a8d2504a-e7a3-4528-9a2f-a921c508d088,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d2504a-e7') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:10:58.683450 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:58.683450 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:58.683450 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:10:58.684943 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:58.685121 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5cb9c0f-c3e3-5092-a972-bd3331228cea', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:58.693776 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: f6a3b268-ad24-445e-a58c-b1e35a289f56] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:10:58.695549 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:58.696265 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:58.696362 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:58.698094 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:58.698240 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8d2504a-e7, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:58.698574 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8d2504a-e7, col_values=(('qos', UUID('754c529c-aceb-40ae-8d8e-c452a64a40b3')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:58.698770 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8d2504a-e7, col_values=(('external_ids', {'iface-id': 'a8d2504a-e7a3-4528-9a2f-a921c508d088', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:5c:79', 'vm-uuid': '64b32e51-54ce-40c1-b92a-aa92dd7a5132'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:10:58.699645 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:58.701598 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:10:58.702169 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Found WWN 330000000697e3d83 for multipath device dm-1 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:10:58.702456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.055s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:10:58.703085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] <== connect_volume: return (3055ms) {'type': 'block', 'scsi_wwn': '330000000697e3d83', 'path': '/dev/dm-1', 'multipath_id': '330000000697e3d83'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:10:58.703085 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000697e3d83', 'path': '/dev/dm-1', 'multipath_id': '330000000697e3d83'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:10:58.707002 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:58.707732 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 9e557941-9e16-4157-b760-d9eee26e39ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:10:58.708764 np0000001565 nova-compute[98289]: INFO os_vif [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=a8d2504a-e7a3-4528-9a2f-a921c508d088,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d2504a-e7')
May 27 23:10:58.816099 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:10:59.028912 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:10:59.214047 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Attempting to attach volume 02ea7a62-7300-4c12-8101-883ddf5fddb0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:10:59.215248 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:10:59.215248 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:10:59.215248 np0000001565 nova-compute[98289]:   <alias name="ua-02ea7a62-7300-4c12-8101-883ddf5fddb0"/>
May 27 23:10:59.215248 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-1"/>
May 27 23:10:59.215248 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:10:59.215248 np0000001565 nova-compute[98289]:   <serial>02ea7a62-7300-4c12-8101-883ddf5fddb0</serial>
May 27 23:10:59.215248 np0000001565 nova-compute[98289]: </disk>
May 27 23:10:59.215248 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:10:59.266294 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Updated VIF entry in instance network info cache for port a8d2504a-e7a3-4528-9a2f-a921c508d088. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:10:59.267000 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Updating instance_info_cache with network_info: [{"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:10:59.388265 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8e8dea4d-7720-434c-a28c-525ed1b2d601 req-25d1968d-6e26-430b-8c68-2345c5a8d47e service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Received event network-changed-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:10:59.388430 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8e8dea4d-7720-434c-a28c-525ed1b2d601 req-25d1968d-6e26-430b-8c68-2345c5a8d47e service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Refreshing instance network info cache due to event network-changed-da9eb869-313e-4789-9dd2-c1c0cd327b91. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:10:59.388590 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8e8dea4d-7720-434c-a28c-525ed1b2d601 req-25d1968d-6e26-430b-8c68-2345c5a8d47e service nova] Acquiring lock "refresh_cache-8eb7e5db-7164-4713-86c9-13ed200502f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:10:59.388675 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8e8dea4d-7720-434c-a28c-525ed1b2d601 req-25d1968d-6e26-430b-8c68-2345c5a8d47e service nova] Acquired lock "refresh_cache-8eb7e5db-7164-4713-86c9-13ed200502f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:10:59.388786 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8e8dea4d-7720-434c-a28c-525ed1b2d601 req-25d1968d-6e26-430b-8c68-2345c5a8d47e service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Refreshing network info cache for port da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:10:59.635719 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003915699999197386 future=<Future at 0x726e582132c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:59.636080 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Emitting event <LifecycleEvent: 1779923444.6351814, 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:10:59.636211 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:10:59.636348 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] VM Stopped (Lifecycle Event)
May 27 23:10:59.769001 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f25ab5ca-73d2-4ea8-ac1a-30d6eb69a1b2 req-68e29f35-a91a-450f-a4ad-1b60d1bcc12e service nova] Releasing lock "refresh_cache-64b32e51-54ce-40c1-b92a-aa92dd7a5132" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:10:59.891679 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8e8dea4d-7720-434c-a28c-525ed1b2d601 req-25d1968d-6e26-430b-8c68-2345c5a8d47e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:00.139091 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: 92ea712d-1f47-4313-8c9f-6c7a4a5b3c46] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:00.237325 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:00.237492 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:00.237572 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No VIF found with MAC fa:16:3e:31:5c:79, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:11:00.237921 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Using config drive
May 27 23:11:00.282417 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8e8dea4d-7720-434c-a28c-525ed1b2d601 req-25d1968d-6e26-430b-8c68-2345c5a8d47e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:00.416548 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8e8dea4d-7720-434c-a28c-525ed1b2d601 req-25d1968d-6e26-430b-8c68-2345c5a8d47e service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Updated VIF entry in instance network info cache for port da9eb869-313e-4789-9dd2-c1c0cd327b91. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:11:00.416894 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8e8dea4d-7720-434c-a28c-525ed1b2d601 req-25d1968d-6e26-430b-8c68-2345c5a8d47e service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Updating instance_info_cache with network_info: [{"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:11:00.743801 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:00.883477 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Creating config drive at /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk.config
May 27 23:11:00.888602 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnxz1bf8q {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:00.905097 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:00.905321 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:00.905574 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:00.905759 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No VIF found with MAC fa:16:3e:04:f5:be, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:11:00.920488 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8e8dea4d-7720-434c-a28c-525ed1b2d601 req-25d1968d-6e26-430b-8c68-2345c5a8d47e service nova] Releasing lock "refresh_cache-8eb7e5db-7164-4713-86c9-13ed200502f6" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:11:00.943691 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnxz1bf8q" returned: 0 in 0.055s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:01.391177 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:01.426730 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:01.520899 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:01.604150 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7b659763-64df-4d04-9801-5c495b262850 req-6a417575-c79d-4a8a-a08f-1bf05fa27bd0 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Received event network-vif-plugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:01.604150 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7b659763-64df-4d04-9801-5c495b262850 req-6a417575-c79d-4a8a-a08f-1bf05fa27bd0 service nova] Acquiring lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:01.604150 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7b659763-64df-4d04-9801-5c495b262850 req-6a417575-c79d-4a8a-a08f-1bf05fa27bd0 service nova] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:01.604150 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7b659763-64df-4d04-9801-5c495b262850 req-6a417575-c79d-4a8a-a08f-1bf05fa27bd0 service nova] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:01.604150 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7b659763-64df-4d04-9801-5c495b262850 req-6a417575-c79d-4a8a-a08f-1bf05fa27bd0 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Processing event network-vif-plugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:11:01.787082 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:01.793213 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:01.813827 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:02.264414 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923462.263983, 64b32e51-54ce-40c1-b92a-aa92dd7a5132 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:11:02.264850 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] VM Started (Lifecycle Event)
May 27 23:11:02.266185 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:11:02.270018 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:11:02.274089 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Instance spawned successfully.
May 27 23:11:02.274391 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:11:02.466378 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e1847df4-47a8-42ea-8ea8-277a5db316ba tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.583s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:02.767940 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:02.770521 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:11:02.786617 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:02.786617 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:02.786617 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:02.786617 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:02.786617 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:02.786617 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:03.171106 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:11:03.171503 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:11:03.171734 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:11:03.171983 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:11:03.172233 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:11:03.172467 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:11:03.172650 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:11:03.172767 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:11:03.172987 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.95 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:11:03.273310 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:11:03.273862 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923463.2734222, 64b32e51-54ce-40c1-b92a-aa92dd7a5132 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:11:03.273862 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] VM Paused (Lifecycle Event)
May 27 23:11:03.292260 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Took 7.19 seconds to spawn the instance on the hypervisor.
May 27 23:11:03.292413 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:03.578689 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:03.578689 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:03.681190 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9e001236-6799-4853-b474-f477bb346ead req-4cef45bf-1b3f-45c3-a5b9-46ba1698e297 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Received event network-vif-plugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:03.682361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9e001236-6799-4853-b474-f477bb346ead req-4cef45bf-1b3f-45c3-a5b9-46ba1698e297 service nova] Acquiring lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:03.682361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9e001236-6799-4853-b474-f477bb346ead req-4cef45bf-1b3f-45c3-a5b9-46ba1698e297 service nova] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:03.682361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9e001236-6799-4853-b474-f477bb346ead req-4cef45bf-1b3f-45c3-a5b9-46ba1698e297 service nova] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:03.682361 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9e001236-6799-4853-b474-f477bb346ead req-4cef45bf-1b3f-45c3-a5b9-46ba1698e297 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] No waiting events found dispatching network-vif-plugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:03.682894 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9e001236-6799-4853-b474-f477bb346ead req-4cef45bf-1b3f-45c3-a5b9-46ba1698e297 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Received unexpected event network-vif-plugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 for instance with vm_state active and task_state None.
May 27 23:11:03.700081 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:03.778388 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:03.779797 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923463.7795167, 64b32e51-54ce-40c1-b92a-aa92dd7a5132 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:11:03.779989 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] VM Resumed (Lifecycle Event)
May 27 23:11:03.801791 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Took 12.77 seconds to build instance.
May 27 23:11:03.832620 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:04.081794 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 9e557941-9e16-4157-b760-d9eee26e39ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:04.286138 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:04.291764 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:11:04.303480 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-055a0259-8a79-4204-ac01-b111c6691006 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.281s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:04.520649 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a5836f12-4d61-4d79-a08c-426e48dc2902 req-01deb5f4-18a6-49f9-87f7-968fa16e4855 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Received event network-changed-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:04.521053 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a5836f12-4d61-4d79-a08c-426e48dc2902 req-01deb5f4-18a6-49f9-87f7-968fa16e4855 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Refreshing instance network info cache due to event network-changed-a8d2504a-e7a3-4528-9a2f-a921c508d088. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:11:04.521226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a5836f12-4d61-4d79-a08c-426e48dc2902 req-01deb5f4-18a6-49f9-87f7-968fa16e4855 service nova] Acquiring lock "refresh_cache-64b32e51-54ce-40c1-b92a-aa92dd7a5132" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:11:04.521486 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a5836f12-4d61-4d79-a08c-426e48dc2902 req-01deb5f4-18a6-49f9-87f7-968fa16e4855 service nova] Acquired lock "refresh_cache-64b32e51-54ce-40c1-b92a-aa92dd7a5132" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:11:04.521634 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a5836f12-4d61-4d79-a08c-426e48dc2902 req-01deb5f4-18a6-49f9-87f7-968fa16e4855 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Refreshing network info cache for port a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:11:05.024039 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a5836f12-4d61-4d79-a08c-426e48dc2902 req-01deb5f4-18a6-49f9-87f7-968fa16e4855 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:05.088461 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:05.334526 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a5836f12-4d61-4d79-a08c-426e48dc2902 req-01deb5f4-18a6-49f9-87f7-968fa16e4855 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:05.464863 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a5836f12-4d61-4d79-a08c-426e48dc2902 req-01deb5f4-18a6-49f9-87f7-968fa16e4855 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Updated VIF entry in instance network info cache for port a8d2504a-e7a3-4528-9a2f-a921c508d088. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:11:05.465147 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a5836f12-4d61-4d79-a08c-426e48dc2902 req-01deb5f4-18a6-49f9-87f7-968fa16e4855 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Updating instance_info_cache with network_info: [{"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:11:05.966963 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a5836f12-4d61-4d79-a08c-426e48dc2902 req-01deb5f4-18a6-49f9-87f7-968fa16e4855 service nova] Releasing lock "refresh_cache-64b32e51-54ce-40c1-b92a-aa92dd7a5132" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:11:06.148359 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:06.148560 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:06.148765 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Attaching volume dd1dd2ae-f6c5-4260-a822-e0928f950a72 to /dev/vdc
May 27 23:11:06.202264 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:06.214035 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:11:06.234687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:06.289475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:11:06.289752 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:11:06.299739 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:11:06.301016 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe04:f5be', 'fe80::70b0:20ff:fe1f:52b3', 'fe80::fc16:3eff:fe5f:f9a9', 'fe80::fc16:3eff:fe65:5eff', 'fe80::4cb6:a6ff:feaf:184a', 'fe80::ceb:9eff:fef9:ea15', 'fe80::fc16:3eff:fe5d:72e', 'fe80::e4eb:faff:fe52:9498', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe31:5c79', 'fe80::bc78:52ff:fe4d:ba0f'] 
May 27 23:11:06.301153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:11:06.301268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:11:06.301526 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:06.301797 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Updating existing volume attachment record: 768f7561-8a9d-4e4d-bd30-d2d9fe47ebf8 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:11:06.852208 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:11:06.852599 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:06.852756 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:06.853161 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:06.853350 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:11:06.865644 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:06.866539 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:06.866988 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:06.867166 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:11:06.867908 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:06.868206 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:11:06.880848 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:11:06.880848 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:06.885225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:11:06.885225 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:06.896815 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72] added
May 27 23:11:06.896815 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:11:06.896815 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:06.896815 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:06.896815 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:06.896815 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:06.896815 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:06.897125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:11:06.897297 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:11:06.897530 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:11:06.900478 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72] added
May 27 23:11:06.900478 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:11:06.900478 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:06.900478 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:06.900478 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:06.900478 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:06.900478 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:06.900985 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:11:06.901187 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:11:06.901357 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:11:07.898060 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:11:07.903871 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:11:07.914503 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:11:07.914503 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:11:07.921290 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:11:07.921290 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:07.927753 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:07.936772 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:07.942997 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:07.942997 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:07.942997 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:07.942997 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:07.942997 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:07.943367 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:07.943367 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:07.943367 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:07.943367 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:07.943367 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:07.954009 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:07.954009 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:07.954009 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:07.954009 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:07.954009 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:07.954255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:07.954255 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:07.954255 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:07.954255 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:07.954255 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:07.978961 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72, portal: 192.168.40.100,3260]
May 27 23:11:07.978961 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72, portal: 192.168.40.100,3260] successful.
May 27 23:11:07.978961 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:07.991438 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:08.000856 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72, portal: 192.168.50.100,3260]
May 27 23:11:08.000856 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72, portal: 192.168.50.100,3260] successful.
May 27 23:11:08.000856 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:08.007039 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:08.007039 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:08.007039 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:08.007039 np0000001565 nova-compute[98289]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:08.007039 np0000001565 nova-compute[98289]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:08.007039 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:08.007039 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:08.007291 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:08.007291 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:08.007291 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:08.007291 np0000001565 nova-compute[98289]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:08.007291 np0000001565 nova-compute[98289]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:08.007291 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:08.007291 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:08.007543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:08.007606 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:11:08.008324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] HCTL ('11', '-', '-', 0) found on session 103 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:11:08.008505 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:11:08.016231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:08.023794 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching for a device in session 103 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:08.023794 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:11:08.037043 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:08.037043 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:08.037043 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:08.037043 np0000001565 nova-compute[98289]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:08.037043 np0000001565 nova-compute[98289]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:08.037043 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:08.037043 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:08.037400 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:08.037400 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:08.037400 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:08.037400 np0000001565 nova-compute[98289]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:08.037400 np0000001565 nova-compute[98289]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:08.037400 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:08.037400 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:08.037726 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:08.037886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:11:08.038987 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] HCTL ('12', '-', '-', 0) found on session 104 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:11:08.039105 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:11:08.058124 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Searching for a device in session 104 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:08.058124 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:11:08.702003 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:08.842176 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:08.867738 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:11:09.889698 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Found WWN 3300000000296b357 for multipath device dm-2 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:11:09.889698 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:09.889698 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000000296b357', 'path': '/dev/dm-2', 'multipath_id': '3300000000296b357'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:09.889698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000296b357', 'path': '/dev/dm-2', 'multipath_id': '3300000000296b357'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:11:09.892994 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 9e557941-9e16-4157-b760-d9eee26e39ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:10.397841 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Attempting to attach volume dd1dd2ae-f6c5-4260-a822-e0928f950a72 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:11:10.400031 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:11:10.400031 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:10.400031 np0000001565 nova-compute[98289]:   <alias name="ua-dd1dd2ae-f6c5-4260-a822-e0928f950a72"/>
May 27 23:11:10.400031 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:11:10.400031 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:11:10.400031 np0000001565 nova-compute[98289]:   <serial>dd1dd2ae-f6c5-4260-a822-e0928f950a72</serial>
May 27 23:11:10.400031 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:10.400031 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:11:12.046569 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:12.046569 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:12.046569 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:12.046569 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:12.046569 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] No VIF found with MAC fa:16:3e:04:f5:be, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:11:13.415054 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Waiting for libvirt event about the detach of device vdb with device alias ua-bd6a5488-3824-4767-9879-bfd2c7abef0e from instance cae297ad-de9f-4adf-9e00-20b1f926df45 is timed out.
May 27 23:11:13.416996 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Found disk vdb by alias ua-bd6a5488-3824-4767-9879-bfd2c7abef0e {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:13.417144 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Failed to detach device vdb with device alias ua-bd6a5488-3824-4767-9879-bfd2c7abef0e from instance cae297ad-de9f-4adf-9e00-20b1f926df45 from the live domain config. Libvirt did not report any error but the device is still in the config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2694}}
May 27 23:11:13.417271 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] (2/8): Attempting to detach device vdb with device alias ua-bd6a5488-3824-4767-9879-bfd2c7abef0e from instance cae297ad-de9f-4adf-9e00-20b1f926df45 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:11:13.417576 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:13.417576 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:13.417576 np0000001565 nova-compute[98289]:   <alias name="ua-bd6a5488-3824-4767-9879-bfd2c7abef0e"/>
May 27 23:11:13.417576 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 27 23:11:13.417576 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:13.417576 np0000001565 nova-compute[98289]:   <serial>bd6a5488-3824-4767-9879-bfd2c7abef0e</serial>
May 27 23:11:13.417576 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:11:13.417576 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:11:13.417576 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="224d9f97-66ea-40d1-8786-34fd710e5815"/>
May 27 23:11:13.417576 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:11:13.417576 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:13.417576 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:13.596995 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-16837fd8-0633-4524-8c96-ea57b0754dbc tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.448s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:13.719169 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:13.848410 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:13.953464 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923473.9529877, cae297ad-de9f-4adf-9e00-20b1f926df45 => ua-bd6a5488-3824-4767-9879-bfd2c7abef0e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:11:13.954469 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bd6a5488-3824-4767-9879-bfd2c7abef0e for instance cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:11:13.958073 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully detached device vdb from instance cae297ad-de9f-4adf-9e00-20b1f926df45 from the live domain config.
May 27 23:11:13.960489 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:11:13.960787 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:13.960928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:13.961237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:13.961537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd6a5488-3824-4767-9879-bfd2c7abef0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:11:13.961706 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:11:13.986584 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:13.986584 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:13.986584 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:13.986584 np0000001565 nova-compute[98289]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:13.986584 np0000001565 nova-compute[98289]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:13.986584 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:13.986584 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:13.986961 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:13.986961 np0000001565 nova-compute[98289]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:13.986961 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:13.986961 np0000001565 nova-compute[98289]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:13.986961 np0000001565 nova-compute[98289]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:13.986961 np0000001565 nova-compute[98289]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e (non-flash)
May 27 23:11:13.986961 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:13.986961 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '99')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:11:13.987202 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '99')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:13.988154 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e', '100')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:13.989321 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58134400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'): ({'sdc'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:11:13.989549 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:11:13.989880 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Flush multipath device 330000000b6712bdb {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:11:14.023003 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:14.078572 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:14.119665 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:11:14.120191 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:11:14.120610 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:11:14.132131 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:11:14.132723 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:11:14.144462 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:14.182275 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260]
May 27 23:11:14.182275 np0000001565 nova-compute[98289]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.40.100,3260] successful.
May 27 23:11:14.182275 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:14.196954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:14.207718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:14.243849 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260]
May 27 23:11:14.243849 np0000001565 nova-compute[98289]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-bd6a5488-3824-4767-9879-bfd2c7abef0e, portal: 192.168.50.100,3260] successful.
May 27 23:11:14.243849 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:14.261114 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:14.262115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:14.262291 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] <== disconnect_volume: return (301ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:14.262407 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:11:14.354214 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:14.354451 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:14.808825 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'flavor' on Instance uuid cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:14.856707 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Detaching volume 02ea7a62-7300-4c12-8101-883ddf5fddb0
May 27 23:11:14.900472 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Attempting to driver detach volume 02ea7a62-7300-4c12-8101-883ddf5fddb0 from mountpoint /dev/vdb
May 27 23:11:14.908023 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Found disk vdb by alias ua-02ea7a62-7300-4c12-8101-883ddf5fddb0 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:14.909451 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Found disk vdb by alias ua-02ea7a62-7300-4c12-8101-883ddf5fddb0 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:14.909580 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Attempting to detach device vdb from instance 9e557941-9e16-4157-b760-d9eee26e39ec from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:11:14.909823 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:14.909823 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:14.909823 np0000001565 nova-compute[98289]:   <alias name="ua-02ea7a62-7300-4c12-8101-883ddf5fddb0"/>
May 27 23:11:14.909823 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-1"/>
May 27 23:11:14.909823 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:14.909823 np0000001565 nova-compute[98289]:   <serial>02ea7a62-7300-4c12-8101-883ddf5fddb0</serial>
May 27 23:11:14.909823 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:11:14.909823 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:14.909823 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:14.917477 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully detached device vdb from instance 9e557941-9e16-4157-b760-d9eee26e39ec from the persistent domain config.
May 27 23:11:14.917628 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] (1/8): Attempting to detach device vdb with device alias ua-02ea7a62-7300-4c12-8101-883ddf5fddb0 from instance 9e557941-9e16-4157-b760-d9eee26e39ec from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:11:14.917873 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:14.917873 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:14.917873 np0000001565 nova-compute[98289]:   <alias name="ua-02ea7a62-7300-4c12-8101-883ddf5fddb0"/>
May 27 23:11:14.917873 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-1"/>
May 27 23:11:14.917873 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:14.917873 np0000001565 nova-compute[98289]:   <serial>02ea7a62-7300-4c12-8101-883ddf5fddb0</serial>
May 27 23:11:14.917873 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:11:14.917873 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:14.917873 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:15.472694 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923475.4722805, 9e557941-9e16-4157-b760-d9eee26e39ec => ua-02ea7a62-7300-4c12-8101-883ddf5fddb0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:11:15.474296 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-02ea7a62-7300-4c12-8101-883ddf5fddb0 for instance 9e557941-9e16-4157-b760-d9eee26e39ec {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:11:15.478306 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully detached device vdb from instance 9e557941-9e16-4157-b760-d9eee26e39ec from the live domain config.
May 27 23:11:15.479513 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:11:15.479867 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02ea7a62-7300-4c12-8101-883ddf5fddb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:15.480049 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:15.480451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:15.480802 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '02ea7a62-7300-4c12-8101-883ddf5fddb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:11:15.480961 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:11:15.507305 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:15.507305 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:15.507305 np0000001565 nova-compute[98289]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:15.507305 np0000001565 nova-compute[98289]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:15.507305 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:15.507590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:15.507590 np0000001565 nova-compute[98289]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0 (non-flash)
May 27 23:11:15.507590 np0000001565 nova-compute[98289]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:15.507590 np0000001565 nova-compute[98289]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:15.507590 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:15.507747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', '104')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:11:15.507824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', '102')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:15.508854 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0', '101')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:15.509727 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58137880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0'): ({'sdd'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:11:15.509954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Removing multipathed devices sdd, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:11:15.510235 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flush multipath device 330000000697e3d83 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:11:15.544895 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:15.616260 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:15.657150 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:11:15.657349 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:11:15.658010 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:11:15.670426 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:11:15.671257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:11:15.686448 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:15.715281 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0, portal: 192.168.40.100,3260]
May 27 23:11:15.715281 np0000001565 nova-compute[98289]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0, portal: 192.168.40.100,3260] successful.
May 27 23:11:15.715281 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:15.732895 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:15.743705 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:15.777358 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 101, target: iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0, portal: 192.168.50.100,3260]
May 27 23:11:15.777358 np0000001565 nova-compute[98289]: Logout of [sid: 101, target: iqn.2023-03.storpool.com:os--volume-02ea7a62-7300-4c12-8101-883ddf5fddb0, portal: 192.168.50.100,3260] successful.
May 27 23:11:15.777358 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:15.790090 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:15.790290 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:15.790409 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] <== disconnect_volume: return (310ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:15.790544 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:11:15.813949 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-083d21c2-185f-4311-992c-6bb69037b0ac tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:16.187302 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:16.187302 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:16.187302 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:16.187302 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:16.187302 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:16.188811 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Terminating instance
May 27 23:11:16.352261 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 9e557941-9e16-4157-b760-d9eee26e39ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:16.693000 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:11:16.714249 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:16.724898 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:16.745000 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:16.749617 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:16.771030 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:16.776009 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:16.874233 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f1ce40bd-eaa9-40d5-92bd-6fad58bb675f req-2a24672b-2da6-46db-be7d-77cdc7ad6cc1 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:16.874233 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f1ce40bd-eaa9-40d5-92bd-6fad58bb675f req-2a24672b-2da6-46db-be7d-77cdc7ad6cc1 service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:16.874233 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f1ce40bd-eaa9-40d5-92bd-6fad58bb675f req-2a24672b-2da6-46db-be7d-77cdc7ad6cc1 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:16.874233 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f1ce40bd-eaa9-40d5-92bd-6fad58bb675f req-2a24672b-2da6-46db-be7d-77cdc7ad6cc1 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:16.874233 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f1ce40bd-eaa9-40d5-92bd-6fad58bb675f req-2a24672b-2da6-46db-be7d-77cdc7ad6cc1 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] No waiting events found dispatching network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:16.874233 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f1ce40bd-eaa9-40d5-92bd-6fad58bb675f req-2a24672b-2da6-46db-be7d-77cdc7ad6cc1 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:11:16.952930 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:17.020530 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999708515000293 future=<Future at 0x726e38720080 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:17.020738 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999476168000001 future=<Future at 0x726e38720080 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:17.020832 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999372678000327 future=<Future at 0x726e38720080 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:17.023314 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Instance destroyed successfully.
May 27 23:11:17.024296 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lazy-loading 'resources' on Instance uuid cae297ad-de9f-4adf-9e00-20b1f926df45 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:17.357266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bf1f9b62-6a5a-4fd0-ba7b-38572b9befb2 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:17.526770 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-952310270',display_name='tempest-TestEncryptedCinderVolumes-server-952310270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-952310270',id=42,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeBhqxE20M9Bm677ecVK4Bxso3Be10ZNZMOFKVGpzJiVLkzjgBf1GilnWj8FQLjvLgdCO1az9+IE11uvwD9zV3ZRW3erwfzlyCmPI79SXH2T2Xk/O7n070Zg7gHRisLaQ==',key_name='tempest-keypair-1714797866',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:10:45Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b69ef10bedf41b48b1455ae48aa534e',ramdisk_id='',reservation_id='r-z0h6rwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-762189049',owner_user_name='tempest-TestEncryptedCinderVolumes-762189049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e15e4b45c874974b28db7f3448a3945',uuid=cae297ad-de9f-4adf-9e00-20b1f926df45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:11:17.526976 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converting VIF {"id": "f03578e3-9014-4578-b259-d4577bb95e72", "address": "fa:16:3e:5f:f9:a9", "network": {"id": "4c44828c-cf46-46f6-b466-cbaf1637b0bb", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-87135246-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b69ef10bedf41b48b1455ae48aa534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03578e3-90", "ovs_interfaceid": "f03578e3-9014-4578-b259-d4577bb95e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:11:17.527602 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:11:17.527822 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:11:17.529663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:17.529663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf03578e3-90, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:17.529954 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:17.530941 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:17.531761 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:17.531963 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12fa0e41-8e49-4609-9877-3773f256e5b0) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:17.532499 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:17.533054 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:17.533928 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:17.535363 np0000001565 nova-compute[98289]: INFO os_vif [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f9:a9,bridge_name='br-int',has_traffic_filtering=True,id=f03578e3-9014-4578-b259-d4577bb95e72,network=Network(4c44828c-cf46-46f6-b466-cbaf1637b0bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03578e3-90')
May 27 23:11:17.535659 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Deleting instance files /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45_del
May 27 23:11:17.541291 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Deletion of /opt/stack/data/nova/instances/cae297ad-de9f-4adf-9e00-20b1f926df45_del complete
May 27 23:11:17.674077 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:17.674284 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:18.047444 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Took 1.35 seconds to destroy the instance on the hypervisor.
May 27 23:11:18.048135 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:11:18.048424 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:11:18.048556 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:11:18.048872 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:18.054055 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "adac29fa-1144-4721-9ab5-0901535cd08e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:18.054239 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:18.118762 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:18.176615 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Detaching volume dd1dd2ae-f6c5-4260-a822-e0928f950a72
May 27 23:11:18.213714 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Attempting to driver detach volume dd1dd2ae-f6c5-4260-a822-e0928f950a72 from mountpoint /dev/vdc
May 27 23:11:18.222295 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Found disk vdc by alias ua-dd1dd2ae-f6c5-4260-a822-e0928f950a72 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:18.223477 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Found disk vdc by alias ua-dd1dd2ae-f6c5-4260-a822-e0928f950a72 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:18.223594 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Attempting to detach device vdc from instance 9e557941-9e16-4157-b760-d9eee26e39ec from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:11:18.223794 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:18.223794 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:18.223794 np0000001565 nova-compute[98289]:   <alias name="ua-dd1dd2ae-f6c5-4260-a822-e0928f950a72"/>
May 27 23:11:18.223794 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:11:18.223794 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:11:18.223794 np0000001565 nova-compute[98289]:   <serial>dd1dd2ae-f6c5-4260-a822-e0928f950a72</serial>
May 27 23:11:18.223794 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 23:11:18.223794 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:18.223794 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:18.229504 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully detached device vdc from instance 9e557941-9e16-4157-b760-d9eee26e39ec from the persistent domain config.
May 27 23:11:18.229656 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] (1/8): Attempting to detach device vdc with device alias ua-dd1dd2ae-f6c5-4260-a822-e0928f950a72 from instance 9e557941-9e16-4157-b760-d9eee26e39ec from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:11:18.229911 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:18.229911 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:18.229911 np0000001565 nova-compute[98289]:   <alias name="ua-dd1dd2ae-f6c5-4260-a822-e0928f950a72"/>
May 27 23:11:18.229911 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:11:18.229911 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:11:18.229911 np0000001565 nova-compute[98289]:   <serial>dd1dd2ae-f6c5-4260-a822-e0928f950a72</serial>
May 27 23:11:18.229911 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 23:11:18.229911 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:18.229911 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:18.542159 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-470e6e48-a393-4cc1-968d-c4a1f5c569e5 req-8932dbf6-8edb-416c-a851-4192b9ea069e service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-deleted-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:18.542591 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-470e6e48-a393-4cc1-968d-c4a1f5c569e5 req-8932dbf6-8edb-416c-a851-4192b9ea069e service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Neutron deleted interface f03578e3-9014-4578-b259-d4577bb95e72; detaching it from the instance and deleting it from the info cache
May 27 23:11:18.543979 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-470e6e48-a393-4cc1-968d-c4a1f5c569e5 req-8932dbf6-8edb-416c-a851-4192b9ea069e service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Detach interface failed, port_id=f03578e3-9014-4578-b259-d4577bb95e72, reason: Instance cae297ad-de9f-4adf-9e00-20b1f926df45 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:11:18.557274 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lazy-loading 'flavor' on Instance uuid adac29fa-1144-4721-9ab5-0901535cd08e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:18.705634 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923478.705266, 9e557941-9e16-4157-b760-d9eee26e39ec => ua-dd1dd2ae-f6c5-4260-a822-e0928f950a72> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:11:18.706731 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-dd1dd2ae-f6c5-4260-a822-e0928f950a72 for instance 9e557941-9e16-4157-b760-d9eee26e39ec {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:11:18.708672 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully detached device vdc from instance 9e557941-9e16-4157-b760-d9eee26e39ec from the live domain config.
May 27 23:11:18.709572 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:11:18.709857 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:18.709992 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:18.710288 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:18.710565 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd1dd2ae-f6c5-4260-a822-e0928f950a72', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:11:18.710685 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:11:18.731398 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:18.731398 np0000001565 nova-compute[98289]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:18.731398 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:18.731551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsi session list stdout=tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:18.731551 np0000001565 nova-compute[98289]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72 (non-flash)
May 27 23:11:18.731551 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:18.731640 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', '104')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:11:18.731744 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', '103')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:18.732475 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72', '104')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:18.733030 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e60261f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:11:18.733199 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:11:18.733421 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Flush multipath device 3300000000296b357 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:11:18.769551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:18.822933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:18.855136 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:18.869604 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:11:18.869807 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:11:18.870435 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:11:18.880567 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:11:18.880747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:11:18.890918 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:18.913980 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72, portal: 192.168.40.100,3260]
May 27 23:11:18.913980 np0000001565 nova-compute[98289]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72, portal: 192.168.40.100,3260] successful.
May 27 23:11:18.913980 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:18.926717 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:18.940203 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4b70337d-0c18-48ce-ac75-c9167cf61d52 req-7f0f57cc-6512-4106-9e7d-0f0c8d1f92c0 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:18.940203 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b70337d-0c18-48ce-ac75-c9167cf61d52 req-7f0f57cc-6512-4106-9e7d-0f0c8d1f92c0 service nova] Acquiring lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:18.940203 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b70337d-0c18-48ce-ac75-c9167cf61d52 req-7f0f57cc-6512-4106-9e7d-0f0c8d1f92c0 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:18.940203 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4b70337d-0c18-48ce-ac75-c9167cf61d52 req-7f0f57cc-6512-4106-9e7d-0f0c8d1f92c0 service nova] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:18.940203 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4b70337d-0c18-48ce-ac75-c9167cf61d52 req-7f0f57cc-6512-4106-9e7d-0f0c8d1f92c0 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] No waiting events found dispatching network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:18.940203 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4b70337d-0c18-48ce-ac75-c9167cf61d52 req-7f0f57cc-6512-4106-9e7d-0f0c8d1f92c0 service nova] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Received event network-vif-unplugged-f03578e3-9014-4578-b259-d4577bb95e72 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:11:18.940748 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:18.972295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72, portal: 192.168.50.100,3260]
May 27 23:11:18.972295 np0000001565 nova-compute[98289]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-dd1dd2ae-f6c5-4260-a822-e0928f950a72, portal: 192.168.50.100,3260] successful.
May 27 23:11:18.972295 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:18.983167 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:18.983404 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:18.983524 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] <== disconnect_volume: return (273ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:18.983635 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:11:18.988054 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:11:19.059879 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Ignoring supplied device name: /dev/vdb
May 27 23:11:19.489765 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Took 1.44 seconds to deallocate network for instance.
May 27 23:11:19.549675 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'flavor' on Instance uuid 9e557941-9e16-4157-b760-d9eee26e39ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:19.562159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:19.995228 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:19.995403 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:20.311619 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:11:20.312263 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:11:20.555020 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d7889060-7d70-4b2d-83c7-e0f587450599 tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.881s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:20.637863 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "adac29fa-1144-4721-9ab5-0901535cd08e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:20.637863 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:20.638097 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Attaching volume 503d084e-24a9-4571-98d6-89bda0b2dfd1 to /dev/vdb
May 27 23:11:20.689418 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:20.701229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:11:20.722838 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:20.771095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:11:20.771714 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:11:20.784249 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:11:20.785729 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe04:f5be', 'fe80::70b0:20ff:fe1f:52b3', 'fe80::fc16:3eff:fe65:5eff', 'fe80::ceb:9eff:fef9:ea15', 'fe80::fc16:3eff:fe5d:72e', 'fe80::e4eb:faff:fe52:9498', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe31:5c79', 'fe80::bc78:52ff:fe4d:ba0f'] 
May 27 23:11:20.785863 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:11:20.786006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:11:20.786383 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:20.786719 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Updating existing volume attachment record: 407df208-2332-4b70-8ff0-2331cdb5cc61 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:11:20.818514 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:11:21.088409 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:21.088606 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:21.088810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:21.088969 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:21.089132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:21.091802 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Terminating instance
May 27 23:11:21.330363 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.333s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:21.344068 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:11:21.344760 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '503d084e-24a9-4571-98d6-89bda0b2dfd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:21.344760 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:21.344902 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:21.345017 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '503d084e-24a9-4571-98d6-89bda0b2dfd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:11:21.361107 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:21.361107 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:21.361316 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:21.361440 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:11:21.361846 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:21.362060 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:11:21.372810 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:11:21.372810 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:21.374213 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:11:21.374213 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:21.384356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1] added
May 27 23:11:21.384356 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:11:21.384356 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:21.384356 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:21.384356 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:21.384356 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:21.384356 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:21.384692 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:11:21.385072 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0233(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:11:21.385072 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:11:21.386573 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1] added
May 27 23:11:21.386573 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:11:21.386573 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:21.386573 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:21.386573 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:21.386573 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:21.386573 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:21.386808 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:11:21.387532 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:11:21.387532 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:11:21.388666 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Deleted allocations for instance cae297ad-de9f-4adf-9e00-20b1f926df45
May 27 23:11:21.595155 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:11:21.625938 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:21.628582 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:21.660937 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:21.662704 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:21.686001 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:21.773690 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e74dffef-0a22-4604-a48b-6524be2242fd req-9c360862-ada8-49ee-b9c7-b593114877a7 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Received event network-vif-unplugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:21.774401 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e74dffef-0a22-4604-a48b-6524be2242fd req-9c360862-ada8-49ee-b9c7-b593114877a7 service nova] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:21.774401 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e74dffef-0a22-4604-a48b-6524be2242fd req-9c360862-ada8-49ee-b9c7-b593114877a7 service nova] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:21.774401 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e74dffef-0a22-4604-a48b-6524be2242fd req-9c360862-ada8-49ee-b9c7-b593114877a7 service nova] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:21.774401 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e74dffef-0a22-4604-a48b-6524be2242fd req-9c360862-ada8-49ee-b9c7-b593114877a7 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] No waiting events found dispatching network-vif-unplugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:21.774673 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e74dffef-0a22-4604-a48b-6524be2242fd req-9c360862-ada8-49ee-b9c7-b593114877a7 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Received event network-vif-unplugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:11:21.917039 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99973507300001 future=<Future at 0x726e581b7680 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:21.918894 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Instance destroyed successfully.
May 27 23:11:21.919278 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lazy-loading 'resources' on Instance uuid 9e557941-9e16-4157-b760-d9eee26e39ec {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:22.385348 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:11:22.388513 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:11:22.398235 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:11:22.398235 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:22.401625 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e84cc8a2-8d59-4c23-a519-4106ae9253e5 tempest-TestEncryptedCinderVolumes-762189049 tempest-TestEncryptedCinderVolumes-762189049-project-member] Lock "cae297ad-de9f-4adf-9e00-20b1f926df45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.213s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:11:22.403723 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:11:22.403723 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:22.409324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:22.414552 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:22.421320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:11:22.421320 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:22.422487 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-517241571',display_name='tempest-AttachVolumeTestJSON-server-517241571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumetestjson-server-517241571',id=46,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu3Hy4n1Qe3drZc8BKjC3ofE4AAzB7ZsO2Mr8aOGpvFm8OD7BrAAXnFyNEf1eUeAZPTPOy/I74/GlMLq6IWAUfi75wTIC1Yq67Nta3lr5J6oUi23mt7H4t8iazoTJ9BEw==',key_name='tempest-keypair-1545727976',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:10:13Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='996f2d92ddf941fab9c407482cbb534e',ramdisk_id='',reservation_id='r-7f8run0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-849627440',owner_user_name='tempest-AttachVolumeTestJSON-849627440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9258fd0841dca06d0184677f7376',uuid=9e557941-9e16-4157-b760-d9eee26e39ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "address": "fa:16:3e:04:f5:be", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a75c3c-cd", "ovs_interfaceid": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:11:22.422731 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:11:22.422731 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:22.422979 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converting VIF {"id": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "address": "fa:16:3e:04:f5:be", "network": {"id": "475e9147-f245-4f4a-8c62-d322b50e08ee", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1261287389-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "996f2d92ddf941fab9c407482cbb534e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a75c3c-cd", "ovs_interfaceid": "49a75c3c-cddc-4e3a-a67f-2c443a3bebf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:11:22.423765 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:11:22.423765 np0000001565 nova-compute[98289]: 
May 27 23:11:22.423920 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:f5:be,bridge_name='br-int',has_traffic_filtering=True,id=49a75c3c-cddc-4e3a-a67f-2c443a3bebf4,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a75c3c-cd') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:11:22.424182 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f5:be,bridge_name='br-int',has_traffic_filtering=True,id=49a75c3c-cddc-4e3a-a67f-2c443a3bebf4,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a75c3c-cd') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:11:22.428907 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:22.429383 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:11:22.429383 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:22.429519 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49a75c3c-cd, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:22.430064 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:11:22.430064 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:22.430190 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:11:22.430190 np0000001565 nova-compute[98289]: 
May 27 23:11:22.430519 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:22.431969 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:22.432754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:22.432889 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab9e8754-d1b2-4a8f-9632-04a53f011d45) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:22.433572 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:22.433979 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:22.435195 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:22.438785 np0000001565 nova-compute[98289]: INFO os_vif [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f5:be,bridge_name='br-int',has_traffic_filtering=True,id=49a75c3c-cddc-4e3a-a67f-2c443a3bebf4,network=Network(475e9147-f245-4f4a-8c62-d322b50e08ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a75c3c-cd')
May 27 23:11:22.438785 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Deleting instance files /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec_del
May 27 23:11:22.439436 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Deletion of /opt/stack/data/nova/instances/9e557941-9e16-4157-b760-d9eee26e39ec_del complete
May 27 23:11:22.455054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, portal: 192.168.40.100,3260]
May 27 23:11:22.455054 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, portal: 192.168.40.100,3260] successful.
May 27 23:11:22.455054 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:22.465271 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:22.469475 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, portal: 192.168.50.100,3260]
May 27 23:11:22.469475 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, portal: 192.168.50.100,3260] successful.
May 27 23:11:22.469475 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:22.478076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:22.478076 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:22.478076 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:22.478217 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:22.478217 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:22.478217 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:22.478888 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.117s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:22.478888 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:11:22.479780 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:22.480355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] HCTL ('7', '-', '-', 0) found on session 105 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:11:22.480355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:11:22.491629 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:22.491629 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:22.491629 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:22.491892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:22.491892 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:22.491892 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:22.492206 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:22.495933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:11:22.495933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] HCTL ('8', '-', '-', 0) found on session 106 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:11:22.495933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:11:22.495933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Searching for a device in session 105 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:22.495933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '503d084e-24a9-4571-98d6-89bda0b2dfd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:11:22.511625 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Searching for a device in session 106 and hctl ['8', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:22.944766 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Took 1.35 seconds to destroy the instance on the hypervisor.
May 27 23:11:22.945413 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:11:22.945771 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:11:22.945926 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:11:22.946247 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:23.013123 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:23.509354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Searching for a device in session 106 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:23.509734 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '503d084e-24a9-4571-98d6-89bda0b2dfd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:11:23.823545 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4c3aea93-f171-4385-95fc-7d8f2e07633f req-2dbb2a90-5348-4fd2-bf1b-6b9880fc76a4 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Received event network-vif-unplugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:23.824031 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4c3aea93-f171-4385-95fc-7d8f2e07633f req-2dbb2a90-5348-4fd2-bf1b-6b9880fc76a4 service nova] Acquiring lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:23.824198 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4c3aea93-f171-4385-95fc-7d8f2e07633f req-2dbb2a90-5348-4fd2-bf1b-6b9880fc76a4 service nova] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:23.824321 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4c3aea93-f171-4385-95fc-7d8f2e07633f req-2dbb2a90-5348-4fd2-bf1b-6b9880fc76a4 service nova] Lock "9e557941-9e16-4157-b760-d9eee26e39ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:23.824483 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4c3aea93-f171-4385-95fc-7d8f2e07633f req-2dbb2a90-5348-4fd2-bf1b-6b9880fc76a4 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] No waiting events found dispatching network-vif-unplugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:23.824645 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4c3aea93-f171-4385-95fc-7d8f2e07633f req-2dbb2a90-5348-4fd2-bf1b-6b9880fc76a4 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Received event network-vif-unplugged-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:11:23.824724 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4c3aea93-f171-4385-95fc-7d8f2e07633f req-2dbb2a90-5348-4fd2-bf1b-6b9880fc76a4 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Received event network-vif-deleted-49a75c3c-cddc-4e3a-a67f-2c443a3bebf4 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:23.824818 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-4c3aea93-f171-4385-95fc-7d8f2e07633f req-2dbb2a90-5348-4fd2-bf1b-6b9880fc76a4 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Neutron deleted interface 49a75c3c-cddc-4e3a-a67f-2c443a3bebf4; detaching it from the instance and deleting it from the info cache
May 27 23:11:23.826261 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4c3aea93-f171-4385-95fc-7d8f2e07633f req-2dbb2a90-5348-4fd2-bf1b-6b9880fc76a4 service nova] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Detach interface failed, port_id=49a75c3c-cddc-4e3a-a67f-2c443a3bebf4, reason: Instance 9e557941-9e16-4157-b760-d9eee26e39ec could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:11:23.874086 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:11:23.877270 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:24.196599 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:24.197428 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:24.376303 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Found WWN 33000000084d23e44 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:11:24.376578 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:24.377003 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '33000000084d23e44', 'path': '/dev/dm-0', 'multipath_id': '33000000084d23e44'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:24.377164 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000084d23e44', 'path': '/dev/dm-0', 'multipath_id': '33000000084d23e44'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:11:24.377445 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Took 1.43 seconds to deallocate network for instance.
May 27 23:11:24.382550 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lazy-loading 'flavor' on Instance uuid adac29fa-1144-4721-9ab5-0901535cd08e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:24.700198 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lazy-loading 'flavor' on Instance uuid b930b00c-9e48-4185-ac6c-cbbcd61682e8 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:24.884764 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:24.886164 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Attempting to attach volume 503d084e-24a9-4571-98d6-89bda0b2dfd1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:11:24.886392 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:24.888545 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:11:24.888545 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:24.888545 np0000001565 nova-compute[98289]:   <alias name="ua-503d084e-24a9-4571-98d6-89bda0b2dfd1"/>
May 27 23:11:24.888545 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:11:24.888545 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:24.888545 np0000001565 nova-compute[98289]:   <serial>503d084e-24a9-4571-98d6-89bda0b2dfd1</serial>
May 27 23:11:24.888545 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:24.888545 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:11:25.140507 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:11:25.140694 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:11:25.202699 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Ignoring supplied device name: /dev/vdb
May 27 23:11:25.643347 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:11:25.704711 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:26.007034 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:26.153925 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.268s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:26.215993 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Deleted allocations for instance 9e557941-9e16-4157-b760-d9eee26e39ec
May 27 23:11:26.546099 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:26.546255 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:26.546373 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:26.546734 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No VIF found with MAC fa:16:3e:65:5e:ff, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:11:26.802980 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:26.803311 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:26.803311 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Attaching volume 4a95e1fe-48f6-4a96-9519-2042b507b4ab to /dev/vdb
May 27 23:11:26.840795 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:26.850772 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:11:26.870144 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:26.911839 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:11:26.912185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:11:26.920771 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:11:26.921873 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe65:5eff', 'fe80::ceb:9eff:fef9:ea15', 'fe80::fc16:3eff:fe5d:72e', 'fe80::e4eb:faff:fe52:9498', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe31:5c79', 'fe80::bc78:52ff:fe4d:ba0f'] 
May 27 23:11:26.922015 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:11:26.922070 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:11:26.922530 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:26.922530 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Updating existing volume attachment record: 388031a6-1e98-4a9d-b8fe-0462971dad96 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:11:27.228276 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d10bae1-934e-4a73-beca-4b3533fc22fb tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Lock "9e557941-9e16-4157-b760-d9eee26e39ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.139s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:27.434687 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:27.467145 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:11:27.467510 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:27.467661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:27.468068 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:27.468235 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:11:27.479443 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:27.480641 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:27.481193 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:27.481385 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:11:27.481689 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:27.481926 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:11:27.492324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:11:27.492324 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:27.497483 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:11:27.497483 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:27.504092 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab] added
May 27 23:11:27.504092 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:11:27.504092 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:27.504092 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:27.504092 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:27.504092 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:27.504092 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:27.504393 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:11:27.504504 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:11:27.504677 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:11:27.509203 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab] added
May 27 23:11:27.509203 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:11:27.509203 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:27.509203 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:27.509203 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:27.509203 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:27.509203 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:27.509514 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:11:27.509514 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:11:27.509603 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:11:27.687355 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:28.117163 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9416b902-c501-458e-9926-00febd71eb48 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.479s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:28.505136 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:11:28.510042 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:11:28.523467 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:11:28.523467 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:11:28.533773 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:11:28.533773 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:28.538873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:28.545312 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:28.550551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.550551 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.550551 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:28.550712 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.550712 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.550712 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:28.556932 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.556932 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.556932 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:28.557092 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.557092 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.557092 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:28.584729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab, portal: 192.168.40.100,3260]
May 27 23:11:28.584729 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab, portal: 192.168.40.100,3260] successful.
May 27 23:11:28.584729 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:28.597882 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:28.607542 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab, portal: 192.168.50.100,3260]
May 27 23:11:28.607542 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab, portal: 192.168.50.100,3260] successful.
May 27 23:11:28.607542 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:28.614514 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.614514 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.614514 np0000001565 nova-compute[98289]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:28.614514 np0000001565 nova-compute[98289]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:28.614514 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:28.614706 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.614706 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.614706 np0000001565 nova-compute[98289]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:28.614706 np0000001565 nova-compute[98289]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:28.614706 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:28.615077 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:28.615173 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:11:28.615825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] HCTL ('9', '-', '-', 0) found on session 107 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:11:28.615976 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:11:28.620643 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:28.629138 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Searching for a device in session 107 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:28.629311 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:11:28.636128 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.636128 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.636128 np0000001565 nova-compute[98289]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:28.636128 np0000001565 nova-compute[98289]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:28.636128 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:28.636323 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.636323 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:28.636323 np0000001565 nova-compute[98289]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:28.636323 np0000001565 nova-compute[98289]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:28.636323 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:28.636649 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:28.636795 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:11:28.637518 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] HCTL ('10', '-', '-', 0) found on session 108 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:11:28.637670 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:11:28.654000 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Searching for a device in session 108 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:28.654236 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:11:28.887015 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:29.481778 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:11:30.498649 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Found WWN 330000000781e8f0e for multipath device dm-3 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:11:30.498954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:30.499049 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000781e8f0e', 'path': '/dev/dm-3', 'multipath_id': '330000000781e8f0e'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:30.499139 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000781e8f0e', 'path': '/dev/dm-3', 'multipath_id': '330000000781e8f0e'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:11:30.512566 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lazy-loading 'flavor' on Instance uuid b930b00c-9e48-4185-ac6c-cbbcd61682e8 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:31.015967 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Attempting to attach volume 4a95e1fe-48f6-4a96-9519-2042b507b4ab with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:11:31.017428 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:11:31.017428 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:31.017428 np0000001565 nova-compute[98289]:   <alias name="ua-4a95e1fe-48f6-4a96-9519-2042b507b4ab"/>
May 27 23:11:31.017428 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:11:31.017428 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:31.017428 np0000001565 nova-compute[98289]:   <serial>4a95e1fe-48f6-4a96-9519-2042b507b4ab</serial>
May 27 23:11:31.017428 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:31.017428 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:11:31.124823 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:32.020676 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00043276999986119336 future=<Future at 0x726e38720080 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:32.021542 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Emitting event <LifecycleEvent: 1779923477.0201302, cae297ad-de9f-4adf-9e00-20b1f926df45 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:11:32.022409 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:32.022629 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] VM Stopped (Lifecycle Event)
May 27 23:11:32.023705 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=4.893033030999959 future=<Future at 0x726e581b7680 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:32.023824 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=4.892922346999967 future=<Future at 0x726e581b7680 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:32.435839 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:32.525615 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: cae297ad-de9f-4adf-9e00-20b1f926df45] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:32.678676 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:32.678803 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:32.678896 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:32.679008 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] No VIF found with MAC fa:16:3e:5d:07:2e, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:11:32.764237 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:32.773920 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:33.888893 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:34.223946 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cd30d6be-acfb-47c3-a797-b62c9df05773 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.421s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:34.284228 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Received event volume-extended-4a95e1fe-48f6-4a96-9519-2042b507b4ab {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:34.785871 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Handling volume-extended event for volume 4a95e1fe-48f6-4a96-9519-2042b507b4ab {{(pid=98289) extend_volume /opt/stack/nova/nova/compute/manager.py:11836}}
May 27 23:11:35.172979 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:35.191013 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "adac29fa-1144-4721-9ab5-0901535cd08e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:35.191203 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:35.259238 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "adac29fa-1144-4721-9ab5-0901535cd08e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:35.290166 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Cinder extended volume 4a95e1fe-48f6-4a96-9519-2042b507b4ab; extending it to detect new size
May 27 23:11:35.693694 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Detaching volume 503d084e-24a9-4571-98d6-89bda0b2dfd1
May 27 23:11:35.730579 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Attempting to driver detach volume 503d084e-24a9-4571-98d6-89bda0b2dfd1 from mountpoint /dev/vdb
May 27 23:11:35.734519 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Found disk vdb by alias ua-503d084e-24a9-4571-98d6-89bda0b2dfd1 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:35.735618 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Found disk vdb by alias ua-503d084e-24a9-4571-98d6-89bda0b2dfd1 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:35.735766 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Attempting to detach device vdb from instance adac29fa-1144-4721-9ab5-0901535cd08e from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:11:35.735957 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:35.735957 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:35.735957 np0000001565 nova-compute[98289]:   <alias name="ua-503d084e-24a9-4571-98d6-89bda0b2dfd1"/>
May 27 23:11:35.735957 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:11:35.735957 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:35.735957 np0000001565 nova-compute[98289]:   <serial>503d084e-24a9-4571-98d6-89bda0b2dfd1</serial>
May 27 23:11:35.735957 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:11:35.735957 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:35.735957 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:35.740978 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Successfully detached device vdb from instance adac29fa-1144-4721-9ab5-0901535cd08e from the persistent domain config.
May 27 23:11:35.741111 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] (1/8): Attempting to detach device vdb with device alias ua-503d084e-24a9-4571-98d6-89bda0b2dfd1 from instance adac29fa-1144-4721-9ab5-0901535cd08e from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:11:35.741326 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:35.741326 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:35.741326 np0000001565 nova-compute[98289]:   <alias name="ua-503d084e-24a9-4571-98d6-89bda0b2dfd1"/>
May 27 23:11:35.741326 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:11:35.741326 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:35.741326 np0000001565 nova-compute[98289]:   <serial>503d084e-24a9-4571-98d6-89bda0b2dfd1</serial>
May 27 23:11:35.741326 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:11:35.741326 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:35.741326 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:35.825060 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] calling os-brick to extend iSCSI Volume {{(pid=98289) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 27 23:11:35.825448 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}), 'kwargs': {}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:35.825874 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:35.826260 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:35.826604 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}
May 27 23:11:35.826758 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Multipath discovery for iSCSI enabled
May 27 23:11:35.826947 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab-lun-0']
May 27 23:11:35.827094 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab-lun-0'] {{(pid=98289) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 27 23:11:35.846899 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab-lun-0'] {{(pid=98289) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 27 23:11:35.847120 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Running cmd (subprocess): lsscsi {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:35.903569 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] CMD "lsscsi" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:35.904295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab-lun-0', 'host': '9', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98289) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 27 23:11:35.904512 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab-lun-0', 'host': '9', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98289) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 27 23:11:35.914147 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Starting size: 1073741824 {{(pid=98289) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 27 23:11:35.947397 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] volume size after scsi device rescan 2147483648 {{(pid=98289) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 27 23:11:35.947397 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Running cmd (subprocess): lsscsi {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:36.011290 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] CMD "lsscsi" returned: 0 in 0.064s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:36.011999 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98289) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 27 23:11:36.012293 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98289) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 27 23:11:36.025790 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Starting size: 1073741824 {{(pid=98289) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 27 23:11:36.057497 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] volume size after scsi device rescan 2147483648 {{(pid=98289) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 27 23:11:36.071774 np0000001565 nova-compute[98289]: INFO os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Find Multipath device file for volume WWN 330000000781e8f0e
May 27 23:11:36.072733 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-330000000781e8f0e exists yet. {{(pid=98289) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 27 23:11:36.072948 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] /dev/disk/by-id/dm-uuid-mpath-330000000781e8f0e has shown up. {{(pid=98289) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 27 23:11:36.096796 np0000001565 nova-compute[98289]: INFO os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000781e8f0e) current size 1073741824
May 27 23:11:36.134773 np0000001565 nova-compute[98289]: INFO os_brick.initiator.linuxscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000781e8f0e) new size 2147483648
May 27 23:11:36.135081 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.309s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:36.135252 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] <== extend_volume: return (309ms) 2147483648 {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:36.135471 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Extend iSCSI Volume: new_size=2147483648 {{(pid=98289) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 27 23:11:36.140089 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [req-0a581f62-4a87-4bad-8931-5406c7eb4044 req-0515f8f1-beba-4bbb-a9bf-68f377f34cd0 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Resizing target device /dev/dm-3 to 2147483648 {{(pid=98289) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 27 23:11:36.235967 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923496.2355049, adac29fa-1144-4721-9ab5-0901535cd08e => ua-503d084e-24a9-4571-98d6-89bda0b2dfd1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:11:36.237030 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-503d084e-24a9-4571-98d6-89bda0b2dfd1 for instance adac29fa-1144-4721-9ab5-0901535cd08e {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:11:36.240771 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Successfully detached device vdb from instance adac29fa-1144-4721-9ab5-0901535cd08e from the live domain config.
May 27 23:11:36.242015 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:11:36.242376 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '503d084e-24a9-4571-98d6-89bda0b2dfd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:36.242521 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:36.242894 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:36.243172 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '503d084e-24a9-4571-98d6-89bda0b2dfd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:11:36.243301 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:11:36.267876 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:36.267876 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:36.267876 np0000001565 nova-compute[98289]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:36.267876 np0000001565 nova-compute[98289]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:36.267876 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:36.268090 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:36.268090 np0000001565 nova-compute[98289]: tcp: [106] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1 (non-flash)
May 27 23:11:36.268090 np0000001565 nova-compute[98289]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:36.268090 np0000001565 nova-compute[98289]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:36.268090 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:36.268247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', '108')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:11:36.268247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', '105')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:36.269087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', '106')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:36.269739 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e605811c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1'): ({'sdc'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:11:36.269924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:11:36.270121 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Flush multipath device 33000000084d23e44 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:11:36.333666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:36.379716 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:36.425854 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:11:36.426022 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:11:36.426757 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:11:36.436811 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:11:36.437100 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:11:36.446384 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:36.474087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, portal: 192.168.40.100,3260]
May 27 23:11:36.474087 np0000001565 nova-compute[98289]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, portal: 192.168.40.100,3260] successful.
May 27 23:11:36.474087 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:36.489282 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:36.501518 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:36.533345 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, portal: 192.168.50.100,3260]
May 27 23:11:36.533345 np0000001565 nova-compute[98289]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, portal: 192.168.50.100,3260] successful.
May 27 23:11:36.533345 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:36.545482 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:36.545756 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:36.545902 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] <== disconnect_volume: return (303ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:36.546050 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:11:36.917184 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00041134499997497187 future=<Future at 0x726e581b7680 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:36.917831 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Emitting event <LifecycleEvent: 1779923481.9166613, 9e557941-9e16-4157-b760-d9eee26e39ec => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:11:36.917831 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:36.917831 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] VM Stopped (Lifecycle Event)
May 27 23:11:36.985348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:36.985557 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:37.111290 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lazy-loading 'flavor' on Instance uuid adac29fa-1144-4721-9ab5-0901535cd08e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:37.420893 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: 9e557941-9e16-4157-b760-d9eee26e39ec] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:37.436873 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:37.487931 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Detaching volume 4a95e1fe-48f6-4a96-9519-2042b507b4ab
May 27 23:11:37.537810 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Attempting to driver detach volume 4a95e1fe-48f6-4a96-9519-2042b507b4ab from mountpoint /dev/vdb
May 27 23:11:37.542247 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Found disk vdb by alias ua-4a95e1fe-48f6-4a96-9519-2042b507b4ab {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:37.543592 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Found disk vdb by alias ua-4a95e1fe-48f6-4a96-9519-2042b507b4ab {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:37.543697 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Attempting to detach device vdb from instance b930b00c-9e48-4185-ac6c-cbbcd61682e8 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:11:37.544088 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:37.544088 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:37.544088 np0000001565 nova-compute[98289]:   <alias name="ua-4a95e1fe-48f6-4a96-9519-2042b507b4ab"/>
May 27 23:11:37.544088 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:11:37.544088 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:37.544088 np0000001565 nova-compute[98289]:   <serial>4a95e1fe-48f6-4a96-9519-2042b507b4ab</serial>
May 27 23:11:37.544088 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:11:37.544088 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:37.544088 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:37.550479 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Successfully detached device vdb from instance b930b00c-9e48-4185-ac6c-cbbcd61682e8 from the persistent domain config.
May 27 23:11:37.550536 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] (1/8): Attempting to detach device vdb with device alias ua-4a95e1fe-48f6-4a96-9519-2042b507b4ab from instance b930b00c-9e48-4185-ac6c-cbbcd61682e8 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:11:37.550924 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:37.550924 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:37.550924 np0000001565 nova-compute[98289]:   <alias name="ua-4a95e1fe-48f6-4a96-9519-2042b507b4ab"/>
May 27 23:11:37.550924 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:11:37.550924 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:37.550924 np0000001565 nova-compute[98289]:   <serial>4a95e1fe-48f6-4a96-9519-2042b507b4ab</serial>
May 27 23:11:37.550924 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:11:37.550924 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:37.550924 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:37.723138 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:37.723571 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:37.888445 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:38.019619 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923498.0191886, b930b00c-9e48-4185-ac6c-cbbcd61682e8 => ua-4a95e1fe-48f6-4a96-9519-2042b507b4ab> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:11:38.020433 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4a95e1fe-48f6-4a96-9519-2042b507b4ab for instance b930b00c-9e48-4185-ac6c-cbbcd61682e8 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:11:38.023090 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Successfully detached device vdb from instance b930b00c-9e48-4185-ac6c-cbbcd61682e8 from the live domain config.
May 27 23:11:38.024234 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:11:38.024591 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:38.024763 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:38.025644 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:38.025960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a95e1fe-48f6-4a96-9519-2042b507b4ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:11:38.026113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:11:38.049913 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:38.049913 np0000001565 nova-compute[98289]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:38.049913 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:38.050089 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsi session list stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:38.050089 np0000001565 nova-compute[98289]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab (non-flash)
May 27 23:11:38.050089 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:38.050145 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', '108')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:11:38.050348 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', '107')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:38.050959 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab', '108')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:38.051566 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e387ec900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:11:38.051756 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Removing multipathed devices sdd, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:11:38.051975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Flush multipath device 330000000781e8f0e {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:11:38.086309 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:38.117974 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-aaccf4b8-20a7-4f58-b8be-9a4b080d894d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.927s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:38.118863 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.859s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:38.119079 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:38.119247 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:38.119399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:38.121274 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Terminating instance
May 27 23:11:38.144699 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:38.196862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:11:38.197089 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:11:38.197703 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:11:38.207844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:11:38.208020 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:11:38.217848 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:38.229106 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:38.252508 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab, portal: 192.168.40.100,3260]
May 27 23:11:38.252508 np0000001565 nova-compute[98289]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab, portal: 192.168.40.100,3260] successful.
May 27 23:11:38.252508 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:38.263978 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:38.274186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:38.299204 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 108, target: iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab, portal: 192.168.50.100,3260]
May 27 23:11:38.299204 np0000001565 nova-compute[98289]: Logout of [sid: 108, target: iqn.2023-03.storpool.com:os--volume-4a95e1fe-48f6-4a96-9519-2042b507b4ab, portal: 192.168.50.100,3260] successful.
May 27 23:11:38.299204 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:38.310074 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:38.310298 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:38.310394 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] <== disconnect_volume: return (285ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:38.310522 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:11:38.624722 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:11:38.641255 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:38.644678 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:38.663895 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:38.689862 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:38.853880 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lazy-loading 'flavor' on Instance uuid b930b00c-9e48-4185-ac6c-cbbcd61682e8 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:38.906516 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:38.966974 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99974968000015 future=<Future at 0x726e601c86e0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:38.967668 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99924143699991 future=<Future at 0x726e601c86e0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:38.967668 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999102231000052 future=<Future at 0x726e601c86e0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:38.969791 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Instance destroyed successfully.
May 27 23:11:38.970669 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lazy-loading 'resources' on Instance uuid adac29fa-1144-4721-9ab5-0901535cd08e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:39.112535 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-36996f9c-ef0b-4951-a566-1e24e60bd209 req-b7514a1d-8691-48b1-980a-97a2b272840f service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Received event network-vif-unplugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:39.112763 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-36996f9c-ef0b-4951-a566-1e24e60bd209 req-b7514a1d-8691-48b1-980a-97a2b272840f service nova] Acquiring lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:39.112979 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-36996f9c-ef0b-4951-a566-1e24e60bd209 req-b7514a1d-8691-48b1-980a-97a2b272840f service nova] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:39.113059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-36996f9c-ef0b-4951-a566-1e24e60bd209 req-b7514a1d-8691-48b1-980a-97a2b272840f service nova] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:39.113175 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-36996f9c-ef0b-4951-a566-1e24e60bd209 req-b7514a1d-8691-48b1-980a-97a2b272840f service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] No waiting events found dispatching network-vif-unplugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:39.113264 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-36996f9c-ef0b-4951-a566-1e24e60bd209 req-b7514a1d-8691-48b1-980a-97a2b272840f service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Received event network-vif-unplugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:11:39.234425 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:39.472456 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1949104133',display_name='tempest-VolumesSnapshotTestJSON-instance-1949104133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumessnapshottestjson-instance-1949104133',id=47,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPFgEp4HYwdrGNENA6wGmAi1NAhzBRZbmBEbMVYXxfDsIeW8f8EHNjhHW8ekGSh4VC4Um5c5jX/hEgn6XetnX7LaP/fZJqYtsTsLr4cJld3F3njNYflidHK4wpzpe28HQ==',key_name='tempest-keypair-1154421445',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:10:40Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eceb76118ffc41a281af4ce737b19b88',ramdisk_id='',reservation_id='r-y94td6xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1830020059',owner_user_name='tempest-VolumesSnapshotTestJSON-1830020059-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:10:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12335b63d21044a6bc1d970ab66c8292',uuid=adac29fa-1144-4721-9ab5-0901535cd08e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:11:39.472620 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converting VIF {"id": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "address": "fa:16:3e:65:5e:ff", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc2b2cb-ab", "ovs_interfaceid": "9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:11:39.473194 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:5e:ff,bridge_name='br-int',has_traffic_filtering=True,id=9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc2b2cb-ab') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:11:39.473413 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:5e:ff,bridge_name='br-int',has_traffic_filtering=True,id=9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc2b2cb-ab') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:11:39.474467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:39.474663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cc2b2cb-ab, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:39.475634 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:39.476417 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:39.476625 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:39.477178 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:39.477358 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5f183f7-78bf-4c46-bcaf-5fd50f517615) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:39.477712 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:39.478384 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:39.478384 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:39.480109 np0000001565 nova-compute[98289]: INFO os_vif [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:5e:ff,bridge_name='br-int',has_traffic_filtering=True,id=9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc2b2cb-ab')
May 27 23:11:39.481473 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:11:39.481746 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '503d084e-24a9-4571-98d6-89bda0b2dfd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:39.481887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:39.482150 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:39.482454 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '503d084e-24a9-4571-98d6-89bda0b2dfd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:11:39.482592 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:11:39.494846 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
May 27 23:11:39.494846 np0000001565 nova-compute[98289]: 
May 27 23:11:39.506364 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:11:39.506364 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:39.506541 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:11:39.506541 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:39.506634 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:11:39.506634 np0000001565 nova-compute[98289]: 
May 27 23:11:39.506714 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Sessions list: [] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:11:39.506769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, 0): [] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:39.506868 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1') {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 23:11:39.506959 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1, 0): [] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:39.507043 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-503d084e-24a9-4571-98d6-89bda0b2dfd1') {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 23:11:39.507138 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e602b0e00>, {}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:11:39.507237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Disconnecting from: [] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:11:39.507424 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.025s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:39.507511 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] <== disconnect_volume: return (25ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:39.507621 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:11:39.507884 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Deleting instance files /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e_del
May 27 23:11:39.508583 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Deletion of /opt/stack/data/nova/instances/adac29fa-1144-4721-9ab5-0901535cd08e_del complete
May 27 23:11:39.859463 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-07cf14f0-64a9-4594-ad66-03a457533596 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.874s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:40.014221 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 23:11:40.014840 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:11:40.015069 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:11:40.015224 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:11:40.015567 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:40.123782 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:40.212080 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:40.212312 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:40.212575 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:40.212763 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:40.212923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:40.215425 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Terminating instance
May 27 23:11:40.305032 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:40.305313 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:40.305544 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attaching volume e7eb1a77-db2c-4082-82d9-e7134b562a1a to /dev/vdb
May 27 23:11:40.366251 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:40.379204 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:11:40.406211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:40.460642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:11:40.461724 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:11:40.472076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:11:40.476890 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe5d:72e', 'fe80::e4eb:faff:fe52:9498', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe31:5c79', 'fe80::bc78:52ff:fe4d:ba0f'] 
May 27 23:11:40.477076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:11:40.477239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:11:40.478137 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:40.478137 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Updating existing volume attachment record: 081781fc-ccef-4f78-979f-347bc9811879 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:11:40.622088 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2997be16-cc43-4b3a-885c-ebca18db30a7 req-a6ec8468-85e9-472c-a59e-94a5c83a4dc4 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Received event network-vif-deleted-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:40.623055 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-2997be16-cc43-4b3a-885c-ebca18db30a7 req-a6ec8468-85e9-472c-a59e-94a5c83a4dc4 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Neutron deleted interface 9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628; detaching it from the instance and deleting it from the info cache
May 27 23:11:40.628261 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2997be16-cc43-4b3a-885c-ebca18db30a7 req-a6ec8468-85e9-472c-a59e-94a5c83a4dc4 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Detach interface failed, port_id=9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628, reason: Instance adac29fa-1144-4721-9ab5-0901535cd08e could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:11:40.722177 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:11:40.735794 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:40.756279 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:40.761823 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:40.784209 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:40.785638 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:41.046035 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999708395000198 future=<Future at 0x726e38650ec0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:41.046557 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:11:41.046790 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:41.046936 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:41.047572 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:11:41.049785 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:41.050076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:11:41.053963 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Instance destroyed successfully.
May 27 23:11:41.054560 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lazy-loading 'resources' on Instance uuid b930b00c-9e48-4185-ac6c-cbbcd61682e8 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:41.063253 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:41.063971 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:41.064594 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:41.064829 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:11:41.065125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:41.065274 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:11:41.076858 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:11:41.076858 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:41.078244 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:11:41.078244 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:41.089494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a] added
May 27 23:11:41.089494 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:11:41.089494 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:41.089494 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:41.089494 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:41.089494 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:41.089494 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:41.089808 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:11:41.090285 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:11:41.090285 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:11:41.095832 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a] added
May 27 23:11:41.095832 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:11:41.095832 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:41.095832 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:41.095832 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:41.095832 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:41.095832 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:41.096047 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:11:41.096285 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:11:41.096519 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:11:41.184365 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Received event network-vif-unplugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:41.184808 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] Acquiring lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:41.184938 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:41.185132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] Lock "adac29fa-1144-4721-9ab5-0901535cd08e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:41.185256 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] No waiting events found dispatching network-vif-unplugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:41.185421 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Received event network-vif-unplugged-9cc2b2cb-abf4-415f-a4bd-bb1eb42c2628 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:11:41.185546 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Received event network-vif-unplugged-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:41.185890 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] Acquiring lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:41.186159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:41.186240 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:41.186357 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] No waiting events found dispatching network-vif-unplugged-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:41.186475 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2ec6c468-2a34-4058-abd6-52dd552d3c0e req-090470cb-24fc-4474-ba1f-318a453482c2 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Received event network-vif-unplugged-fac3e57b-733e-42a5-81a9-b5720d244659 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:11:41.552686 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Took 1.54 seconds to deallocate network for instance.
May 27 23:11:41.556994 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1794877486',display_name='tempest-VolumesExtendAttachedTest-instance-1794877486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesextendattachedtest-instance-1794877486',id=48,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUyfp8YHlL3eeigTQXIL7Z52NuZQFKaArICXAcUN+VxNaLiyaZB1/7Q8EQhKpvJW4zoHfseEslHp2kf4P2mBZe8fIKM739CvAGjpJgxRcFt8tQWjIvjAy/Xr9WWqE+BHA==',key_name='tempest-keypair-1933711445',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:10:46Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='199fc687f9c94d22899ca4964c2ea250',ramdisk_id='',reservation_id='r-dfukxqce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-527819065',owner_user_name='tempest-VolumesExtendAttachedTest-527819065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4d70d6d0d1c49ad9a7544e9c6df08e9',uuid=b930b00c-9e48-4185-ac6c-cbbcd61682e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:11:41.557165 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Converting VIF {"id": "fac3e57b-733e-42a5-81a9-b5720d244659", "address": "fa:16:3e:5d:07:2e", "network": {"id": "b29c1e55-a7c7-4138-a79d-35dc3c7b75c8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1960396909-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "199fc687f9c94d22899ca4964c2ea250", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac3e57b-73", "ovs_interfaceid": "fac3e57b-733e-42a5-81a9-b5720d244659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:11:41.557753 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:07:2e,bridge_name='br-int',has_traffic_filtering=True,id=fac3e57b-733e-42a5-81a9-b5720d244659,network=Network(b29c1e55-a7c7-4138-a79d-35dc3c7b75c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac3e57b-73') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:11:41.557958 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:07:2e,bridge_name='br-int',has_traffic_filtering=True,id=fac3e57b-733e-42a5-81a9-b5720d244659,network=Network(b29c1e55-a7c7-4138-a79d-35dc3c7b75c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac3e57b-73') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:11:41.559442 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:41.559661 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfac3e57b-73, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:41.560834 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:41.562175 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:41.562691 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:41.562861 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23739f5f-8cef-4ba3-b727-5e31278fcfec) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:41.563303 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:41.563949 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:41.565511 np0000001565 nova-compute[98289]: INFO os_vif [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:07:2e,bridge_name='br-int',has_traffic_filtering=True,id=fac3e57b-733e-42a5-81a9-b5720d244659,network=Network(b29c1e55-a7c7-4138-a79d-35dc3c7b75c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac3e57b-73')
May 27 23:11:41.565776 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Deleting instance files /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8_del
May 27 23:11:41.566501 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Deletion of /opt/stack/data/nova/instances/b930b00c-9e48-4185-ac6c-cbbcd61682e8_del complete
May 27 23:11:41.569408 np0000001565 nova-compute[98289]: WARNING nova.volume.cinder [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Attachment 407df208-2332-4b70-8ff0-2331cdb5cc61 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 407df208-2332-4b70-8ff0-2331cdb5cc61. (HTTP 404) (Request-ID: req-ab676118-0f6b-4078-974f-4969f0a209f5)
May 27 23:11:41.569777 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Took 0.02 seconds to detach 1 volumes for instance.
May 27 23:11:41.828082 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:41.829475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:41.935466 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:42.076816 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:42.077292 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 23:11:42.077724 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:42.078296 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:11:42.078639 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:11:42.078730 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:11:42.078956 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:42.090596 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:11:42.099351 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:11:42.106862 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:11:42.106862 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:11:42.113253 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:11:42.113253 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:42.122152 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:42.127842 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:42.139172 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:11:42.139172 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:42.139294 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:11:42.139294 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:42.139448 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:11:42.139448 np0000001565 nova-compute[98289]: 
May 27 23:11:42.141971 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:11:42.141971 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:42.142073 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:11:42.142073 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:42.142165 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:11:42.142165 np0000001565 nova-compute[98289]: 
May 27 23:11:42.164621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a, portal: 192.168.50.100,3260]
May 27 23:11:42.164621 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a, portal: 192.168.50.100,3260] successful.
May 27 23:11:42.164621 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:42.178668 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:42.184240 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a, portal: 192.168.40.100,3260]
May 27 23:11:42.184240 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a, portal: 192.168.40.100,3260] successful.
May 27 23:11:42.184240 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:42.194834 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:42.194834 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:42.194834 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:42.195043 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:42.195043 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:42.195043 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:42.195317 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:42.195507 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:11:42.196087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] HCTL ('7', '-', '-', 0) found on session 109 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:11:42.196234 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:11:42.199091 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:42.213543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Searching for a device in session 109 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:42.213805 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:11:42.214354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:42.214354 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:42.214354 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:42.214525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:42.214525 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:42.214525 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:42.214805 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:42.214935 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:11:42.215457 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] HCTL ('8', '-', '-', 0) found on session 110 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:11:42.215611 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:11:42.218759 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:42.232684 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Searching for a device in session 110 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:42.232684 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:11:42.334612 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'flavor' on Instance uuid 64b32e51-54ce-40c1-b92a-aa92dd7a5132 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:42.386679 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:11:42.386906 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:11:42.699555 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-019fa765-2095-4aed-954a-55ece6ced6f5 req-3f8a26e0-24cd-4208-933b-0023b1f28269 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Received event network-vif-deleted-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:42.699776 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-019fa765-2095-4aed-954a-55ece6ced6f5 req-3f8a26e0-24cd-4208-933b-0023b1f28269 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Neutron deleted interface fac3e57b-733e-42a5-81a9-b5720d244659; detaching it from the instance and deleting it from the info cache
May 27 23:11:42.703425 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-019fa765-2095-4aed-954a-55ece6ced6f5 req-3f8a26e0-24cd-4208-933b-0023b1f28269 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Detach interface failed, port_id=fac3e57b-733e-42a5-81a9-b5720d244659, reason: Instance b930b00c-9e48-4185-ac6c-cbbcd61682e8 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:11:42.889512 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:11:43.065710 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:11:43.146907 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:11:43.244552 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aadb535f-f096-461e-857d-bebf987d4c2b req-0b49cf53-e720-469b-85a9-4db77152d935 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Received event network-vif-unplugged-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:43.244704 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aadb535f-f096-461e-857d-bebf987d4c2b req-0b49cf53-e720-469b-85a9-4db77152d935 service nova] Acquiring lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:43.244922 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aadb535f-f096-461e-857d-bebf987d4c2b req-0b49cf53-e720-469b-85a9-4db77152d935 service nova] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:43.244990 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aadb535f-f096-461e-857d-bebf987d4c2b req-0b49cf53-e720-469b-85a9-4db77152d935 service nova] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:43.246014 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aadb535f-f096-461e-857d-bebf987d4c2b req-0b49cf53-e720-469b-85a9-4db77152d935 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] No waiting events found dispatching network-vif-unplugged-fac3e57b-733e-42a5-81a9-b5720d244659 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:43.246222 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aadb535f-f096-461e-857d-bebf987d4c2b req-0b49cf53-e720-469b-85a9-4db77152d935 service nova] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Received event network-vif-unplugged-fac3e57b-733e-42a5-81a9-b5720d244659 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:11:43.340785 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:43.398871 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.321s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:43.460801 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Deleted allocations for instance adac29fa-1144-4721-9ab5-0901535cd08e
May 27 23:11:43.608615 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:43.649649 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Took 1.57 seconds to deallocate network for instance.
May 27 23:11:43.906985 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:44.080066 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found WWN 330000000b34f785c for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:11:44.080311 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:44.080530 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000b34f785c', 'path': '/dev/dm-0', 'multipath_id': '330000000b34f785c'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:44.080629 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b34f785c', 'path': '/dev/dm-0', 'multipath_id': '330000000b34f785c'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:11:44.082964 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:44.155554 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:44.155873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:44.321992 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:11:44.322189 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:11:44.394300 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:44.394454 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:44.394614 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Attaching volume 910dac13-0da1-4900-ad12-5fde98f02161 to /dev/vdb
May 27 23:11:44.426490 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:44.438988 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:11:44.457109 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:44.474686 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-47b96fd7-0a7b-49d3-8105-bb6f8dada5d4 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "adac29fa-1144-4721-9ab5-0901535cd08e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.356s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:44.498719 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:11:44.498968 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:11:44.507054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:11:44.508083 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe31:5c79', 'fe80::bc78:52ff:fe4d:ba0f'] 
May 27 23:11:44.508188 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:11:44.508306 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:11:44.508550 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:44.508755 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Updating existing volume attachment record: 9de8343f-5df8-4919-924d-3578f21e8a13 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:11:44.586413 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attempting to attach volume e7eb1a77-db2c-4082-82d9-e7134b562a1a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:11:44.590009 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:11:44.590009 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:44.590009 np0000001565 nova-compute[98289]:   <alias name="ua-e7eb1a77-db2c-4082-82d9-e7134b562a1a"/>
May 27 23:11:44.590009 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:11:44.590009 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:44.590009 np0000001565 nova-compute[98289]:   <serial>e7eb1a77-db2c-4082-82d9-e7134b562a1a</serial>
May 27 23:11:44.590009 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:44.590009 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:11:44.824620 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:11:45.056321 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:11:45.056715 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '910dac13-0da1-4900-ad12-5fde98f02161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:45.056912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:45.330592 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:45.381244 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Deleted allocations for instance b930b00c-9e48-4185-ac6c-cbbcd61682e8
May 27 23:11:46.096761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "4fa535f0-639b-458c-aec2-3229efb09a8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:46.096952 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:46.239973 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:46.240166 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:46.240166 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:46.240282 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No VIF found with MAC fa:16:3e:93:34:97, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:11:46.388597 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e6b83edc-dd07-48fb-b9ef-9b5af913b4a8 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Lock "b930b00c-9e48-4185-ac6c-cbbcd61682e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.176s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:46.564323 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:46.598630 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:11:47.124125 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:11:47.141992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:47.142316 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:47.144846 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:11:47.144971 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Claim successful on node np0000001565
May 27 23:11:47.210940 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.154s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:47.211226 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '910dac13-0da1-4900-ad12-5fde98f02161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:11:47.225735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:47.226296 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:47.226983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:47.227224 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:11:47.227635 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:47.228123 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:11:47.241141 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:11:47.241141 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:47.251601 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:11:47.251601 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:47.256774 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161] added
May 27 23:11:47.256774 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:11:47.256774 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:47.256774 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:47.256774 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:47.256774 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:47.256774 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:47.256995 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:11:47.257152 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:11:47.257342 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:11:47.262354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161] added
May 27 23:11:47.262354 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:11:47.262354 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:47.262354 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:47.262354 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:11:47.262354 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:11:47.262354 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:47.262562 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:11:47.262800 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:11:47.262988 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:11:47.629158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:47.785309 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b7f9e060-cb0f-4ea2-988b-0cd17d65feec tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.480s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:48.257712 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:11:48.263707 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:11:48.272379 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:11:48.272379 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:11:48.282375 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:11:48.282375 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:48.288718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:48.302234 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:48.311186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.311186 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.311186 np0000001565 nova-compute[98289]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.311186 np0000001565 nova-compute[98289]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.311186 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:48.311186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.311186 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.311186 np0000001565 nova-compute[98289]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.311186 np0000001565 nova-compute[98289]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.311186 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:48.316437 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.316437 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.316437 np0000001565 nova-compute[98289]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.316437 np0000001565 nova-compute[98289]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.316437 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:48.316579 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.316579 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.316579 np0000001565 nova-compute[98289]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.316579 np0000001565 nova-compute[98289]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.316579 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:48.328116 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:11:48.328295 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:11:48.351582 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161, portal: 192.168.40.100,3260]
May 27 23:11:48.351582 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161, portal: 192.168.40.100,3260] successful.
May 27 23:11:48.351582 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:48.360692 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161, portal: 192.168.50.100,3260]
May 27 23:11:48.360692 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161, portal: 192.168.50.100,3260] successful.
May 27 23:11:48.360692 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:48.364976 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:48.372113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:48.381478 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.381478 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.381478 np0000001565 nova-compute[98289]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.381478 np0000001565 nova-compute[98289]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.381478 np0000001565 nova-compute[98289]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:48.381478 np0000001565 nova-compute[98289]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:48.381478 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:48.381795 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.381795 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.381795 np0000001565 nova-compute[98289]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.381795 np0000001565 nova-compute[98289]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.381795 np0000001565 nova-compute[98289]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:48.381795 np0000001565 nova-compute[98289]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:48.381795 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:48.381795 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:48.382062 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:11:48.382598 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] HCTL ('11', '-', '-', 0) found on session 113 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:11:48.382782 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:11:48.388584 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.388584 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.388584 np0000001565 nova-compute[98289]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.388584 np0000001565 nova-compute[98289]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.388584 np0000001565 nova-compute[98289]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:48.388584 np0000001565 nova-compute[98289]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:48.388584 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:48.388867 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.388867 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:48.388867 np0000001565 nova-compute[98289]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.388867 np0000001565 nova-compute[98289]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:11:48.388867 np0000001565 nova-compute[98289]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:48.388867 np0000001565 nova-compute[98289]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:48.388867 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:48.388867 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:48.389117 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:11:48.389657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] HCTL ('12', '-', '-', 0) found on session 114 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:11:48.389758 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:11:48.400954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching for a device in session 113 and hctl ['11', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:48.405804 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching for a device in session 114 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:48.405804 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '910dac13-0da1-4900-ad12-5fde98f02161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:11:48.830911 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:11:48.917364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:49.340765 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.198s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:49.341577 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.712s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:49.343138 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:11:49.343890 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:49.344084 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:11:49.399043 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching for a device in session 113 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:11:49.399208 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '910dac13-0da1-4900-ad12-5fde98f02161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:11:49.848398 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:11:49.848962 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:11:49.848962 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:49.849036 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:49.852743 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:49.925448 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '067b6ee5c2a64c49b4996bfdb0da2f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fdabf383b34e58a2e73a840bb71c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:11:50.255776 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Found WWN 330000000acd98017 for multipath device dm-2 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:11:50.256087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:50.256270 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] <== connect_volume: return (5199ms) {'type': 'block', 'scsi_wwn': '330000000acd98017', 'path': '/dev/dm-2', 'multipath_id': '330000000acd98017'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:50.256456 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000acd98017', 'path': '/dev/dm-2', 'multipath_id': '330000000acd98017'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:11:50.259300 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'flavor' on Instance uuid 64b32e51-54ce-40c1-b92a-aa92dd7a5132 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:50.351013 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:11:50.366749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:50.390806 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Successfully created port: 4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:11:50.473566 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:50.474061 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:50.576306 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:50.577029 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:11:50.583807 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:50.681847 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:50.682978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:50.764087 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Attempting to attach volume 910dac13-0da1-4900-ad12-5fde98f02161 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:11:50.773432 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:11:50.773432 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:50.773432 np0000001565 nova-compute[98289]:   <alias name="ua-910dac13-0da1-4900-ad12-5fde98f02161"/>
May 27 23:11:50.773432 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:11:50.773432 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:50.773432 np0000001565 nova-compute[98289]:   <serial>910dac13-0da1-4900-ad12-5fde98f02161</serial>
May 27 23:11:50.773432 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:50.773432 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:11:50.775148 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:50.786597 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:11:50.790568 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:50.813179 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c023f33a-0fb3-467f-9c0f-640ee4574360 req-91eea295-980f-4c4e-ac28-c85efa26b438 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Received event network-vif-unplugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:50.813831 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c023f33a-0fb3-467f-9c0f-640ee4574360 req-91eea295-980f-4c4e-ac28-c85efa26b438 service nova] Acquiring lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:50.814669 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c023f33a-0fb3-467f-9c0f-640ee4574360 req-91eea295-980f-4c4e-ac28-c85efa26b438 service nova] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:50.814873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c023f33a-0fb3-467f-9c0f-640ee4574360 req-91eea295-980f-4c4e-ac28-c85efa26b438 service nova] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:50.815065 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c023f33a-0fb3-467f-9c0f-640ee4574360 req-91eea295-980f-4c4e-ac28-c85efa26b438 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] No waiting events found dispatching network-vif-unplugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:50.815281 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c023f33a-0fb3-467f-9c0f-640ee4574360 req-91eea295-980f-4c4e-ac28-c85efa26b438 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Received unexpected event network-vif-unplugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 for instance with vm_state building and task_state networking.
May 27 23:11:50.836518 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:50.836972 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13201MB free_disk=73.72412872314453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:11:50.837163 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:50.837465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:50.852532 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:11:50.921948 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Successfully updated port: 4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:11:50.966009 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d4f7304d-daa7-4981-946f-3cb04f159236 req-db34244e-610c-4831-a63e-ce01de359aac service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Received event network-changed-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:50.966281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d4f7304d-daa7-4981-946f-3cb04f159236 req-db34244e-610c-4831-a63e-ce01de359aac service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Refreshing instance network info cache due to event network-changed-4fa09685-a54a-4e3f-bacc-9b8d82fae740. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:11:50.966649 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d4f7304d-daa7-4981-946f-3cb04f159236 req-db34244e-610c-4831-a63e-ce01de359aac service nova] Acquiring lock "refresh_cache-4fa535f0-639b-458c-aec2-3229efb09a8d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:11:50.966741 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d4f7304d-daa7-4981-946f-3cb04f159236 req-db34244e-610c-4831-a63e-ce01de359aac service nova] Acquired lock "refresh_cache-4fa535f0-639b-458c-aec2-3229efb09a8d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:11:50.967190 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d4f7304d-daa7-4981-946f-3cb04f159236 req-db34244e-610c-4831-a63e-ce01de359aac service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Refreshing network info cache for port 4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:11:51.423721 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "refresh_cache-4fa535f0-639b-458c-aec2-3229efb09a8d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:11:51.468739 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d4f7304d-daa7-4981-946f-3cb04f159236 req-db34244e-610c-4831-a63e-ce01de359aac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:51.482157 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:51.482423 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:51.523627 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d4f7304d-daa7-4981-946f-3cb04f159236 req-db34244e-610c-4831-a63e-ce01de359aac service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:11:51.565992 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:51.659899 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d4f7304d-daa7-4981-946f-3cb04f159236 req-db34244e-610c-4831-a63e-ce01de359aac service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:11:51.863084 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:11:51.864573 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:11:51.865280 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Creating image(s)
May 27 23:11:51.865587 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:51.865785 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "/opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:51.866503 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "/opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:51.867050 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:11:51.871669 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:11:51.875544 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:51.916508 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 8eb7e5db-7164-4713-86c9-13ed200502f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:11:51.916646 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 64b32e51-54ce-40c1-b92a-aa92dd7a5132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:11:51.916746 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 4fa535f0-639b-458c-aec2-3229efb09a8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:11:51.984178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.109s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:51.984912 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:51.985198 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:11:51.989165 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:51.989165 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:11:51.991324 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:11:51.991744 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:52.090957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.099s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:52.091504 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:52.155614 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk 1073741824" returned: 0 in 0.064s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:52.156250 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:52.156778 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:52.171266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d4f7304d-daa7-4981-946f-3cb04f159236 req-db34244e-610c-4831-a63e-ce01de359aac service nova] Releasing lock "refresh_cache-4fa535f0-639b-458c-aec2-3229efb09a8d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:11:52.172510 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquired lock "refresh_cache-4fa535f0-639b-458c-aec2-3229efb09a8d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:11:52.172864 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:11:52.252505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.096s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:52.253198 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:11:52.253198 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:52.323606 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:52.341485 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:52.341885 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Cannot resize image /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:11:52.342281 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:11:52.342567 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Ensure instance console log exists: /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:11:52.342956 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:52.343157 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:52.343323 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:52.378179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:52.378367 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:52.420733 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 27 23:11:52.421215 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:11:52.421450 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:11:50 up 40 min,  2 users,  load average: 4.85, 6.23, 4.42\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_eaec81e9dd2444e1a6d54f579a902212': '1', 'io_workload': '1', 'num_proj_47cb500558784c258720ab29bf2d40fe': '1', 'num_vm_building': '1', 'num_task_networking': '1', 'num_proj_a6fdabf383b34e58a2e73a840bb71c7e': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:11:52.445117 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:52.446018 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:52.446018 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:52.446018 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No VIF found with MAC fa:16:3e:31:5c:79, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:11:52.536475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:52.686350 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:11:52.686350 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:11:52.738561 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:11:52.873302 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:52.880180 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:11:53.011349 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Updating instance_info_cache with network_info: [{"id": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "address": "fa:16:3e:a3:0e:95", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa09685-a5", "ovs_interfaceid": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:11:53.186814 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:11:53.424075 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:53.513348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Releasing lock "refresh_cache-4fa535f0-639b-458c-aec2-3229efb09a8d" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:11:53.513611 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Instance network_info: |[{"id": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "address": "fa:16:3e:a3:0e:95", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa09685-a5", "ovs_interfaceid": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:11:53.515056 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Start _get_guest_xml network_info=[{"id": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "address": "fa:16:3e:a3:0e:95", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa09685-a5", "ovs_interfaceid": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:11:53.516946 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:11:53.517998 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1715453502', uuid='4fa535f0-639b-458c-aec2-3229efb09a8d'), owner=OwnerMeta(userid='067b6ee5c2a64c49b4996bfdb0da2f92', username='tempest-VolumesActionsTest-366756017-project-member', projectid='a6fdabf383b34e58a2e73a840bb71c7e', projectname='tempest-VolumesActionsTest-366756017'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "address": "fa:16:3e:a3:0e:95", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa09685-a5", "ovs_interfaceid": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923513.5177104) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:11:53.518876 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:11:53.519160 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:11:53.520068 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:11:53.520250 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:11:53.520997 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:11:53.521282 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:11:53.521449 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:11:53.521585 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:11:53.521752 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:11:53.521853 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:11:53.521994 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:11:53.522183 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:11:53.522318 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:11:53.522471 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:11:53.522601 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:11:53.522749 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:11:53.531766 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1715453502',display_name='tempest-VolumesActionsTest-instance-1715453502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesactionstest-instance-1715453502',id=51,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fdabf383b34e58a2e73a840bb71c7e',ramdisk_id='',reservation_id='r-jbt88isn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-366756017',owner_user_name='tempest-VolumesActionsTest-366756017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:11:51Z,user_data=None,user_id='067b6ee5c2a64c49b4996bfdb0da2f92',uuid=4fa535f0-639b-458c-aec2-3229efb09a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "address": "fa:16:3e:a3:0e:95", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa09685-a5", "ovs_interfaceid": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:11:53.531916 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converting VIF {"id": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "address": "fa:16:3e:a3:0e:95", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa09685-a5", "ovs_interfaceid": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:11:53.532470 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:0e:95,bridge_name='br-int',has_traffic_filtering=True,id=4fa09685-a54a-4e3f-bacc-9b8d82fae740,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa09685-a5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:11:53.532977 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fa535f0-639b-458c-aec2-3229efb09a8d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:53.692565 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:11:53.692728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.855s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:53.693035 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.157s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:53.693309 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:11:53.697583 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:11:53.697761 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Claim successful on node np0000001565
May 27 23:11:53.926992 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:53.967139 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004108279999854858 future=<Future at 0x726e601c86e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:53.967656 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] Emitting event <LifecycleEvent: 1779923498.966617, adac29fa-1144-4721-9ab5-0901535cd08e => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:11:53.967842 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:53.968050 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] VM Stopped (Lifecycle Event)
May 27 23:11:53.969054 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.076691407999988 future=<Future at 0x726e38650ec0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:53.969239 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.076497713000208 future=<Future at 0x726e38650ec0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:53.991947 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2f62b5ed-a815-4bce-a0af-c2a821937260 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.597s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:54.035520 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] End _get_guest_xml xml=<domain type="qemu">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <uuid>4fa535f0-639b-458c-aec2-3229efb09a8d</uuid>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <name>instance-00000033</name>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumesActionsTest-instance-1715453502</nova:name>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:11:53</nova:creationTime>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:user uuid="067b6ee5c2a64c49b4996bfdb0da2f92">tempest-VolumesActionsTest-366756017-project-member</nova:user>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:project uuid="a6fdabf383b34e58a2e73a840bb71c7e">tempest-VolumesActionsTest-366756017</nova:project>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         <nova:port uuid="4fa09685-a54a-4e3f-bacc-9b8d82fae740">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <system>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <entry name="serial">4fa535f0-639b-458c-aec2-3229efb09a8d</entry>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <entry name="uuid">4fa535f0-639b-458c-aec2-3229efb09a8d</entry>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     </system>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <os>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   </os>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <features>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   </features>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   <devices>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     </disk>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk.config"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     </disk>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:a3:0e:95"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <target dev="tap4fa09685-a5"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     </interface>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/console.log" append="off"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     </serial>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <video>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     </video>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     </rng>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:   </devices>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]: </domain>
May 27 23:11:54.035520 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Preparing to wait for external event network-vif-plugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1715453502',display_name='tempest-VolumesActionsTest-instance-1715453502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesactionstest-instance-1715453502',id=51,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fdabf383b34e58a2e73a840bb71c7e',ramdisk_id='',reservation_id='r-jbt88isn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-366756017',owner_user_name='tempest-VolumesActionsTest-366756017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:11:51Z,user_data=None,user_id='067b6ee5c2a64c49b4996bfdb0da2f92',uuid=4fa535f0-639b-458c-aec2-3229efb09a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "address": "fa:16:3e:a3:0e:95", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa09685-a5", "ovs_interfaceid": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converting VIF {"id": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "address": "fa:16:3e:a3:0e:95", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa09685-a5", "ovs_interfaceid": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:0e:95,bridge_name='br-int',has_traffic_filtering=True,id=4fa09685-a54a-4e3f-bacc-9b8d82fae740,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa09685-a5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:0e:95,bridge_name='br-int',has_traffic_filtering=True,id=4fa09685-a54a-4e3f-bacc-9b8d82fae740,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa09685-a5') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:54.039274 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc38d395-240d-5c3b-8ba7-710ca3e6eb86', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:54.039904 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:54.040628 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:54.042245 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:54.042389 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fa09685-a5, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:54.042648 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fa09685-a5, col_values=(('qos', UUID('a5c2dcd1-3721-4a69-a173-542e1799d68a')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:54.042822 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fa09685-a5, col_values=(('external_ids', {'iface-id': '4fa09685-a54a-4e3f-bacc-9b8d82fae740', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:0e:95', 'vm-uuid': '4fa535f0-639b-458c-aec2-3229efb09a8d'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:54.043677 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:54.045445 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:54.048837 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:54.049977 np0000001565 nova-compute[98289]: INFO os_vif [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:0e:95,bridge_name='br-int',has_traffic_filtering=True,id=4fa09685-a54a-4e3f-bacc-9b8d82fae740,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa09685-a5')
May 27 23:11:54.410274 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:54.410497 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:54.470553 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-628f5986-7e19-4e6d-9ddc-ef3f62144af6 tempest-TestStampPattern-893938880 tempest-TestStampPattern-893938880-project-member] [instance: adac29fa-1144-4721-9ab5-0901535cd08e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:54.913921 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Detaching volume 910dac13-0da1-4900-ad12-5fde98f02161
May 27 23:11:54.956846 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Attempting to driver detach volume 910dac13-0da1-4900-ad12-5fde98f02161 from mountpoint /dev/vdb
May 27 23:11:54.959012 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:11:54.959214 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:11:54.963142 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Found disk vdb by alias ua-910dac13-0da1-4900-ad12-5fde98f02161 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:54.964491 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Found disk vdb by alias ua-910dac13-0da1-4900-ad12-5fde98f02161 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:54.964491 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Attempting to detach device vdb from instance 64b32e51-54ce-40c1-b92a-aa92dd7a5132 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:11:54.964792 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:54.964792 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:54.964792 np0000001565 nova-compute[98289]:   <alias name="ua-910dac13-0da1-4900-ad12-5fde98f02161"/>
May 27 23:11:54.964792 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:11:54.964792 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:54.964792 np0000001565 nova-compute[98289]:   <serial>910dac13-0da1-4900-ad12-5fde98f02161</serial>
May 27 23:11:54.964792 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:11:54.964792 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:54.964792 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:54.971321 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully detached device vdb from instance 64b32e51-54ce-40c1-b92a-aa92dd7a5132 from the persistent domain config.
May 27 23:11:54.971479 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] (1/8): Attempting to detach device vdb with device alias ua-910dac13-0da1-4900-ad12-5fde98f02161 from instance 64b32e51-54ce-40c1-b92a-aa92dd7a5132 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:11:54.971676 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:54.971676 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:54.971676 np0000001565 nova-compute[98289]:   <alias name="ua-910dac13-0da1-4900-ad12-5fde98f02161"/>
May 27 23:11:54.971676 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:11:54.971676 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:54.971676 np0000001565 nova-compute[98289]:   <serial>910dac13-0da1-4900-ad12-5fde98f02161</serial>
May 27 23:11:54.971676 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:11:54.971676 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:54.971676 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:55.442682 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923515.4423501, 64b32e51-54ce-40c1-b92a-aa92dd7a5132 => ua-910dac13-0da1-4900-ad12-5fde98f02161> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:11:55.443775 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-910dac13-0da1-4900-ad12-5fde98f02161 for instance 64b32e51-54ce-40c1-b92a-aa92dd7a5132 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:11:55.446191 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully detached device vdb from instance 64b32e51-54ce-40c1-b92a-aa92dd7a5132 from the live domain config.
May 27 23:11:55.447405 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:11:55.447743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '910dac13-0da1-4900-ad12-5fde98f02161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:55.447897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:55.448284 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:55.448633 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '910dac13-0da1-4900-ad12-5fde98f02161', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:11:55.448785 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:11:55.462090 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:11:55.474016 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:55.474016 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:55.474016 np0000001565 nova-compute[98289]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:55.474016 np0000001565 nova-compute[98289]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:55.474016 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:11:55.474230 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:55.474230 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:11:55.474230 np0000001565 nova-compute[98289]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:55.474230 np0000001565 nova-compute[98289]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161 (non-flash)
May 27 23:11:55.474230 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:11:55.474355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', '114')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:11:55.474490 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', '113')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:55.475403 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161', '114')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:11:55.476140 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e6a457e20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:11:55.476355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:11:55.476597 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Flush multipath device 330000000acd98017 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:11:55.507879 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:55.554214 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:11:55.564856 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:55.565045 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:11:55.565212 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] No VIF found with MAC fa:16:3e:a3:0e:95, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:11:55.565702 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Using config drive
May 27 23:11:55.596877 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:11:55.597083 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:11:55.597925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:11:55.610577 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:11:55.610787 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:11:55.625605 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:55.651606 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 113, target: iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161, portal: 192.168.40.100,3260]
May 27 23:11:55.651606 np0000001565 nova-compute[98289]: Logout of [sid: 113, target: iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161, portal: 192.168.40.100,3260] successful.
May 27 23:11:55.651606 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:55.664767 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:55.675263 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:55.704112 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161, portal: 192.168.50.100,3260]
May 27 23:11:55.704112 np0000001565 nova-compute[98289]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-910dac13-0da1-4900-ad12-5fde98f02161, portal: 192.168.50.100,3260] successful.
May 27 23:11:55.704112 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:55.715681 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:11:55.715928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:11:55.716010 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] <== disconnect_volume: return (268ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:11:55.716118 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:11:55.968030 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.275s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:55.968532 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.544s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:55.968792 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:11:55.976101 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:11:55.976271 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Claim successful on node np0000001565
May 27 23:11:56.046136 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00036401699981070124 future=<Future at 0x726e38650ec0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:56.046378 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:56.046620 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Emitting event <LifecycleEvent: 1779923501.0456433, b930b00c-9e48-4185-ac6c-cbbcd61682e8 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:11:56.046771 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] VM Stopped (Lifecycle Event)
May 27 23:11:56.070835 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:56.182236 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Creating config drive at /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk.config
May 27 23:11:56.186030 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx0rplqf_ {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:56.246348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx0rplqf_" returned: 0 in 0.060s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:56.265994 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'flavor' on Instance uuid 64b32e51-54ce-40c1-b92a-aa92dd7a5132 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:56.475670 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:11:56.475968 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:11:56.476691 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:56.476691 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:56.549246 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: b930b00c-9e48-4185-ac6c-cbbcd61682e8] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:56.551888 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12335b63d21044a6bc1d970ab66c8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eceb76118ffc41a281af4ce737b19b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:11:56.672349 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:56.696381 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:56.779878 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:56.955840 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c3d8124f-0638-43c3-a2c5-8e5eb42fd68a req-a66c063e-764c-4ed3-9503-b24805ad9626 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Received event network-vif-plugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:56.956440 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c3d8124f-0638-43c3-a2c5-8e5eb42fd68a req-a66c063e-764c-4ed3-9503-b24805ad9626 service nova] Acquiring lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:56.956756 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c3d8124f-0638-43c3-a2c5-8e5eb42fd68a req-a66c063e-764c-4ed3-9503-b24805ad9626 service nova] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:56.956911 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c3d8124f-0638-43c3-a2c5-8e5eb42fd68a req-a66c063e-764c-4ed3-9503-b24805ad9626 service nova] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:56.957108 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c3d8124f-0638-43c3-a2c5-8e5eb42fd68a req-a66c063e-764c-4ed3-9503-b24805ad9626 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Processing event network-vif-plugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:11:56.978982 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:11:56.982578 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:56.991121 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:57.012504 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:57.256156 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Successfully created port: dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:11:57.271109 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:11:57.271404 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:11:57.274701 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6074b363-eca1-48e1-b6ff-939456d8b01d tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.864s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:57.298997 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:57.300081 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:57.428184 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:11:57.428721 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923517.4283864, 4fa535f0-639b-458c-aec2-3229efb09a8d => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:11:57.428878 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] VM Started (Lifecycle Event)
May 27 23:11:57.430442 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:11:57.433281 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Instance spawned successfully.
May 27 23:11:57.433979 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:11:57.496743 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:11:57.679351 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:57.679522 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:57.679682 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:57.679798 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:57.679900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:57.682810 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Terminating instance
May 27 23:11:57.709169 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Successfully updated port: dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:11:57.764831 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5128e8d7-cd15-48ef-a9f9-2c37b92b7773 req-7cf91771-4ab7-4274-91d5-9f2ef2c0b97c service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Received event network-changed-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:57.764894 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5128e8d7-cd15-48ef-a9f9-2c37b92b7773 req-7cf91771-4ab7-4274-91d5-9f2ef2c0b97c service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Refreshing instance network info cache due to event network-changed-dc4632c1-819f-48f6-bbca-0ffd14f60f58. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:11:57.765008 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5128e8d7-cd15-48ef-a9f9-2c37b92b7773 req-7cf91771-4ab7-4274-91d5-9f2ef2c0b97c service nova] Acquiring lock "refresh_cache-eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:11:57.765112 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5128e8d7-cd15-48ef-a9f9-2c37b92b7773 req-7cf91771-4ab7-4274-91d5-9f2ef2c0b97c service nova] Acquired lock "refresh_cache-eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:11:57.765215 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5128e8d7-cd15-48ef-a9f9-2c37b92b7773 req-7cf91771-4ab7-4274-91d5-9f2ef2c0b97c service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Refreshing network info cache for port dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:11:57.773526 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:11:57.801259 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Detaching volume e7eb1a77-db2c-4082-82d9-e7134b562a1a
May 27 23:11:57.837338 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attempting to driver detach volume e7eb1a77-db2c-4082-82d9-e7134b562a1a from mountpoint /dev/vdb
May 27 23:11:57.853079 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found disk vdb by alias ua-e7eb1a77-db2c-4082-82d9-e7134b562a1a {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:57.854356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found disk vdb by alias ua-e7eb1a77-db2c-4082-82d9-e7134b562a1a {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:11:57.854515 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Attempting to detach device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:11:57.854828 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:57.854828 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:57.854828 np0000001565 nova-compute[98289]:   <alias name="ua-e7eb1a77-db2c-4082-82d9-e7134b562a1a"/>
May 27 23:11:57.854828 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:11:57.854828 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:57.854828 np0000001565 nova-compute[98289]:   <serial>e7eb1a77-db2c-4082-82d9-e7134b562a1a</serial>
May 27 23:11:57.854828 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:11:57.854828 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:57.854828 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:57.859571 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Successfully detached device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the persistent domain config.
May 27 23:11:57.859735 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] (1/8): Attempting to detach device vdb with device alias ua-e7eb1a77-db2c-4082-82d9-e7134b562a1a from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:11:57.860006 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:11:57.860006 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:11:57.860006 np0000001565 nova-compute[98289]:   <alias name="ua-e7eb1a77-db2c-4082-82d9-e7134b562a1a"/>
May 27 23:11:57.860006 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:11:57.860006 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:11:57.860006 np0000001565 nova-compute[98289]:   <serial>e7eb1a77-db2c-4082-82d9-e7134b562a1a</serial>
May 27 23:11:57.860006 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:11:57.860006 np0000001565 nova-compute[98289]: </disk>
May 27 23:11:57.860006 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:11:57.931609 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:57.933820 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:11:57.940422 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:57.940604 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:57.940924 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:57.941180 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:57.941497 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:57.941733 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:11:58.185568 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:11:58.199901 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:58.202285 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:58.214179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "refresh_cache-eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:11:58.223771 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:58.226813 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:58.249863 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:58.268279 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5128e8d7-cd15-48ef-a9f9-2c37b92b7773 req-7cf91771-4ab7-4274-91d5-9f2ef2c0b97c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:58.280011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.312s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:58.280309 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:11:58.348694 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e7eb1a77-db2c-4082-82d9-e7134b562a1a for instance 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:11:58.350599 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5128e8d7-cd15-48ef-a9f9-2c37b92b7773 req-7cf91771-4ab7-4274-91d5-9f2ef2c0b97c service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:11:58.435920 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:11:58.436249 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923518.4360142, 4fa535f0-639b-458c-aec2-3229efb09a8d => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:11:58.436448 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] VM Paused (Lifecycle Event)
May 27 23:11:58.445727 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Took 6.58 seconds to spawn the instance on the hypervisor.
May 27 23:11:58.445898 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:58.508275 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:11:58.510443 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:11:58.510769 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Creating image(s)
May 27 23:11:58.512297 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:58.512297 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "/opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:58.512297 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "/opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:58.512447 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:11:58.518183 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:11:58.521761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:58.551512 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Instance destroyed successfully.
May 27 23:11:58.552708 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'resources' on Instance uuid 64b32e51-54ce-40c1-b92a-aa92dd7a5132 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:11:58.574015 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5128e8d7-cd15-48ef-a9f9-2c37b92b7773 req-7cf91771-4ab7-4274-91d5-9f2ef2c0b97c service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:11:58.611703 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:58.612152 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:58.612665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:58.613177 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:11:58.617522 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:11:58.617910 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:58.717348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:58.717348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:58.768126 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk 1073741824" returned: 0 in 0.051s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:58.768597 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.156s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:58.768931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:58.794502 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:11:58.796764 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:11:58.797752 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:58.798315 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:58.868913 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.100s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:58.869311 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:11:58.869535 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:11:58.894492 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88750b2b9d1242958b8da2d950c729f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'face22aba3d94486baaef109923294a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:11:58.939439 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:58.958592 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:58.962932 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:11:58.963384 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Cannot resize image /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:11:58.963801 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:11:58.964028 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Ensure instance console log exists: /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:11:58.964764 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Took 11.86 seconds to build instance.
May 27 23:11:58.967672 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:58.967767 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:58.967844 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:58.968385 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923518.967989, 4fa535f0-639b-458c-aec2-3229efb09a8d => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:11:58.968726 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] VM Resumed (Lifecycle Event)
May 27 23:11:59.038750 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Received event network-vif-plugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:59.038963 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] Acquiring lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:59.039123 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:59.039246 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:59.039396 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] No waiting events found dispatching network-vif-plugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:59.039512 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Received unexpected event network-vif-plugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 for instance with vm_state active and task_state None.
May 27 23:11:59.039631 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Received event network-vif-unplugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:59.039828 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] Acquiring lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:59.039930 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:59.040001 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:59.040089 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] No waiting events found dispatching network-vif-unplugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:59.040190 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Received event network-vif-unplugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:11:59.040281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Received event network-vif-unplugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:59.041222 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] Acquiring lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:11:59.041407 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:11:59.041521 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:59.041626 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] No waiting events found dispatching network-vif-unplugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:11:59.041753 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-896a48d5-8d4a-416c-9597-1bb334cfc19e req-039d9934-4e06-43af-80ce-da03afcbe359 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Received event network-vif-unplugged-a8d2504a-e7a3-4528-9a2f-a921c508d088 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:11:59.043712 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:59.056716 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1860480735',display_name='tempest-AttachVolumeNegativeTest-server-1860480735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1860480735',id=50,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJz+qqKyGlu3XXJPcwjJfGVM5RcwasLlUfnxv018X6I95kzTB7fampNOBCvq3lMX9/tTYJo9f20MYGv6XabyFuncWLCWDGH2CsOQjUXKa+vBeCOiLy6BgfZB1W25haEbVQ==',key_name='tempest-keypair-988888742',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:11:03Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-ly4pyild',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=64b32e51-54ce-40c1-b92a-aa92dd7a5132,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:11:59.057005 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "address": "fa:16:3e:31:5c:79", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d2504a-e7", "ovs_interfaceid": "a8d2504a-e7a3-4528-9a2f-a921c508d088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:11:59.057735 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=a8d2504a-e7a3-4528-9a2f-a921c508d088,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d2504a-e7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:11:59.058072 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=a8d2504a-e7a3-4528-9a2f-a921c508d088,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d2504a-e7') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:11:59.059929 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:59.060208 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8d2504a-e7, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:59.061287 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:59.062233 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:59.063000 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:59.063217 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=754c529c-aceb-40ae-8d8e-c452a64a40b3) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:11:59.063662 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:59.064097 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:11:59.064426 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:11:59.066727 np0000001565 nova-compute[98289]: INFO os_vif [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:5c:79,bridge_name='br-int',has_traffic_filtering=True,id=a8d2504a-e7a3-4528-9a2f-a921c508d088,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d2504a-e7')
May 27 23:11:59.067088 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Deleting instance files /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132_del
May 27 23:11:59.067892 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Deletion of /opt/stack/data/nova/instances/64b32e51-54ce-40c1-b92a-aa92dd7a5132_del complete
May 27 23:11:59.076146 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5128e8d7-cd15-48ef-a9f9-2c37b92b7773 req-7cf91771-4ab7-4274-91d5-9f2ef2c0b97c service nova] Releasing lock "refresh_cache-eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:11:59.077370 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquired lock "refresh_cache-eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:11:59.077554 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:11:59.303568 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:11:59.383361 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Successfully created port: 095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:11:59.469084 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-65e894fe-eb70-46a8-80d3-a9b7dff5bfbd tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.372s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:11:59.471272 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:11:59.473499 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:11:59.574173 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 23:11:59.574968 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:11:59.575146 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:11:59.575309 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:11:59.575521 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:59.676365 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:11:59.721377 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:59.808719 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:11:59.876627 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:11:59.911746 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Successfully updated port: 095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:11:59.964348 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b8a43292-a411-4246-a052-40e6abce90e8 req-f5e30891-07d5-4947-9053-8e0a2ad36ba4 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-changed-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:11:59.964348 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b8a43292-a411-4246-a052-40e6abce90e8 req-f5e30891-07d5-4947-9053-8e0a2ad36ba4 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Refreshing instance network info cache due to event network-changed-095b1112-b13d-4a74-bf06-ffb6ed339a83. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:11:59.964615 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b8a43292-a411-4246-a052-40e6abce90e8 req-f5e30891-07d5-4947-9053-8e0a2ad36ba4 service nova] Acquiring lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:11:59.964615 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b8a43292-a411-4246-a052-40e6abce90e8 req-f5e30891-07d5-4947-9053-8e0a2ad36ba4 service nova] Acquired lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:11:59.964826 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b8a43292-a411-4246-a052-40e6abce90e8 req-f5e30891-07d5-4947-9053-8e0a2ad36ba4 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Refreshing network info cache for port 095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:11:59.976468 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923519.976129, 8eb7e5db-7164-4713-86c9-13ed200502f6 => ua-e7eb1a77-db2c-4082-82d9-e7134b562a1a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:11:59.976734 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999818946999767 future=<Future at 0x726e385feff0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:59.981397 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998283520999848 future=<Future at 0x726e385feff0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:59.981397 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998106616999848 future=<Future at 0x726e385feff0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:11:59.986859 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Successfully detached device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the live domain config.
May 27 23:11:59.988373 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:11:59.988836 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:11:59.989057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:11:59.990716 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:11:59.991172 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7eb1a77-db2c-4082-82d9-e7134b562a1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:11:59.991386 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:12:00.018454 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:12:00.018454 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:12:00.018454 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:00.018631 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:12:00.018631 np0000001565 nova-compute[98289]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a (non-flash)
May 27 23:12:00.018631 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:00.018762 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', '110')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:12:00.018885 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', '110')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:12:00.019886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a', '109')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:12:00.020721 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e699091c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a'): ({'sdb'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:12:00.020933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:12:00.022212 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Flush multipath device 330000000b34f785c {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:12:00.057025 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Updating instance_info_cache with network_info: [{"id": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "address": "fa:16:3e:7b:24:15", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4632c1-81", "ovs_interfaceid": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:00.058848 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:12:00.115278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:12:00.167565 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:12:00.167740 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:12:00.168404 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:12:00.181483 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:12:00.181483 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:12:00.195262 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:00.202359 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-83eebb3f-68b5-4d6b-a89a-7529d7d65ec8 req-282037af-662e-4778-8f52-c7581aa3c4c4 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Received event network-vif-deleted-a8d2504a-e7a3-4528-9a2f-a921c508d088 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:00.202819 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-83eebb3f-68b5-4d6b-a89a-7529d7d65ec8 req-282037af-662e-4778-8f52-c7581aa3c4c4 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Neutron deleted interface a8d2504a-e7a3-4528-9a2f-a921c508d088; detaching it from the instance and deleting it from the info cache
May 27 23:12:00.204205 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-83eebb3f-68b5-4d6b-a89a-7529d7d65ec8 req-282037af-662e-4778-8f52-c7581aa3c4c4 service nova] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Detach interface failed, port_id=a8d2504a-e7a3-4528-9a2f-a921c508d088, reason: Instance 64b32e51-54ce-40c1-b92a-aa92dd7a5132 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:12:00.224743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 110, target: iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a, portal: 192.168.40.100,3260]
May 27 23:12:00.224743 np0000001565 nova-compute[98289]: Logout of [sid: 110, target: iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a, portal: 192.168.40.100,3260] successful.
May 27 23:12:00.224743 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:00.236578 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:00.247224 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:00.281171 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 109, target: iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a, portal: 192.168.50.100,3260]
May 27 23:12:00.281171 np0000001565 nova-compute[98289]: Logout of [sid: 109, target: iqn.2023-03.storpool.com:os--volume-e7eb1a77-db2c-4082-82d9-e7134b562a1a, portal: 192.168.50.100,3260] successful.
May 27 23:12:00.281171 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:00.290913 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:00.291234 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:00.291430 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== disconnect_volume: return (302ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:00.291607 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:12:00.316058 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Booting with volume fd10d6c5-8470-4dd0-8b97-6dd3d465063b at /dev/vda
May 27 23:12:00.352192 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:00.362848 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:12:00.381205 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:00.416145 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:00.423098 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:12:00.423406 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:12:00.431227 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:12:00.432237 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fea3:e95', 'fe80::38b5:d3ff:fe1a:89b0'] 
May 27 23:12:00.432369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:12:00.432485 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:12:00.432701 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:00.432896 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updating existing volume attachment record: bb2aa82a-7d5c-4bab-ad07-6227c62d98c3 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:12:00.469495 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-b8a43292-a411-4246-a052-40e6abce90e8 req-f5e30891-07d5-4947-9053-8e0a2ad36ba4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:00.523712 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b8a43292-a411-4246-a052-40e6abce90e8 req-f5e30891-07d5-4947-9053-8e0a2ad36ba4 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:12:00.559293 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Releasing lock "refresh_cache-eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:00.559722 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Instance network_info: |[{"id": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "address": "fa:16:3e:7b:24:15", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4632c1-81", "ovs_interfaceid": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:12:00.561562 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Start _get_guest_xml network_info=[{"id": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "address": "fa:16:3e:7b:24:15", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4632c1-81", "ovs_interfaceid": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:12:00.565447 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:12:00.566860 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1405023490', uuid='eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e'), owner=OwnerMeta(userid='12335b63d21044a6bc1d970ab66c8292', username='tempest-VolumesSnapshotTestJSON-1830020059-project-member', projectid='eceb76118ffc41a281af4ce737b19b88', projectname='tempest-VolumesSnapshotTestJSON-1830020059'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "address": "fa:16:3e:7b:24:15", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4632c1-81", "ovs_interfaceid": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923520.566445) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:12:00.568007 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:12:00.568344 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:12:00.569311 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:12:00.569512 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:12:00.570418 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:12:00.570710 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:12:00.570821 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:12:00.570914 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:12:00.571045 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:12:00.571124 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:12:00.571195 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:12:00.571371 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:12:00.571470 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:12:00.571578 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:12:00.571662 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:12:00.571772 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:12:00.581906 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:11:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1405023490',display_name='tempest-VolumesSnapshotTestJSON-instance-1405023490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumessnapshottestjson-instance-1405023490',id=52,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA55DopB/bO2TfIyUX/Wj/RgYNhqi+oiy9uySDzGAI9COTo2WLTfju74pSH43WNlrdTrn0XWKCEX/h1RKcYNExgrZkcp2EIwYbHxDQE3PpAaoGuP/V/Ms+VfK5bJ1rnySw==',key_name='tempest-keypair-756094411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eceb76118ffc41a281af4ce737b19b88',ramdisk_id='',reservation_id='r-2zxisbhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1830020059',owner_user_name='tempest-VolumesSnapshotTestJSON-1830020059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:11:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12335b63d21044a6bc1d970ab66c8292',uuid=eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "address": "fa:16:3e:7b:24:15", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4632c1-81", "ovs_interfaceid": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:12:00.582151 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converting VIF {"id": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "address": "fa:16:3e:7b:24:15", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4632c1-81", "ovs_interfaceid": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:00.582761 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:24:15,bridge_name='br-int',has_traffic_filtering=True,id=dc4632c1-819f-48f6-bbca-0ffd14f60f58,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4632c1-81') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:00.583544 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lazy-loading 'pci_devices' on Instance uuid eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:00.648798 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b8a43292-a411-4246-a052-40e6abce90e8 req-f5e30891-07d5-4947-9053-8e0a2ad36ba4 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:00.652342 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:00.686676 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:00.686907 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:00.687116 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:00.687296 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:00.687733 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:00.687928 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:00.688152 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:00.688300 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:12:00.688551 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.44 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:12:00.832952 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:01.086298 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] End _get_guest_xml xml=<domain type="qemu">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <uuid>eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e</uuid>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <name>instance-00000034</name>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1405023490</nova:name>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:12:00</nova:creationTime>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:user uuid="12335b63d21044a6bc1d970ab66c8292">tempest-VolumesSnapshotTestJSON-1830020059-project-member</nova:user>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:project uuid="eceb76118ffc41a281af4ce737b19b88">tempest-VolumesSnapshotTestJSON-1830020059</nova:project>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         <nova:port uuid="dc4632c1-819f-48f6-bbca-0ffd14f60f58">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <system>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <entry name="serial">eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e</entry>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <entry name="uuid">eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e</entry>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     </system>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <os>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   </os>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <features>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   </features>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   <devices>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     </disk>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk.config"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     </disk>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:7b:24:15"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <target dev="tapdc4632c1-81"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     </interface>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/console.log" append="off"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     </serial>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <video>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     </video>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     </rng>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:   </devices>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]: </domain>
May 27 23:12:01.086298 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:12:01.088375 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Preparing to wait for external event network-vif-plugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:12:01.088375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:01.088375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:01.088375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:01.088375 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:11:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1405023490',display_name='tempest-VolumesSnapshotTestJSON-instance-1405023490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumessnapshottestjson-instance-1405023490',id=52,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA55DopB/bO2TfIyUX/Wj/RgYNhqi+oiy9uySDzGAI9COTo2WLTfju74pSH43WNlrdTrn0XWKCEX/h1RKcYNExgrZkcp2EIwYbHxDQE3PpAaoGuP/V/Ms+VfK5bJ1rnySw==',key_name='tempest-keypair-756094411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eceb76118ffc41a281af4ce737b19b88',ramdisk_id='',reservation_id='r-2zxisbhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1830020059',owner_user_name='tempest-VolumesSnapshotTestJSON-1830020059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:11:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12335b63d21044a6bc1d970ab66c8292',uuid=eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "address": "fa:16:3e:7b:24:15", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4632c1-81", "ovs_interfaceid": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:12:01.088375 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converting VIF {"id": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "address": "fa:16:3e:7b:24:15", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4632c1-81", "ovs_interfaceid": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:01.088735 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:24:15,bridge_name='br-int',has_traffic_filtering=True,id=dc4632c1-819f-48f6-bbca-0ffd14f60f58,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4632c1-81') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:01.088735 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:24:15,bridge_name='br-int',has_traffic_filtering=True,id=dc4632c1-819f-48f6-bbca-0ffd14f60f58,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4632c1-81') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:12:01.089280 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.089663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:01.089932 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:12:01.090647 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.090800 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b51fcbe0-5835-5413-9ca7-decdbae307f8', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:01.100167 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.100167 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:01.100167 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.102009 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.102168 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc4632c1-81, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:01.102550 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc4632c1-81, col_values=(('qos', UUID('db5da108-fcf8-43ce-a4c0-2cc10a2ab337')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:01.102716 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc4632c1-81, col_values=(('external_ids', {'iface-id': 'dc4632c1-819f-48f6-bbca-0ffd14f60f58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:24:15', 'vm-uuid': 'eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:01.103741 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.104577 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:01.108830 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.109650 np0000001565 nova-compute[98289]: INFO os_vif [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:24:15,bridge_name='br-int',has_traffic_filtering=True,id=dc4632c1-819f-48f6-bbca-0ffd14f60f58,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4632c1-81')
May 27 23:12:01.124657 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:01.124927 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:12:01.150762 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b8a43292-a411-4246-a052-40e6abce90e8 req-f5e30891-07d5-4947-9053-8e0a2ad36ba4 service nova] Releasing lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:01.151171 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquired lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:01.151369 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:12:01.154770 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Took 1.58 seconds to deallocate network for instance.
May 27 23:12:01.168044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "4fa535f0-639b-458c-aec2-3229efb09a8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:01.168044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:01.168044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:01.168044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:01.168044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:01.171275 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Terminating instance
May 27 23:12:01.662687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:01.662687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:01.675139 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:12:01.693277 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.695837 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.713021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.715670 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.722083 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:12:01.734712 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.743212 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:01.826930 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6aaf579b-8bf5-4658-8923-09d07a041ee4 req-9973205f-1b8d-4c82-9192-4f762e1b9334 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Received event network-vif-unplugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:01.827431 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6aaf579b-8bf5-4658-8923-09d07a041ee4 req-9973205f-1b8d-4c82-9192-4f762e1b9334 service nova] Acquiring lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:01.827618 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6aaf579b-8bf5-4658-8923-09d07a041ee4 req-9973205f-1b8d-4c82-9192-4f762e1b9334 service nova] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:01.827758 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6aaf579b-8bf5-4658-8923-09d07a041ee4 req-9973205f-1b8d-4c82-9192-4f762e1b9334 service nova] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:01.827896 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6aaf579b-8bf5-4658-8923-09d07a041ee4 req-9973205f-1b8d-4c82-9192-4f762e1b9334 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] No waiting events found dispatching network-vif-unplugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:01.828041 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6aaf579b-8bf5-4658-8923-09d07a041ee4 req-9973205f-1b8d-4c82-9192-4f762e1b9334 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Received event network-vif-unplugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:12:01.839614 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8ca2c753-6c80-4b9a-ac63-2025a9c79226 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.540s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:01.938003 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:01.988713 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:12:01.988972 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:12:01.997114 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999698307000017 future=<Future at 0x726e38779850 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:01.999874 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Instance destroyed successfully.
May 27 23:12:02.000305 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lazy-loading 'resources' on Instance uuid 4fa535f0-639b-458c-aec2-3229efb09a8d {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:02.083799 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updating instance_info_cache with network_info: [{"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:02.491402 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:12:02.502528 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1715453502',display_name='tempest-VolumesActionsTest-instance-1715453502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesactionstest-instance-1715453502',id=51,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:11:58Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6fdabf383b34e58a2e73a840bb71c7e',ramdisk_id='',reservation_id='r-jbt88isn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-366756017',owner_user_name='tempest-VolumesActionsTest-366756017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:11:58Z,user_data=None,user_id='067b6ee5c2a64c49b4996bfdb0da2f92',uuid=4fa535f0-639b-458c-aec2-3229efb09a8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "address": "fa:16:3e:a3:0e:95", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa09685-a5", "ovs_interfaceid": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:12:02.502739 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converting VIF {"id": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "address": "fa:16:3e:a3:0e:95", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa09685-a5", "ovs_interfaceid": "4fa09685-a54a-4e3f-bacc-9b8d82fae740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:02.503436 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:0e:95,bridge_name='br-int',has_traffic_filtering=True,id=4fa09685-a54a-4e3f-bacc-9b8d82fae740,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa09685-a5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:02.503719 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:0e:95,bridge_name='br-int',has_traffic_filtering=True,id=4fa09685-a54a-4e3f-bacc-9b8d82fae740,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa09685-a5') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:12:02.505036 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:02.505325 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fa09685-a5, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:02.520711 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:02.521778 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:02.527428 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:12:02.528806 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:02.530788 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:12:02.531608 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:02.532379 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Creating image(s)
May 27 23:12:02.532714 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5c2dcd1-3721-4a69-a173-542e1799d68a) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:02.532997 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:12:02.533165 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Ensure instance console log exists: /opt/stack/data/nova/instances/589f570f-00bc-4fd6-8002-7d583f2d3949/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:12:02.533387 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:02.533600 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:02.533728 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:02.534650 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:02.540209 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:02.542031 np0000001565 nova-compute[98289]: INFO os_vif [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:0e:95,bridge_name='br-int',has_traffic_filtering=True,id=4fa09685-a54a-4e3f-bacc-9b8d82fae740,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa09685-a5')
May 27 23:12:02.542430 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Deleting instance files /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d_del
May 27 23:12:02.543090 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Deletion of /opt/stack/data/nova/instances/4fa535f0-639b-458c-aec2-3229efb09a8d_del complete
May 27 23:12:02.586042 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Releasing lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:02.586283 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Instance network_info: |[{"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:12:02.587045 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Start _get_guest_xml network_info=[{"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bb2aa82a-7d5c-4bab-ad07-6227c62d98c3', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '589f570f-00bc-4fd6-8002-7d583f2d3949', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'serial': 'fd10d6c5-8470-4dd0-8b97-6dd3d465063b'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:12:02.589586 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:12:02.590543 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-1915026212', uuid='589f570f-00bc-4fd6-8002-7d583f2d3949'), owner=OwnerMeta(userid='88750b2b9d1242958b8da2d950c729f2', username='tempest-TestInstancesWithCinderVolumes-1573798239-project-member', projectid='face22aba3d94486baaef109923294a3', projectname='tempest-TestInstancesWithCinderVolumes-1573798239'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923522.5902045) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:12:02.592133 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:12:02.592466 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:12:02.593447 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:12:02.593625 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:12:02.594294 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:12:02.594565 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:12:02.594681 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:12:02.594765 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:12:02.594876 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:12:02.594985 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:12:02.595061 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:12:02.595188 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:12:02.595280 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:12:02.595409 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:12:02.595509 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:12:02.595685 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:12:02.605036 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:12:02.605271 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:02.605419 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:02.605749 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:02.605918 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:12:02.616535 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:02.617725 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:02.618115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:02.618294 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:02.618637 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:02.618815 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:02.623005 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:02.623116 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:02.623225 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No VIF found with MAC fa:16:3e:7b:24:15, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:12:02.623647 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Using config drive
May 27 23:12:02.628801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:02.628801 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:02.633027 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:02.633027 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:02.639734 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b] added
May 27 23:12:02.639734 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:02.639734 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:02.639734 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:02.639734 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:02.639734 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:02.639734 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:02.639902 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:02.640073 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0217(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:02.640457 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:02.643630 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b] added
May 27 23:12:02.643630 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:02.643630 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:02.643630 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:02.643630 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:02.643630 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:02.643630 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:02.643765 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:02.643973 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:02.644060 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:02.998242 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.336s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:03.048532 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Took 1.37 seconds to destroy the instance on the hypervisor.
May 27 23:12:03.049237 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:12:03.049583 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:12:03.049956 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:12:03.049956 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:03.057943 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Deleted allocations for instance 64b32e51-54ce-40c1-b92a-aa92dd7a5132
May 27 23:12:03.108014 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:03.129845 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:03.262931 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Creating config drive at /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk.config
May 27 23:12:03.267630 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphvdh2y7u {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:03.323394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphvdh2y7u" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:03.365663 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1d52c71b-4b79-489a-8638-5e11210a3e9c req-de4b6c33-d898-4e67-be6c-6f5845738821 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Received event network-vif-deleted-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:03.366024 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-1d52c71b-4b79-489a-8638-5e11210a3e9c req-de4b6c33-d898-4e67-be6c-6f5845738821 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Neutron deleted interface 4fa09685-a54a-4e3f-bacc-9b8d82fae740; detaching it from the instance and deleting it from the info cache
May 27 23:12:03.368371 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1d52c71b-4b79-489a-8638-5e11210a3e9c req-de4b6c33-d898-4e67-be6c-6f5845738821 service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Detach interface failed, port_id=4fa09685-a54a-4e3f-bacc-9b8d82fae740, reason: Instance 4fa535f0-639b-458c-aec2-3229efb09a8d could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:12:03.640969 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:03.644702 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:03.654560 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:03.654560 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:03.662020 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:03.662020 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:03.669974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:03.678147 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:03.684960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:12:03.684960 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:03.685086 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:12:03.685086 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:03.685206 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:12:03.685206 np0000001565 nova-compute[98289]: 
May 27 23:12:03.691822 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:12:03.691822 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:03.691958 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:12:03.691958 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:03.692088 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:12:03.692088 np0000001565 nova-compute[98289]: 
May 27 23:12:03.717434 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b, portal: 192.168.40.100,3260]
May 27 23:12:03.717434 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b, portal: 192.168.40.100,3260] successful.
May 27 23:12:03.717434 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:03.729534 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:03.733371 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b, portal: 192.168.50.100,3260]
May 27 23:12:03.733371 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b, portal: 192.168.50.100,3260] successful.
May 27 23:12:03.733371 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:03.743675 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:03.749462 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:03.749462 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:03.749462 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:03.749462 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:03.749462 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:03.749462 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:03.749611 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:03.749735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:03.750214 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] HCTL ('7', '-', '-', 0) found on session 115 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:03.750320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:03.753964 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:03.765762 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Searching for a device in session 115 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:03.765762 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:03.766318 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:03.766318 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:03.766318 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:03.767642 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:03.767642 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:03.767642 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:03.768010 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:03.768202 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:03.769151 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] HCTL ('8', '-', '-', 0) found on session 116 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:03.769227 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:03.771280 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:03.785889 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Searching for a device in session 116 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:03.785889 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:03.824583 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:03.831869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:03.832067 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:03.854726 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:03.908595 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6685ed62-1496-4bfe-bc92-457a5b4d913d req-92fabee3-9eaa-4ca2-a231-856dcee6717b service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Received event network-vif-unplugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:03.909411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6685ed62-1496-4bfe-bc92-457a5b4d913d req-92fabee3-9eaa-4ca2-a231-856dcee6717b service nova] Acquiring lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:03.909411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6685ed62-1496-4bfe-bc92-457a5b4d913d req-92fabee3-9eaa-4ca2-a231-856dcee6717b service nova] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:03.909506 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6685ed62-1496-4bfe-bc92-457a5b4d913d req-92fabee3-9eaa-4ca2-a231-856dcee6717b service nova] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:03.909672 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6685ed62-1496-4bfe-bc92-457a5b4d913d req-92fabee3-9eaa-4ca2-a231-856dcee6717b service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] No waiting events found dispatching network-vif-unplugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:03.909833 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6685ed62-1496-4bfe-bc92-457a5b4d913d req-92fabee3-9eaa-4ca2-a231-856dcee6717b service nova] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Received event network-vif-unplugged-4fa09685-a54a-4e3f-bacc-9b8d82fae740 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:12:03.953567 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:03.969384 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d84284a0-41b6-4872-a13b-dbb44ccdd5f3 req-50545989-5467-4e3b-be3d-a76f041650f8 service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Received event network-vif-plugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:03.969384 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d84284a0-41b6-4872-a13b-dbb44ccdd5f3 req-50545989-5467-4e3b-be3d-a76f041650f8 service nova] Acquiring lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:03.969489 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d84284a0-41b6-4872-a13b-dbb44ccdd5f3 req-50545989-5467-4e3b-be3d-a76f041650f8 service nova] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:03.969543 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d84284a0-41b6-4872-a13b-dbb44ccdd5f3 req-50545989-5467-4e3b-be3d-a76f041650f8 service nova] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:03.970363 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d84284a0-41b6-4872-a13b-dbb44ccdd5f3 req-50545989-5467-4e3b-be3d-a76f041650f8 service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Processing event network-vif-plugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:12:04.066452 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-921ffb60-e9a5-4690-aac5-c69cb43d7c93 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "64b32e51-54ce-40c1-b92a-aa92dd7a5132" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.387s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:04.110024 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:04.111344 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:04.113376 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:04.131994 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:04.326636 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Took 1.28 seconds to deallocate network for instance.
May 27 23:12:04.336543 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:04.481149 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923524.4807851, eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:04.481517 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:12:04.481663 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] VM Started (Lifecycle Event)
May 27 23:12:04.484059 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:12:04.486849 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Instance spawned successfully.
May 27 23:12:04.487213 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:12:04.619587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:12:04.834462 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:04.834462 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:04.985189 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:04.993660 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:12:04.998763 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:04.998951 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:04.999294 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:04.999594 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:04.999908 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:05.000205 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:05.074593 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:12:05.075003 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:12:05.343303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:05.495648 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:12:05.495922 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923525.4957337, eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:05.496035 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] VM Paused (Lifecycle Event)
May 27 23:12:05.507599 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Took 7.00 seconds to spawn the instance on the hypervisor.
May 27 23:12:05.507755 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:05.577528 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:12:05.642388 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Found WWN 330000000a8ee9907 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:12:05.642659 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:05.642817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000a8ee9907', 'path': '/dev/dm-0', 'multipath_id': '330000000a8ee9907'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:05.642958 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a8ee9907', 'path': '/dev/dm-0', 'multipath_id': '330000000a8ee9907'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:12:05.999826 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:06.002854 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923526.002627, eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:06.002996 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] VM Resumed (Lifecycle Event)
May 27 23:12:06.016155 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Took 13.53 seconds to build instance.
May 27 23:12:06.083992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.250s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:06.095863 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3d4dfcac-f95d-4281-ba8a-4d88b33e2972 req-5ea9eab9-ab11-4836-8c20-1cdc22d61c75 service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Received event network-vif-plugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:06.096288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3d4dfcac-f95d-4281-ba8a-4d88b33e2972 req-5ea9eab9-ab11-4836-8c20-1cdc22d61c75 service nova] Acquiring lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:06.096621 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3d4dfcac-f95d-4281-ba8a-4d88b33e2972 req-5ea9eab9-ab11-4836-8c20-1cdc22d61c75 service nova] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:06.096873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3d4dfcac-f95d-4281-ba8a-4d88b33e2972 req-5ea9eab9-ab11-4836-8c20-1cdc22d61c75 service nova] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:06.097168 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3d4dfcac-f95d-4281-ba8a-4d88b33e2972 req-5ea9eab9-ab11-4836-8c20-1cdc22d61c75 service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] No waiting events found dispatching network-vif-plugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:06.097605 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3d4dfcac-f95d-4281-ba8a-4d88b33e2972 req-5ea9eab9-ab11-4836-8c20-1cdc22d61c75 service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Received unexpected event network-vif-plugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 for instance with vm_state active and task_state None.
May 27 23:12:06.143940 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Deleted allocations for instance 4fa535f0-639b-458c-aec2-3229efb09a8d
May 27 23:12:06.150070 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1915026212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testinstanceswithcindervolumes-server-1915026212',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB709dB6jpd/F31kUar1LFfw6r2eppohl04fJPNYwOb0q/GS7M6SeAgY1ZFhAbyCF+HHqXhbYT9i16j0AZIFo1e7NToaAk/1wmiytCXlMfJD/HdhTgNjju+yO0N9vyUJRA==',key_name='tempest-TestInstancesWithCinderVolumes-980796134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='face22aba3d94486baaef109923294a3',ramdisk_id='',reservation_id='r-ymxhc3u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1573798239',owner_user_name='tempest-TestInstancesWithCinderVolumes-1573798239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:12:00Z,user_data=None,user_id='88750b2b9d1242958b8da2d950c729f2',uuid=589f570f-00bc-4fd6-8002-7d583f2d3949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:12:06.150279 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Converting VIF {"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:06.150844 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=095b1112-b13d-4a74-bf06-ffb6ed339a83,network=Network(e9ecd47d-5f55-4b0a-bc19-078ca260efe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095b1112-b1') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:06.152794 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lazy-loading 'pci_devices' on Instance uuid 589f570f-00bc-4fd6-8002-7d583f2d3949 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:06.499476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:06.499651 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:06.499892 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attaching volume d1818a0b-4891-41e9-b731-7563af964135 to /dev/vdb
May 27 23:12:06.505038 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:06.511266 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:12:06.518716 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.036s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:06.554491 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:06.567025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:12:06.587388 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:06.643326 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:12:06.643580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:12:06.653347 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:12:06.654288 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe7b:2415', 'fe80::ceb:9eff:fef9:ea15'] 
May 27 23:12:06.654449 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:12:06.654735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:12:06.654809 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:06.655043 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Updating existing volume attachment record: 642405a5-9a09-45ee-b6d1-57c86de074af {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:12:06.663553 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] End _get_guest_xml xml=<domain type="qemu">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <uuid>589f570f-00bc-4fd6-8002-7d583f2d3949</uuid>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <name>instance-00000035</name>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-1915026212</nova:name>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:12:02</nova:creationTime>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:properties/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:user uuid="88750b2b9d1242958b8da2d950c729f2">tempest-TestInstancesWithCinderVolumes-1573798239-project-member</nova:user>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:project uuid="face22aba3d94486baaef109923294a3">tempest-TestInstancesWithCinderVolumes-1573798239</nova:project>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         <nova:port uuid="095b1112-b13d-4a74-bf06-ffb6ed339a83">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <system>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <entry name="serial">589f570f-00bc-4fd6-8002-7d583f2d3949</entry>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <entry name="uuid">589f570f-00bc-4fd6-8002-7d583f2d3949</entry>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     </system>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <os>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   </os>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <features>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   </features>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   <devices>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/589f570f-00bc-4fd6-8002-7d583f2d3949/disk.config"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     </disk>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <alias name="ua-fd10d6c5-8470-4dd0-8b97-6dd3d465063b"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <serial>fd10d6c5-8470-4dd0-8b97-6dd3d465063b</serial>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     </disk>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:03:7c:08"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <target dev="tap095b1112-b1"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     </interface>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/589f570f-00bc-4fd6-8002-7d583f2d3949/console.log" append="off"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     </serial>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <video>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     </video>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     </rng>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:   </devices>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]: </domain>
May 27 23:12:06.663553 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:12:06.666114 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Preparing to wait for external event network-vif-plugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:12:06.666114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:06.666114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:06.666114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:06.666114 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1915026212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testinstanceswithcindervolumes-server-1915026212',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB709dB6jpd/F31kUar1LFfw6r2eppohl04fJPNYwOb0q/GS7M6SeAgY1ZFhAbyCF+HHqXhbYT9i16j0AZIFo1e7NToaAk/1wmiytCXlMfJD/HdhTgNjju+yO0N9vyUJRA==',key_name='tempest-TestInstancesWithCinderVolumes-980796134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='face22aba3d94486baaef109923294a3',ramdisk_id='',reservation_id='r-ymxhc3u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1573798239',owner_user_name='tempest-TestInstancesWithCinderVolumes-1573798239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:12:00Z,user_data=None,user_id='88750b2b9d1242958b8da2d950c729f2',uuid=589f570f-00bc-4fd6-8002-7d583f2d3949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:12:06.666114 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Converting VIF {"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:06.667871 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=095b1112-b13d-4a74-bf06-ffb6ed339a83,network=Network(e9ecd47d-5f55-4b0a-bc19-078ca260efe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095b1112-b1') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:06.668230 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=095b1112-b13d-4a74-bf06-ffb6ed339a83,network=Network(e9ecd47d-5f55-4b0a-bc19-078ca260efe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095b1112-b1') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:12:06.668629 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:06.669004 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:06.670177 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:12:06.672720 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:06.673013 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64e4d61e-0507-53c0-bafc-b8bf091c21ed', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:06.690631 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:06.691829 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:06.692629 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "10612118-f248-450c-89e3-663051a76135" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:06.694233 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:06.696570 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:06.696905 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap095b1112-b1, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:06.697536 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap095b1112-b1, col_values=(('qos', UUID('06439b6b-6d98-463d-9e9e-5e81a041c4ee')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:06.697847 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap095b1112-b1, col_values=(('external_ids', {'iface-id': '095b1112-b13d-4a74-bf06-ffb6ed339a83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:7c:08', 'vm-uuid': '589f570f-00bc-4fd6-8002-7d583f2d3949'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:06.700206 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:06.706236 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:06.709059 np0000001565 nova-compute[98289]: INFO os_vif [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=095b1112-b13d-4a74-bf06-ffb6ed339a83,network=Network(e9ecd47d-5f55-4b0a-bc19-078ca260efe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095b1112-b1')
May 27 23:12:07.161160 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cb73a4e7-3d8a-40ec-b52f-57ba33e6a672 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "4fa535f0-639b-458c-aec2-3229efb09a8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.995s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:07.200873 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:12:07.219950 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:12:07.220244 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1818a0b-4891-41e9-b731-7563af964135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:07.220412 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:07.220749 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:07.220975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1818a0b-4891-41e9-b731-7563af964135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:12:07.233587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:07.234201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:07.234542 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:07.234771 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:07.235066 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:07.235217 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:07.247245 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:07.247245 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:07.250249 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:07.250249 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:07.256677 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135] added
May 27 23:12:07.256677 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:07.256677 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:07.256677 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:07.256677 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:07.256677 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:07.256677 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:07.256881 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:07.259020 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0222(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:07.259020 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:07.260790 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135] added
May 27 23:12:07.260790 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:07.260790 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:07.260790 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:07.260790 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:07.260790 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:07.260790 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:07.260965 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:07.260992 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:07.261127 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:07.757173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:07.757484 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:07.761438 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:12:07.761626 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Claim successful on node np0000001565
May 27 23:12:08.159735 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8bf6f344-85d9-4640-9301-8185ae9280d5 req-c530ca7f-419e-43ff-8bad-c5feebf0a662 service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Received event network-changed-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:08.159916 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8bf6f344-85d9-4640-9301-8185ae9280d5 req-c530ca7f-419e-43ff-8bad-c5feebf0a662 service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Refreshing instance network info cache due to event network-changed-dc4632c1-819f-48f6-bbca-0ffd14f60f58. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:12:08.160144 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8bf6f344-85d9-4640-9301-8185ae9280d5 req-c530ca7f-419e-43ff-8bad-c5feebf0a662 service nova] Acquiring lock "refresh_cache-eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:08.160287 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8bf6f344-85d9-4640-9301-8185ae9280d5 req-c530ca7f-419e-43ff-8bad-c5feebf0a662 service nova] Acquired lock "refresh_cache-eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:08.160518 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8bf6f344-85d9-4640-9301-8185ae9280d5 req-c530ca7f-419e-43ff-8bad-c5feebf0a662 service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Refreshing network info cache for port dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:12:08.229232 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:08.229567 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:08.229567 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No VIF found with MAC fa:16:3e:03:7c:08, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:12:08.229863 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Using config drive
May 27 23:12:08.257567 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:08.261464 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:08.271494 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:08.271494 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:08.276899 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:08.276899 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:08.287574 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:08.293433 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:08.301930 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.301930 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.301930 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:08.302132 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.302132 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.302132 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:08.314955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.314955 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.314955 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:08.315077 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.315077 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.315077 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:08.339281 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135, portal: 192.168.40.100,3260]
May 27 23:12:08.339281 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135, portal: 192.168.40.100,3260] successful.
May 27 23:12:08.339281 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:08.351508 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:08.357543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135, portal: 192.168.50.100,3260]
May 27 23:12:08.357543 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135, portal: 192.168.50.100,3260] successful.
May 27 23:12:08.357543 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:08.368249 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:08.374129 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.374129 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.374129 np0000001565 nova-compute[98289]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:08.374129 np0000001565 nova-compute[98289]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:08.374129 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:08.374391 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.374391 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.374391 np0000001565 nova-compute[98289]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:08.374391 np0000001565 nova-compute[98289]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:08.374391 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:08.374552 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:08.374649 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:08.375191 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] HCTL ('9', '-', '-', 0) found on session 117 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:08.375290 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:08.383174 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.383174 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.383174 np0000001565 nova-compute[98289]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:08.383174 np0000001565 nova-compute[98289]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:08.383174 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:08.383478 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.383478 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:08.383478 np0000001565 nova-compute[98289]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:08.383478 np0000001565 nova-compute[98289]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:08.383478 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:08.383622 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:08.383700 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:08.384481 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] HCTL ('10', '-', '-', 0) found on session 118 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:08.384619 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:08.389442 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Searching for a device in session 117 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:08.389442 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1818a0b-4891-41e9-b731-7563af964135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:08.404119 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Searching for a device in session 118 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:08.404119 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd1818a0b-4891-41e9-b731-7563af964135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:08.667352 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8bf6f344-85d9-4640-9301-8185ae9280d5 req-c530ca7f-419e-43ff-8bad-c5feebf0a662 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:08.734755 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:08.746646 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:12:08.868112 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:08.868542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:08.901758 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Creating config drive at /opt/stack/data/nova/instances/589f570f-00bc-4fd6-8002-7d583f2d3949/disk.config
May 27 23:12:08.906655 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/589f570f-00bc-4fd6-8002-7d583f2d3949/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu9texmw_ {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:08.970418 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:08.978852 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/589f570f-00bc-4fd6-8002-7d583f2d3949/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu9texmw_" returned: 0 in 0.072s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:09.065451 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8bf6f344-85d9-4640-9301-8185ae9280d5 req-c530ca7f-419e-43ff-8bad-c5feebf0a662 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:09.127459 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:12:09.127799 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:12:09.206867 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8bf6f344-85d9-4640-9301-8185ae9280d5 req-c530ca7f-419e-43ff-8bad-c5feebf0a662 service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Updated VIF entry in instance network info cache for port dc4632c1-819f-48f6-bbca-0ffd14f60f58. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:12:09.207214 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8bf6f344-85d9-4640-9301-8185ae9280d5 req-c530ca7f-419e-43ff-8bad-c5feebf0a662 service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Updating instance_info_cache with network_info: [{"id": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "address": "fa:16:3e:7b:24:15", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4632c1-81", "ovs_interfaceid": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:09.237393 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:12:09.371155 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:12:09.387144 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:09.414031 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:09.415836 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:09.527663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:09.583386 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a72064aa-892c-4080-be72-9898fba24059 req-8ddc7d61-84c9-4fe9-92d7-86e3b7e470cf service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-vif-plugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:09.583386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a72064aa-892c-4080-be72-9898fba24059 req-8ddc7d61-84c9-4fe9-92d7-86e3b7e470cf service nova] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:09.583386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a72064aa-892c-4080-be72-9898fba24059 req-8ddc7d61-84c9-4fe9-92d7-86e3b7e470cf service nova] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:09.583386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a72064aa-892c-4080-be72-9898fba24059 req-8ddc7d61-84c9-4fe9-92d7-86e3b7e470cf service nova] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:09.583386 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a72064aa-892c-4080-be72-9898fba24059 req-8ddc7d61-84c9-4fe9-92d7-86e3b7e470cf service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Processing event network-vif-plugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:12:09.631656 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:12:09.709158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8bf6f344-85d9-4640-9301-8185ae9280d5 req-c530ca7f-419e-43ff-8bad-c5feebf0a662 service nova] Releasing lock "refresh_cache-eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:09.728925 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:09.732431 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:09.733685 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:09.756668 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:09.920873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:10.133756 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923530.133349, 589f570f-00bc-4fd6-8002-7d583f2d3949 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:10.134160 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:12:10.134340 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] VM Started (Lifecycle Event)
May 27 23:12:10.137070 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:12:10.138360 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Instance spawned successfully.
May 27 23:12:10.138628 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:12:10.141284 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.384s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:10.142609 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.221s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:10.142796 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:12:10.146813 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:12:10.146992 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Claim successful on node np0000001565
May 27 23:12:10.252941 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found WWN 3300000003559f67b for multipath device dm-3 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:12:10.253380 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:10.253562 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000003559f67b', 'path': '/dev/dm-3', 'multipath_id': '3300000003559f67b'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:10.253600 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003559f67b', 'path': '/dev/dm-3', 'multipath_id': '3300000003559f67b'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:12:10.255980 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:10.638287 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:10.642227 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:12:10.645292 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:10.645507 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:10.645766 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:10.645952 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:10.646221 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:10.646466 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:10.652235 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:12:10.652369 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:12:10.652600 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:10.652793 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:10.732275 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9df5f69b62834b2caaf76302e55c9707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47cb500558784c258720ab29bf2d40fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:12:10.758747 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attempting to attach volume d1818a0b-4891-41e9-b731-7563af964135 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:12:10.760959 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:12:10.760959 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:10.760959 np0000001565 nova-compute[98289]:   <alias name="ua-d1818a0b-4891-41e9-b731-7563af964135"/>
May 27 23:12:10.760959 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:12:10.760959 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:12:10.760959 np0000001565 nova-compute[98289]:   <serial>d1818a0b-4891-41e9-b731-7563af964135</serial>
May 27 23:12:10.760959 np0000001565 nova-compute[98289]: </disk>
May 27 23:12:10.760959 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:12:11.159169 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:12:11.162311 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:12:11.165106 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Took 8.64 seconds to spawn the instance on the hypervisor.
May 27 23:12:11.165356 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:11.167077 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923531.1656623, 589f570f-00bc-4fd6-8002-7d583f2d3949 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:11.167077 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] VM Paused (Lifecycle Event)
May 27 23:12:11.283002 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Successfully created port: c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:12:11.480069 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:12:11.480255 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:12:11.650404 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1a4d6e3a-c588-465a-a63a-c197f513d64f req-b54d5d1f-6ad6-4e64-80b3-b4192eee7f66 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-vif-plugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:11.650845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1a4d6e3a-c588-465a-a63a-c197f513d64f req-b54d5d1f-6ad6-4e64-80b3-b4192eee7f66 service nova] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:11.651048 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1a4d6e3a-c588-465a-a63a-c197f513d64f req-b54d5d1f-6ad6-4e64-80b3-b4192eee7f66 service nova] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:11.651139 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1a4d6e3a-c588-465a-a63a-c197f513d64f req-b54d5d1f-6ad6-4e64-80b3-b4192eee7f66 service nova] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:11.651237 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1a4d6e3a-c588-465a-a63a-c197f513d64f req-b54d5d1f-6ad6-4e64-80b3-b4192eee7f66 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] No waiting events found dispatching network-vif-plugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:11.651370 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-1a4d6e3a-c588-465a-a63a-c197f513d64f req-b54d5d1f-6ad6-4e64-80b3-b4192eee7f66 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received unexpected event network-vif-plugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 for instance with vm_state active and task_state None.
May 27 23:12:11.666156 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:12:11.671586 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:11.673066 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923531.6728969, 589f570f-00bc-4fd6-8002-7d583f2d3949 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:11.673308 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] VM Resumed (Lifecycle Event)
May 27 23:12:11.681211 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Took 18.30 seconds to build instance.
May 27 23:12:11.704822 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:11.832630 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Successfully updated port: c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:12:11.982574 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:12:12.175320 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:12.177286 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:12:12.185297 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.807s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:12.334749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "refresh_cache-10612118-f248-450c-89e3-663051a76135" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:12.335206 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquired lock "refresh_cache-10612118-f248-450c-89e3-663051a76135" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:12.335206 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:12:12.427832 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:12.427967 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:12.428064 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:12.428167 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No VIF found with MAC fa:16:3e:93:34:97, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:12:12.489434 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.348s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:12.489962 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:12:12.674171 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:12:12.675147 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:12:12.675467 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Creating image(s)
May 27 23:12:12.676155 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "/opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:12.676312 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "/opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:12.676862 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "/opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:12.677295 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:12.680301 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:12.681246 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:12.778960 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.097s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:12.779668 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:12.781422 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:12.781852 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:12.788895 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:12.789604 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:12.894508 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.105s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:12.895038 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:12.944838 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:12:12.953495 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk 1073741824" returned: 0 in 0.058s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:12.955963 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:12.956585 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:13.001051 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:12:13.002152 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:12:13.002859 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:13.003196 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:13.045199 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-93b3a54f-7172-4bea-bf93-c169f872709c req-8796f92a-6598-4039-b481-d3928d215aa1 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-changed-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:13.045392 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-93b3a54f-7172-4bea-bf93-c169f872709c req-8796f92a-6598-4039-b481-d3928d215aa1 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Refreshing instance network info cache due to event network-changed-095b1112-b13d-4a74-bf06-ffb6ed339a83. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:12:13.045681 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-93b3a54f-7172-4bea-bf93-c169f872709c req-8796f92a-6598-4039-b481-d3928d215aa1 service nova] Acquiring lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:13.045827 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-93b3a54f-7172-4bea-bf93-c169f872709c req-8796f92a-6598-4039-b481-d3928d215aa1 service nova] Acquired lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:13.046053 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-93b3a54f-7172-4bea-bf93-c169f872709c req-8796f92a-6598-4039-b481-d3928d215aa1 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Refreshing network info cache for port 095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:12:13.062675 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.106s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:13.065452 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:12:13.066246 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:13.109060 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '067b6ee5c2a64c49b4996bfdb0da2f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fdabf383b34e58a2e73a840bb71c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:12:13.164699 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:13.165071 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Cannot resize image /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:12:13.165418 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:12:13.165591 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Ensure instance console log exists: /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:12:13.165894 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:13.166096 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:13.166217 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:13.199767 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:13.458180 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Updating instance_info_cache with network_info: [{"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:13.507218 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:12:13.548513 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-93b3a54f-7172-4bea-bf93-c169f872709c req-8796f92a-6598-4039-b481-d3928d215aa1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:13.576527 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Successfully created port: 3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:12:13.732019 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ac0490a1-a068-4524-a926-d2cdd7a7414b req-4176c25d-642e-4f7a-a0a8-be454fb41aca service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Received event network-changed-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:13.732163 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ac0490a1-a068-4524-a926-d2cdd7a7414b req-4176c25d-642e-4f7a-a0a8-be454fb41aca service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Refreshing instance network info cache due to event network-changed-c5b4131d-a64d-4a3a-8a46-903138712db9. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:12:13.732308 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ac0490a1-a068-4524-a926-d2cdd7a7414b req-4176c25d-642e-4f7a-a0a8-be454fb41aca service nova] Acquiring lock "refresh_cache-10612118-f248-450c-89e3-663051a76135" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:13.961273 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Releasing lock "refresh_cache-10612118-f248-450c-89e3-663051a76135" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:13.962124 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Instance network_info: |[{"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:12:13.964375 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Start _get_guest_xml network_info=[{"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:12:13.965095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ac0490a1-a068-4524-a926-d2cdd7a7414b req-4176c25d-642e-4f7a-a0a8-be454fb41aca service nova] Acquired lock "refresh_cache-10612118-f248-450c-89e3-663051a76135" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:13.966005 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ac0490a1-a068-4524-a926-d2cdd7a7414b req-4176c25d-642e-4f7a-a0a8-be454fb41aca service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Refreshing network info cache for port c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:12:13.971695 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:13.975755 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:12:13.977062 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1743837486', uuid='10612118-f248-450c-89e3-663051a76135'), owner=OwnerMeta(userid='9df5f69b62834b2caaf76302e55c9707', username='tempest-AttachVolumeNegativeTest-1834166666-project-member', projectid='47cb500558784c258720ab29bf2d40fe', projectname='tempest-AttachVolumeNegativeTest-1834166666'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923533.9766424) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:12:13.980044 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:12:13.981545 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:12:13.984940 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:12:13.984940 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:12:13.984940 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:12:13.984940 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:12:13.984940 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:12:13.984940 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:12:13.985182 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:12:13.985182 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:12:13.985240 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:12:13.985516 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:12:13.985516 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:12:13.985660 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:12:13.985702 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:12:13.985828 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:12:14.007102 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1743837486',display_name='tempest-AttachVolumeNegativeTest-server-1743837486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1743837486',id=54,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKTGV4k70529mmE5xOum4QIcyOfCBbjPWduWMUTQ+lLNvPrKq2puQoquUWv5IqchbKv4htqXWuTLfWX9VOxvVpQB71PRjNd3lCtngCXQ/oCPsfOBEnnQk+N5yuksafQUg==',key_name='tempest-keypair-1767225239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-9485vzr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=10612118-f248-450c-89e3-663051a76135,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:12:14.007323 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:14.008289 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=c5b4131d-a64d-4a3a-8a46-903138712db9,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b4131d-a6') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:14.009076 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'pci_devices' on Instance uuid 10612118-f248-450c-89e3-663051a76135 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:14.012385 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:12:14.015531 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-873b563f-65a8-4d13-bbec-86e766b6d17d tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.516s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:14.128424 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Successfully updated port: 3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:12:14.208916 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-93b3a54f-7172-4bea-bf93-c169f872709c req-8796f92a-6598-4039-b481-d3928d215aa1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:14.364664 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-93b3a54f-7172-4bea-bf93-c169f872709c req-8796f92a-6598-4039-b481-d3928d215aa1 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updated VIF entry in instance network info cache for port 095b1112-b13d-4a74-bf06-ffb6ed339a83. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:12:14.365019 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-93b3a54f-7172-4bea-bf93-c169f872709c req-8796f92a-6598-4039-b481-d3928d215aa1 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updating instance_info_cache with network_info: [{"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:14.468715 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-ac0490a1-a068-4524-a926-d2cdd7a7414b req-4176c25d-642e-4f7a-a0a8-be454fb41aca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:14.517276 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] End _get_guest_xml xml=<domain type="qemu">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <uuid>10612118-f248-450c-89e3-663051a76135</uuid>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <name>instance-00000036</name>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1743837486</nova:name>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:12:13</nova:creationTime>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:user uuid="9df5f69b62834b2caaf76302e55c9707">tempest-AttachVolumeNegativeTest-1834166666-project-member</nova:user>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:project uuid="47cb500558784c258720ab29bf2d40fe">tempest-AttachVolumeNegativeTest-1834166666</nova:project>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         <nova:port uuid="c5b4131d-a64d-4a3a-8a46-903138712db9">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <system>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <entry name="serial">10612118-f248-450c-89e3-663051a76135</entry>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <entry name="uuid">10612118-f248-450c-89e3-663051a76135</entry>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     </system>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <os>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   </os>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <features>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   </features>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   <devices>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     </disk>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk.config"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     </disk>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:b8:17:8d"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <target dev="tapc5b4131d-a6"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     </interface>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/console.log" append="off"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     </serial>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <video>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     </video>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     </rng>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:   </devices>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]: </domain>
May 27 23:12:14.517276 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:12:14.524304 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Preparing to wait for external event network-vif-plugged-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:12:14.524642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "10612118-f248-450c-89e3-663051a76135-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:14.524795 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:14.524923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:14.525516 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1743837486',display_name='tempest-AttachVolumeNegativeTest-server-1743837486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1743837486',id=54,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKTGV4k70529mmE5xOum4QIcyOfCBbjPWduWMUTQ+lLNvPrKq2puQoquUWv5IqchbKv4htqXWuTLfWX9VOxvVpQB71PRjNd3lCtngCXQ/oCPsfOBEnnQk+N5yuksafQUg==',key_name='tempest-keypair-1767225239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-9485vzr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=10612118-f248-450c-89e3-663051a76135,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:12:14.525656 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:14.526125 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=c5b4131d-a64d-4a3a-8a46-903138712db9,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b4131d-a6') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:14.526382 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=c5b4131d-a64d-4a3a-8a46-903138712db9,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b4131d-a6') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:12:14.526760 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:14.527810 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:14.527810 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:12:14.528503 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:14.528691 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '643de62b-068c-5c91-83ea-bc4df0cfeaf4', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:14.531163 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:14.533109 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:14.533392 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5b4131d-a6, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:14.533668 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5b4131d-a6, col_values=(('qos', UUID('aa9fdb9d-0f53-478d-9556-f87e996cad5a')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:14.533865 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5b4131d-a6, col_values=(('external_ids', {'iface-id': 'c5b4131d-a64d-4a3a-8a46-903138712db9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:17:8d', 'vm-uuid': '10612118-f248-450c-89e3-663051a76135'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:14.536611 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:14.545360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:14.546550 np0000001565 nova-compute[98289]: INFO os_vif [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=c5b4131d-a64d-4a3a-8a46-903138712db9,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b4131d-a6')
May 27 23:12:14.633374 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "refresh_cache-bebf4b9c-132d-4bc4-aeed-d47f935bc548" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:14.633656 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquired lock "refresh_cache-bebf4b9c-132d-4bc4-aeed-d47f935bc548" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:14.633862 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:12:14.751842 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5cd00584-b69d-449f-b5bd-0f112deef7a7 req-9fa84975-b017-4b7e-943f-b21645b3d96a service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-changed-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:14.751842 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5cd00584-b69d-449f-b5bd-0f112deef7a7 req-9fa84975-b017-4b7e-943f-b21645b3d96a service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Refreshing instance network info cache due to event network-changed-095b1112-b13d-4a74-bf06-ffb6ed339a83. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:12:14.751842 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5cd00584-b69d-449f-b5bd-0f112deef7a7 req-9fa84975-b017-4b7e-943f-b21645b3d96a service nova] Acquiring lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:14.793503 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-ac0490a1-a068-4524-a926-d2cdd7a7414b req-4176c25d-642e-4f7a-a0a8-be454fb41aca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:14.874129 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-93b3a54f-7172-4bea-bf93-c169f872709c req-8796f92a-6598-4039-b481-d3928d215aa1 service nova] Releasing lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:14.874129 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5cd00584-b69d-449f-b5bd-0f112deef7a7 req-9fa84975-b017-4b7e-943f-b21645b3d96a service nova] Acquired lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:14.874129 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5cd00584-b69d-449f-b5bd-0f112deef7a7 req-9fa84975-b017-4b7e-943f-b21645b3d96a service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Refreshing network info cache for port 095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:12:14.926726 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ac0490a1-a068-4524-a926-d2cdd7a7414b req-4176c25d-642e-4f7a-a0a8-be454fb41aca service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Updated VIF entry in instance network info cache for port c5b4131d-a64d-4a3a-8a46-903138712db9. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:12:14.927014 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ac0490a1-a068-4524-a926-d2cdd7a7414b req-4176c25d-642e-4f7a-a0a8-be454fb41aca service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Updating instance_info_cache with network_info: [{"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:14.977058 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00040272400019603083 future=<Future at 0x726e385feff0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:14.977444 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:14.977554 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.0192290899999534 future=<Future at 0x726e38779850 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:14.977652 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.0191186960000778 future=<Future at 0x726e38779850 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:14.977919 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] Emitting event <LifecycleEvent: 1779923519.9764788, 64b32e51-54ce-40c1-b92a-aa92dd7a5132 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:14.978079 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] VM Stopped (Lifecycle Event)
May 27 23:12:15.029174 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:12:15.030245 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:12:15.030566 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Creating image(s)
May 27 23:12:15.031129 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "/opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:15.031356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "/opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:15.031974 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "/opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:15.032508 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:15.036637 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:15.038103 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:15.128846 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:15.129733 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:15.132251 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:15.132758 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:15.145107 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:15.146394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:15.174716 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:15.237430 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:12:15.240516 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:15.241135 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:15.297708 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk 1073741824" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:15.298160 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:15.298512 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:15.376868 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5cd00584-b69d-449f-b5bd-0f112deef7a7 req-9fa84975-b017-4b7e-943f-b21645b3d96a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:15.391509 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:15.394901 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:12:15.395183 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:15.437553 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ac0490a1-a068-4524-a926-d2cdd7a7414b req-4176c25d-642e-4f7a-a0a8-be454fb41aca service nova] Releasing lock "refresh_cache-10612118-f248-450c-89e3-663051a76135" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:15.476908 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:15.482667 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8644d169-bb07-4eba-a74b-f7fcf26aff82 tempest-VolumesExtendAttachedTest-527819065 tempest-VolumesExtendAttachedTest-527819065-project-member] [instance: 64b32e51-54ce-40c1-b92a-aa92dd7a5132] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:15.504408 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:15.504821 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Cannot resize image /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:12:15.505485 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:12:15.505485 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Ensure instance console log exists: /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:12:15.505485 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:15.505745 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:15.505866 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:15.626678 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Updating instance_info_cache with network_info: [{"id": "3466db96-43a9-4200-98b2-22f646c08556", "address": "fa:16:3e:02:b4:f6", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3466db96-43", "ovs_interfaceid": "3466db96-43a9-4200-98b2-22f646c08556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:15.778537 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5cd00584-b69d-449f-b5bd-0f112deef7a7 req-9fa84975-b017-4b7e-943f-b21645b3d96a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:15.790919 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f99a92ae-e7ae-48f4-9acc-d8804d070946 req-297146a1-bf4b-464e-bac7-bf077776ec53 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-changed-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:15.791964 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f99a92ae-e7ae-48f4-9acc-d8804d070946 req-297146a1-bf4b-464e-bac7-bf077776ec53 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Refreshing instance network info cache due to event network-changed-3466db96-43a9-4200-98b2-22f646c08556. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:12:15.792110 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f99a92ae-e7ae-48f4-9acc-d8804d070946 req-297146a1-bf4b-464e-bac7-bf077776ec53 service nova] Acquiring lock "refresh_cache-bebf4b9c-132d-4bc4-aeed-d47f935bc548" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:15.903203 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5cd00584-b69d-449f-b5bd-0f112deef7a7 req-9fa84975-b017-4b7e-943f-b21645b3d96a service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updated VIF entry in instance network info cache for port 095b1112-b13d-4a74-bf06-ffb6ed339a83. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:12:15.903558 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5cd00584-b69d-449f-b5bd-0f112deef7a7 req-9fa84975-b017-4b7e-943f-b21645b3d96a service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updating instance_info_cache with network_info: [{"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:16.072038 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:16.072253 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:16.072433 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No VIF found with MAC fa:16:3e:b8:17:8d, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:12:16.073135 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Using config drive
May 27 23:12:16.131576 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Releasing lock "refresh_cache-bebf4b9c-132d-4bc4-aeed-d47f935bc548" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:16.131971 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Instance network_info: |[{"id": "3466db96-43a9-4200-98b2-22f646c08556", "address": "fa:16:3e:02:b4:f6", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3466db96-43", "ovs_interfaceid": "3466db96-43a9-4200-98b2-22f646c08556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:12:16.133734 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f99a92ae-e7ae-48f4-9acc-d8804d070946 req-297146a1-bf4b-464e-bac7-bf077776ec53 service nova] Acquired lock "refresh_cache-bebf4b9c-132d-4bc4-aeed-d47f935bc548" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:16.134218 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f99a92ae-e7ae-48f4-9acc-d8804d070946 req-297146a1-bf4b-464e-bac7-bf077776ec53 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Refreshing network info cache for port 3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:12:16.134741 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Start _get_guest_xml network_info=[{"id": "3466db96-43a9-4200-98b2-22f646c08556", "address": "fa:16:3e:02:b4:f6", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3466db96-43", "ovs_interfaceid": "3466db96-43a9-4200-98b2-22f646c08556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:12:16.137047 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:12:16.138215 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-149121409', uuid='bebf4b9c-132d-4bc4-aeed-d47f935bc548'), owner=OwnerMeta(userid='067b6ee5c2a64c49b4996bfdb0da2f92', username='tempest-VolumesActionsTest-366756017-project-member', projectid='a6fdabf383b34e58a2e73a840bb71c7e', projectname='tempest-VolumesActionsTest-366756017'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3466db96-43a9-4200-98b2-22f646c08556", "address": "fa:16:3e:02:b4:f6", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3466db96-43", "ovs_interfaceid": "3466db96-43a9-4200-98b2-22f646c08556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923536.1379218) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:12:16.139423 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:12:16.139798 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:12:16.140735 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:12:16.140956 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:12:16.141848 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:12:16.142294 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:12:16.142697 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:12:16.143025 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:12:16.143224 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:12:16.143403 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:12:16.143604 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:12:16.143811 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:12:16.144001 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:12:16.144284 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:12:16.147350 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:12:16.147350 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:12:16.154005 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-149121409',display_name='tempest-VolumesActionsTest-instance-149121409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesactionstest-instance-149121409',id=55,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fdabf383b34e58a2e73a840bb71c7e',ramdisk_id='',reservation_id='r-vlzzs6xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-366756017',owner_user_name='tempest-VolumesActionsTest-366756017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:12:14Z,user_data=None,user_id='067b6ee5c2a64c49b4996bfdb0da2f92',uuid=bebf4b9c-132d-4bc4-aeed-d47f935bc548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3466db96-43a9-4200-98b2-22f646c08556", "address": "fa:16:3e:02:b4:f6", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3466db96-43", "ovs_interfaceid": "3466db96-43a9-4200-98b2-22f646c08556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:12:16.154341 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converting VIF {"id": "3466db96-43a9-4200-98b2-22f646c08556", "address": "fa:16:3e:02:b4:f6", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3466db96-43", "ovs_interfaceid": "3466db96-43a9-4200-98b2-22f646c08556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:16.154963 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3466db96-43a9-4200-98b2-22f646c08556,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3466db96-43') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:16.155766 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lazy-loading 'pci_devices' on Instance uuid bebf4b9c-132d-4bc4-aeed-d47f935bc548 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:16.405595 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5cd00584-b69d-449f-b5bd-0f112deef7a7 req-9fa84975-b017-4b7e-943f-b21645b3d96a service nova] Releasing lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:16.579414 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:16.637414 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f99a92ae-e7ae-48f4-9acc-d8804d070946 req-297146a1-bf4b-464e-bac7-bf077776ec53 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:16.658436 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] End _get_guest_xml xml=<domain type="qemu">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <uuid>bebf4b9c-132d-4bc4-aeed-d47f935bc548</uuid>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <name>instance-00000037</name>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumesActionsTest-instance-149121409</nova:name>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:12:16</nova:creationTime>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:user uuid="067b6ee5c2a64c49b4996bfdb0da2f92">tempest-VolumesActionsTest-366756017-project-member</nova:user>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:project uuid="a6fdabf383b34e58a2e73a840bb71c7e">tempest-VolumesActionsTest-366756017</nova:project>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         <nova:port uuid="3466db96-43a9-4200-98b2-22f646c08556">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <system>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <entry name="serial">bebf4b9c-132d-4bc4-aeed-d47f935bc548</entry>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <entry name="uuid">bebf4b9c-132d-4bc4-aeed-d47f935bc548</entry>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     </system>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <os>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   </os>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <features>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   </features>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   <devices>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     </disk>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk.config"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     </disk>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:02:b4:f6"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <target dev="tap3466db96-43"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     </interface>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/console.log" append="off"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     </serial>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <video>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     </video>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     </rng>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:   </devices>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]: </domain>
May 27 23:12:16.658436 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:12:16.660114 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Preparing to wait for external event network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:12:16.660114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:16.660114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:16.660114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:16.660114 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-149121409',display_name='tempest-VolumesActionsTest-instance-149121409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesactionstest-instance-149121409',id=55,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fdabf383b34e58a2e73a840bb71c7e',ramdisk_id='',reservation_id='r-vlzzs6xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-366756017',owner_user_name='tempest-VolumesActionsTest-366756017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:12:14Z,user_data=None,user_id='067b6ee5c2a64c49b4996bfdb0da2f92',uuid=bebf4b9c-132d-4bc4-aeed-d47f935bc548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3466db96-43a9-4200-98b2-22f646c08556", "address": "fa:16:3e:02:b4:f6", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3466db96-43", "ovs_interfaceid": "3466db96-43a9-4200-98b2-22f646c08556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:12:16.660114 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converting VIF {"id": "3466db96-43a9-4200-98b2-22f646c08556", "address": "fa:16:3e:02:b4:f6", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3466db96-43", "ovs_interfaceid": "3466db96-43a9-4200-98b2-22f646c08556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:16.660962 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3466db96-43a9-4200-98b2-22f646c08556,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3466db96-43') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:16.661073 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3466db96-43a9-4200-98b2-22f646c08556,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3466db96-43') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:12:16.663657 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:16.664511 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:16.664511 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:12:16.665356 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:16.665558 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c62c4484-9b02-5ce6-a583-647185fd7cf3', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:16.666613 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:16.667250 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:16.678813 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:16.684200 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:16.684200 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3466db96-43, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:16.684563 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3466db96-43, col_values=(('qos', UUID('9faef612-091f-46db-9f59-457b47e29c17')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:16.685058 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3466db96-43, col_values=(('external_ids', {'iface-id': '3466db96-43a9-4200-98b2-22f646c08556', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:b4:f6', 'vm-uuid': 'bebf4b9c-132d-4bc4-aeed-d47f935bc548'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:16.685827 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:16.686938 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:16.698670 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:16.699235 np0000001565 nova-compute[98289]: INFO os_vif [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3466db96-43a9-4200-98b2-22f646c08556,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3466db96-43')
May 27 23:12:16.747832 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Creating config drive at /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk.config
May 27 23:12:16.751910 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkpjdrhzt {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:16.818927 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkpjdrhzt" returned: 0 in 0.067s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:16.958094 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f99a92ae-e7ae-48f4-9acc-d8804d070946 req-297146a1-bf4b-464e-bac7-bf077776ec53 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:16.997453 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0006122730001152377 future=<Future at 0x726e38779850 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:16.998114 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Emitting event <LifecycleEvent: 1779923521.996725, 4fa535f0-639b-458c-aec2-3229efb09a8d => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:16.998373 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:16.998578 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] VM Stopped (Lifecycle Event)
May 27 23:12:17.095495 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f99a92ae-e7ae-48f4-9acc-d8804d070946 req-297146a1-bf4b-464e-bac7-bf077776ec53 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Updated VIF entry in instance network info cache for port 3466db96-43a9-4200-98b2-22f646c08556. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:12:17.095812 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f99a92ae-e7ae-48f4-9acc-d8804d070946 req-297146a1-bf4b-464e-bac7-bf077776ec53 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Updating instance_info_cache with network_info: [{"id": "3466db96-43a9-4200-98b2-22f646c08556", "address": "fa:16:3e:02:b4:f6", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3466db96-43", "ovs_interfaceid": "3466db96-43a9-4200-98b2-22f646c08556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:17.240558 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:17.283935 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:17.375364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:17.501437 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-367a6fc4-1923-4054-be89-3b9066bd2bc0 req-7ba38474-6e3c-49a3-8bc4-b59a7c3a4a14 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Received event network-vif-plugged-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:17.501917 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-367a6fc4-1923-4054-be89-3b9066bd2bc0 req-7ba38474-6e3c-49a3-8bc4-b59a7c3a4a14 service nova] Acquiring lock "10612118-f248-450c-89e3-663051a76135-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:17.502213 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-367a6fc4-1923-4054-be89-3b9066bd2bc0 req-7ba38474-6e3c-49a3-8bc4-b59a7c3a4a14 service nova] Lock "10612118-f248-450c-89e3-663051a76135-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:17.502402 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-367a6fc4-1923-4054-be89-3b9066bd2bc0 req-7ba38474-6e3c-49a3-8bc4-b59a7c3a4a14 service nova] Lock "10612118-f248-450c-89e3-663051a76135-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:17.502594 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-367a6fc4-1923-4054-be89-3b9066bd2bc0 req-7ba38474-6e3c-49a3-8bc4-b59a7c3a4a14 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Processing event network-vif-plugged-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:12:17.503620 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: 4fa535f0-639b-458c-aec2-3229efb09a8d] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:17.594129 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:17.598505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f99a92ae-e7ae-48f4-9acc-d8804d070946 req-297146a1-bf4b-464e-bac7-bf077776ec53 service nova] Releasing lock "refresh_cache-bebf4b9c-132d-4bc4-aeed-d47f935bc548" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:17.603013 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:17.605699 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:17.630231 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:17.870860 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:17.870860 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:18.054203 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923538.0531, 10612118-f248-450c-89e3-663051a76135 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:18.055271 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:12:18.055271 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 10612118-f248-450c-89e3-663051a76135] VM Started (Lifecycle Event)
May 27 23:12:18.057766 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:12:18.062746 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 10612118-f248-450c-89e3-663051a76135] Instance spawned successfully.
May 27 23:12:18.063092 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:12:18.218094 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:18.220462 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:18.220663 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] No VIF found with MAC fa:16:3e:02:b4:f6, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:12:18.221190 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Using config drive
May 27 23:12:18.372411 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Detaching volume d1818a0b-4891-41e9-b731-7563af964135
May 27 23:12:18.411218 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attempting to driver detach volume d1818a0b-4891-41e9-b731-7563af964135 from mountpoint /dev/vdb
May 27 23:12:18.414789 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found disk vdb by alias ua-d1818a0b-4891-41e9-b731-7563af964135 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:12:18.415725 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found disk vdb by alias ua-d1818a0b-4891-41e9-b731-7563af964135 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:12:18.415831 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Attempting to detach device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:12:18.416052 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:12:18.416052 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:18.416052 np0000001565 nova-compute[98289]:   <alias name="ua-d1818a0b-4891-41e9-b731-7563af964135"/>
May 27 23:12:18.416052 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:12:18.416052 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:12:18.416052 np0000001565 nova-compute[98289]:   <serial>d1818a0b-4891-41e9-b731-7563af964135</serial>
May 27 23:12:18.416052 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:12:18.416052 np0000001565 nova-compute[98289]: </disk>
May 27 23:12:18.416052 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:12:18.422170 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Successfully detached device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the persistent domain config.
May 27 23:12:18.422272 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] (1/8): Attempting to detach device vdb with device alias ua-d1818a0b-4891-41e9-b731-7563af964135 from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:12:18.422551 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:12:18.422551 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:18.422551 np0000001565 nova-compute[98289]:   <alias name="ua-d1818a0b-4891-41e9-b731-7563af964135"/>
May 27 23:12:18.422551 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:12:18.422551 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:12:18.422551 np0000001565 nova-compute[98289]:   <serial>d1818a0b-4891-41e9-b731-7563af964135</serial>
May 27 23:12:18.422551 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:12:18.422551 np0000001565 nova-compute[98289]: </disk>
May 27 23:12:18.422551 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:12:18.559392 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 10612118-f248-450c-89e3-663051a76135] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:18.561667 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 10612118-f248-450c-89e3-663051a76135] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:12:18.572497 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:18.572709 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:18.573942 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:18.575740 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:18.576269 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:18.576605 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:18.732360 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:18.851714 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:18.883859 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Creating config drive at /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk.config
May 27 23:12:18.887162 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyy4eatwm {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:18.949195 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyy4eatwm" returned: 0 in 0.062s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:18.974572 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:19.031149 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d1818a0b-4891-41e9-b731-7563af964135 for instance 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:12:19.065227 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 10612118-f248-450c-89e3-663051a76135] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:12:19.066316 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923539.0654292, 10612118-f248-450c-89e3-663051a76135 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:19.066316 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 10612118-f248-450c-89e3-663051a76135] VM Paused (Lifecycle Event)
May 27 23:12:19.082558 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Took 6.41 seconds to spawn the instance on the hypervisor.
May 27 23:12:19.084911 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:19.446898 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:19.470927 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:19.575690 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 10612118-f248-450c-89e3-663051a76135] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:19.579776 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5f341d81-13d4-455c-8c3e-2e8d4dce2a90 req-8d7e5989-0671-4ce2-bc50-6b8f4da8bbbc service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Received event network-vif-plugged-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:19.580069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5f341d81-13d4-455c-8c3e-2e8d4dce2a90 req-8d7e5989-0671-4ce2-bc50-6b8f4da8bbbc service nova] Acquiring lock "10612118-f248-450c-89e3-663051a76135-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:19.580285 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5f341d81-13d4-455c-8c3e-2e8d4dce2a90 req-8d7e5989-0671-4ce2-bc50-6b8f4da8bbbc service nova] Lock "10612118-f248-450c-89e3-663051a76135-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:19.580530 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5f341d81-13d4-455c-8c3e-2e8d4dce2a90 req-8d7e5989-0671-4ce2-bc50-6b8f4da8bbbc service nova] Lock "10612118-f248-450c-89e3-663051a76135-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:19.580628 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5f341d81-13d4-455c-8c3e-2e8d4dce2a90 req-8d7e5989-0671-4ce2-bc50-6b8f4da8bbbc service nova] [instance: 10612118-f248-450c-89e3-663051a76135] No waiting events found dispatching network-vif-plugged-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:19.580803 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5f341d81-13d4-455c-8c3e-2e8d4dce2a90 req-8d7e5989-0671-4ce2-bc50-6b8f4da8bbbc service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Received unexpected event network-vif-plugged-c5b4131d-a64d-4a3a-8a46-903138712db9 for instance with vm_state active and task_state None.
May 27 23:12:19.595177 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:19.597494 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923539.5967505, 10612118-f248-450c-89e3-663051a76135 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:19.601631 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Took 11.90 seconds to build instance.
May 27 23:12:19.602571 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 10612118-f248-450c-89e3-663051a76135] VM Resumed (Lifecycle Event)
May 27 23:12:19.822668 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:19.827927 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-40939eb0-a62b-4765-be6f-491617e4a19e req-d61a371d-a12f-4ef9-8c6c-cc6393a7f9e8 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:19.827927 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40939eb0-a62b-4765-be6f-491617e4a19e req-d61a371d-a12f-4ef9-8c6c-cc6393a7f9e8 service nova] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:19.827927 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40939eb0-a62b-4765-be6f-491617e4a19e req-d61a371d-a12f-4ef9-8c6c-cc6393a7f9e8 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:19.827927 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40939eb0-a62b-4765-be6f-491617e4a19e req-d61a371d-a12f-4ef9-8c6c-cc6393a7f9e8 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:19.827927 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-40939eb0-a62b-4765-be6f-491617e4a19e req-d61a371d-a12f-4ef9-8c6c-cc6393a7f9e8 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Processing event network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:12:19.889342 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:19.891364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:19.900874 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:19.923652 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:20.104496 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e2cffe88-c9c0-4f9e-8bab-12a00819dfe5 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.410s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:20.109022 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 10612118-f248-450c-89e3-663051a76135] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:20.112134 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 10612118-f248-450c-89e3-663051a76135] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:12:20.402083 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:12:20.403613 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:12:20.406149 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Instance spawned successfully.
May 27 23:12:20.407282 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:12:20.616725 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923540.6162817, 8eb7e5db-7164-4713-86c9-13ed200502f6 => ua-d1818a0b-4891-41e9-b731-7563af964135> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:12:20.617613 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923540.6173704, bebf4b9c-132d-4bc4-aeed-d47f935bc548 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:20.617797 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] VM Started (Lifecycle Event)
May 27 23:12:20.623495 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Successfully detached device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the live domain config.
May 27 23:12:20.625191 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:12:20.625850 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1818a0b-4891-41e9-b731-7563af964135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:20.626039 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:20.626727 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:20.627135 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1818a0b-4891-41e9-b731-7563af964135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:12:20.627315 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:12:20.659826 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:20.659826 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:20.659826 np0000001565 nova-compute[98289]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:20.659826 np0000001565 nova-compute[98289]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:20.659826 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:20.660090 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:20.660090 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:20.660090 np0000001565 nova-compute[98289]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:20.660090 np0000001565 nova-compute[98289]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135 (non-flash)
May 27 23:12:20.660090 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:20.660189 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', '118')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:12:20.660390 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', '117')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:12:20.661228 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135', '118')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:12:20.662729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e601ad440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:12:20.662994 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Removing multipathed devices sdd, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:12:20.663241 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Flush multipath device 3300000003559f67b {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:12:20.705005 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:12:20.771849 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:12:20.812891 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:12:20.813032 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:12:20.813934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:12:20.825418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:12:20.826119 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:12:20.838255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:20.874081 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135, portal: 192.168.40.100,3260]
May 27 23:12:20.874081 np0000001565 nova-compute[98289]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135, portal: 192.168.40.100,3260] successful.
May 27 23:12:20.874081 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:20.897571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:20.912355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:20.918281 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:20.918281 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:20.918281 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:20.918281 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:20.918281 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:20.918281 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:20.946686 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135, portal: 192.168.50.100,3260]
May 27 23:12:20.946686 np0000001565 nova-compute[98289]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-d1818a0b-4891-41e9-b731-7563af964135, portal: 192.168.50.100,3260] successful.
May 27 23:12:20.946686 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:20.960108 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:20.960483 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:20.960660 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== disconnect_volume: return (334ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:20.960779 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:12:21.120869 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:21.122841 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:12:21.425114 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Took 6.40 seconds to spawn the instance on the hypervisor.
May 27 23:12:21.425258 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:21.513289 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fe3f1b5d-31f6-448e-a025-b2f503ee4baa req-ee581ad7-9008-4c3d-b925-49afebf151d4 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Received event network-changed-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:21.513359 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fe3f1b5d-31f6-448e-a025-b2f503ee4baa req-ee581ad7-9008-4c3d-b925-49afebf151d4 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Refreshing instance network info cache due to event network-changed-c5b4131d-a64d-4a3a-8a46-903138712db9. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:12:21.513760 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe3f1b5d-31f6-448e-a025-b2f503ee4baa req-ee581ad7-9008-4c3d-b925-49afebf151d4 service nova] Acquiring lock "refresh_cache-10612118-f248-450c-89e3-663051a76135" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:21.513760 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe3f1b5d-31f6-448e-a025-b2f503ee4baa req-ee581ad7-9008-4c3d-b925-49afebf151d4 service nova] Acquired lock "refresh_cache-10612118-f248-450c-89e3-663051a76135" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:21.513904 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fe3f1b5d-31f6-448e-a025-b2f503ee4baa req-ee581ad7-9008-4c3d-b925-49afebf151d4 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Refreshing network info cache for port c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:12:21.539147 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:21.625365 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:12:21.625652 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923541.625276, bebf4b9c-132d-4bc4-aeed-d47f935bc548 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:21.625786 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] VM Paused (Lifecycle Event)
May 27 23:12:21.684029 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:21.687121 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:21.932388 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b1395f4-808b-4ebc-ab70-f56bbf23d024 req-1add86ea-3f36-4b46-822d-bd03f633842e service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:21.932388 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b1395f4-808b-4ebc-ab70-f56bbf23d024 req-1add86ea-3f36-4b46-822d-bd03f633842e service nova] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:21.932388 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b1395f4-808b-4ebc-ab70-f56bbf23d024 req-1add86ea-3f36-4b46-822d-bd03f633842e service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:21.932388 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3b1395f4-808b-4ebc-ab70-f56bbf23d024 req-1add86ea-3f36-4b46-822d-bd03f633842e service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:21.934285 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3b1395f4-808b-4ebc-ab70-f56bbf23d024 req-1add86ea-3f36-4b46-822d-bd03f633842e service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] No waiting events found dispatching network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:21.934494 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3b1395f4-808b-4ebc-ab70-f56bbf23d024 req-1add86ea-3f36-4b46-822d-bd03f633842e service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received unexpected event network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 for instance with vm_state active and task_state None.
May 27 23:12:21.935095 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Took 12.06 seconds to build instance.
May 27 23:12:22.017667 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-fe3f1b5d-31f6-448e-a025-b2f503ee4baa req-ee581ad7-9008-4c3d-b925-49afebf151d4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:22.130313 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:22.134795 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923542.13454, bebf4b9c-132d-4bc4-aeed-d47f935bc548 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:22.135007 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] VM Resumed (Lifecycle Event)
May 27 23:12:22.312276 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-fe3f1b5d-31f6-448e-a025-b2f503ee4baa req-ee581ad7-9008-4c3d-b925-49afebf151d4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:22.430004 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fe3f1b5d-31f6-448e-a025-b2f503ee4baa req-ee581ad7-9008-4c3d-b925-49afebf151d4 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Updated VIF entry in instance network info cache for port c5b4131d-a64d-4a3a-8a46-903138712db9. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:12:22.430325 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fe3f1b5d-31f6-448e-a025-b2f503ee4baa req-ee581ad7-9008-4c3d-b925-49afebf151d4 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Updating instance_info_cache with network_info: [{"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:22.437340 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.569s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:22.547698 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-08b49600-98fc-4863-9168-f1bf3241129c tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.677s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:22.637857 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:22.640259 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:12:22.932493 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fe3f1b5d-31f6-448e-a025-b2f503ee4baa req-ee581ad7-9008-4c3d-b925-49afebf151d4 service nova] Releasing lock "refresh_cache-10612118-f248-450c-89e3-663051a76135" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:23.990965 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:24.226515 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:24.226699 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:24.397528 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:24.398008 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:24.644566 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:24.644743 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:24.644916 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:24.645176 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:24.645445 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:24.647962 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Terminating instance
May 27 23:12:24.728403 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:12:24.901010 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:25.151087 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:12:25.165697 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.169705 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.186501 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.200730 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.217423 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.221922 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.281826 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:25.282746 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:25.287846 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:12:25.288291 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Claim successful on node np0000001565
May 27 23:12:25.305021 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-da83af1f-348a-49c8-9d57-f48582f352f6 req-cdd83f5e-4441-4ed9-a5fe-9d5122da9202 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:25.305259 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-da83af1f-348a-49c8-9d57-f48582f352f6 req-cdd83f5e-4441-4ed9-a5fe-9d5122da9202 service nova] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:25.307758 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-da83af1f-348a-49c8-9d57-f48582f352f6 req-cdd83f5e-4441-4ed9-a5fe-9d5122da9202 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:25.308429 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-da83af1f-348a-49c8-9d57-f48582f352f6 req-cdd83f5e-4441-4ed9-a5fe-9d5122da9202 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:25.309676 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-da83af1f-348a-49c8-9d57-f48582f352f6 req-cdd83f5e-4441-4ed9-a5fe-9d5122da9202 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] No waiting events found dispatching network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:25.309805 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-da83af1f-348a-49c8-9d57-f48582f352f6 req-cdd83f5e-4441-4ed9-a5fe-9d5122da9202 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:12:25.444407 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.471378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.476123 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.488005 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999728613000116 future=<Future at 0x726e386a5880 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:25.488384 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999351352000303 future=<Future at 0x726e386a5880 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:25.488865 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998851145000117 future=<Future at 0x726e386a5880 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:25.489415 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Instance destroyed successfully.
May 27 23:12:25.489733 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lazy-loading 'resources' on Instance uuid bebf4b9c-132d-4bc4-aeed-d47f935bc548 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:25.493343 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.807518 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.815014 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.818299 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.841280 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.848302 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.910925 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:25.947010 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.969202 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.970035 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.993996 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-149121409',display_name='tempest-VolumesActionsTest-instance-149121409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesactionstest-instance-149121409',id=55,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:12:21Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6fdabf383b34e58a2e73a840bb71c7e',ramdisk_id='',reservation_id='r-vlzzs6xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-366756017',owner_user_name='tempest-VolumesActionsTest-366756017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:12:21Z,user_data=None,user_id='067b6ee5c2a64c49b4996bfdb0da2f92',uuid=bebf4b9c-132d-4bc4-aeed-d47f935bc548,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3466db96-43a9-4200-98b2-22f646c08556", "address": "fa:16:3e:02:b4:f6", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3466db96-43", "ovs_interfaceid": "3466db96-43a9-4200-98b2-22f646c08556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:12:25.994209 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converting VIF {"id": "3466db96-43a9-4200-98b2-22f646c08556", "address": "fa:16:3e:02:b4:f6", "network": {"id": "909c1f65-73e3-4b86-98dd-a447d718e41b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1280116684-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6fdabf383b34e58a2e73a840bb71c7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3466db96-43", "ovs_interfaceid": "3466db96-43a9-4200-98b2-22f646c08556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:25.994946 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3466db96-43a9-4200-98b2-22f646c08556,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3466db96-43') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:25.995240 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3466db96-43a9-4200-98b2-22f646c08556,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3466db96-43') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:12:25.997734 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.998674 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3466db96-43, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:25.999859 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:25.999859 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:26.000380 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:26.002273 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:26.002273 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9faef612-091f-46db-9f59-457b47e29c17) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:26.003084 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:26.003084 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:26.004393 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:26.006220 np0000001565 nova-compute[98289]: INFO os_vif [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3466db96-43a9-4200-98b2-22f646c08556,network=Network(909c1f65-73e3-4b86-98dd-a447d718e41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3466db96-43')
May 27 23:12:26.006567 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Deleting instance files /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548_del
May 27 23:12:26.007242 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Deletion of /opt/stack/data/nova/instances/bebf4b9c-132d-4bc4-aeed-d47f935bc548_del complete
May 27 23:12:26.515203 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 23:12:26.515919 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:12:26.516146 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:12:26.516236 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:12:26.516497 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:26.587189 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:26.590869 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:12:26.591099 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:12:27.040449 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aef9577e-47af-4330-898f-c08368b42e03 req-6e49257a-1482-4102-8ae8-805652805a58 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-deleted-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:27.040613 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-aef9577e-47af-4330-898f-c08368b42e03 req-6e49257a-1482-4102-8ae8-805652805a58 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Neutron deleted interface 3466db96-43a9-4200-98b2-22f646c08556; detaching it from the instance and deleting it from the info cache
May 27 23:12:27.044393 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aef9577e-47af-4330-898f-c08368b42e03 req-6e49257a-1482-4102-8ae8-805652805a58 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Detach interface failed, port_id=3466db96-43a9-4200-98b2-22f646c08556, reason: Instance bebf4b9c-132d-4bc4-aeed-d47f935bc548 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:12:27.063249 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:27.064795 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:27.064795 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attaching volume e0c5cffc-a4ea-4a95-a506-11df236c2958 to /dev/vdb
May 27 23:12:27.095628 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:12:27.101907 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:27.118476 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:12:27.138872 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:27.187092 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:12:27.188643 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:12:27.199032 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:12:27.200229 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe7b:2415', 'fe80::ceb:9eff:fef9:ea15', 'fe80::fc16:3eff:fe03:7c08', 'fe80::e899:e2ff:fe2c:df98', 'fe80::fc16:3eff:feb8:178d', 'fe80::bc78:52ff:fe4d:ba0f'] 
May 27 23:12:27.200391 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:12:27.200547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:12:27.200804 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:27.201049 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Updating existing volume attachment record: 1c865d12-3eca-4536-8ef9-003a7f2e1a07 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:12:27.367315 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:27.367900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:27.368106 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:27.368321 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:27.368444 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] No waiting events found dispatching network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:27.368498 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:12:27.368605 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:27.368720 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:27.368840 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:27.368939 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:27.369071 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] No waiting events found dispatching network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:27.369146 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received unexpected event network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 for instance with vm_state active and task_state deleting.
May 27 23:12:27.369263 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:27.369389 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:27.369511 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:27.369631 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:27.369717 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] No waiting events found dispatching network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:27.369821 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received unexpected event network-vif-plugged-3466db96-43a9-4200-98b2-22f646c08556 for instance with vm_state active and task_state deleting.
May 27 23:12:27.369950 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:27.370023 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:27.370148 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:27.370553 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:27.370661 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] No waiting events found dispatching network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:27.370765 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:12:27.370860 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:27.370963 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Acquiring lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:27.371080 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:27.371173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:27.371281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] No waiting events found dispatching network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:27.371396 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c0b2e37b-cd1b-471f-b963-a381d3b501da req-db3e59de-cc3f-40f2-b1df-858b1d653da6 service nova] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Received event network-vif-unplugged-3466db96-43a9-4200-98b2-22f646c08556 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:12:27.487873 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:27.603660 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.320s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:27.603660 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:12:27.765489 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:12:27.765835 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0c5cffc-a4ea-4a95-a506-11df236c2958', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:27.766153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:27.766729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:27.766920 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0c5cffc-a4ea-4a95-a506-11df236c2958', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:12:27.778559 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:27.779045 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:27.781161 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:27.781380 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:27.781742 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:27.781928 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:27.792516 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:27.792516 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:27.798466 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:27.798466 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:27.804560 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958] added
May 27 23:12:27.804560 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:27.804560 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:27.804560 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:27.804560 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:27.804560 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:27.804560 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:27.804765 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:27.804965 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:27.805143 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:27.809687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958] added
May 27 23:12:27.809687 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:27.809687 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:27.809687 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:27.809687 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:27.809687 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:27.809687 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:27.809841 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:27.810012 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:27.810156 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:27.989999 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Took 1.47 seconds to deallocate network for instance.
May 27 23:12:28.113580 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:12:28.114480 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:12:28.116170 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:28.116170 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:28.190792 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '984773a4d7b041688390f2c89696b5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712851e990684e0eabb135f1e10663d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:12:28.501986 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:28.501986 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:28.584721 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Successfully created port: 2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:12:28.617111 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:12:28.802830 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:12:28.802830 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:12:28.805494 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:28.811258 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:28.819070 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:28.819070 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:28.821811 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:28.821811 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:28.832878 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:28.843494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:28.851596 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.851596 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.851596 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:28.851729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.851729 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.851729 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:28.857274 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.857274 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.857274 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:28.857427 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.857427 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.857427 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:28.885683 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958, portal: 192.168.40.100,3260]
May 27 23:12:28.885683 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958, portal: 192.168.40.100,3260] successful.
May 27 23:12:28.885683 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:28.890696 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958, portal: 192.168.50.100,3260]
May 27 23:12:28.890696 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958, portal: 192.168.50.100,3260] successful.
May 27 23:12:28.890696 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:28.898671 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:28.904455 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:28.912627 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.912627 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.912627 np0000001565 nova-compute[98289]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:28.912627 np0000001565 nova-compute[98289]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:28.912627 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:28.912800 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.912800 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.912800 np0000001565 nova-compute[98289]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:28.912800 np0000001565 nova-compute[98289]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:28.912800 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:28.912919 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:28.913046 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:28.913717 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] HCTL ('9', '-', '-', 0) found on session 119 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:28.913824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:28.919493 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.919493 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.919493 np0000001565 nova-compute[98289]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:28.919493 np0000001565 nova-compute[98289]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:28.919493 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:28.919603 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.919603 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:28.919603 np0000001565 nova-compute[98289]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:28.919603 np0000001565 nova-compute[98289]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:28.919603 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:28.919811 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:28.919907 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:28.920443 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] HCTL ('10', '-', '-', 0) found on session 120 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:28.920540 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:28.929323 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Searching for a device in session 119 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:28.929510 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0c5cffc-a4ea-4a95-a506-11df236c2958', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:28.941567 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Searching for a device in session 120 and hctl ['10', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:28.992926 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:29.080089 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Successfully updated port: 2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:12:29.119702 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:12:29.304003 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:12:29.432526 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-63eaa998-0297-425a-85f2-95dc06866f0e req-9a351b7c-69fa-4606-9b4c-9832ff6f1ba8 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received event network-changed-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:29.434086 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-63eaa998-0297-425a-85f2-95dc06866f0e req-9a351b7c-69fa-4606-9b4c-9832ff6f1ba8 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Refreshing instance network info cache due to event network-changed-2c18db18-9f6f-499b-9f78-0471883b7390. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:12:29.434304 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-63eaa998-0297-425a-85f2-95dc06866f0e req-9a351b7c-69fa-4606-9b4c-9832ff6f1ba8 service nova] Acquiring lock "refresh_cache-a3323d78-9845-4972-821e-daefe2bf4d67" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:29.434459 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-63eaa998-0297-425a-85f2-95dc06866f0e req-9a351b7c-69fa-4606-9b4c-9832ff6f1ba8 service nova] Acquired lock "refresh_cache-a3323d78-9845-4972-821e-daefe2bf4d67" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:29.434615 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-63eaa998-0297-425a-85f2-95dc06866f0e req-9a351b7c-69fa-4606-9b4c-9832ff6f1ba8 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Refreshing network info cache for port 2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:12:29.583831 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "refresh_cache-a3323d78-9845-4972-821e-daefe2bf4d67" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:29.812040 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.311s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:29.864579 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Deleted allocations for instance bebf4b9c-132d-4bc4-aeed-d47f935bc548
May 27 23:12:29.937116 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-63eaa998-0297-425a-85f2-95dc06866f0e req-9a351b7c-69fa-4606-9b4c-9832ff6f1ba8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:29.940120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Searching for a device in session 120 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:29.940283 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e0c5cffc-a4ea-4a95-a506-11df236c2958', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:29.990943 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-63eaa998-0297-425a-85f2-95dc06866f0e req-9a351b7c-69fa-4606-9b4c-9832ff6f1ba8 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:12:30.122035 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-63eaa998-0297-425a-85f2-95dc06866f0e req-9a351b7c-69fa-4606-9b4c-9832ff6f1ba8 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:30.126779 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:12:30.128355 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:12:30.128355 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Creating image(s)
May 27 23:12:30.128851 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:30.129376 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "/opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:30.129913 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "/opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:30.130520 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:30.133162 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:30.135950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:30.213839 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.079s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:30.214507 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:30.215049 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:30.215594 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:30.218170 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:12:30.218585 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:30.301788 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.081s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:30.305404 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:30.357256 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk 1073741824" returned: 0 in 0.055s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:30.360345 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.143s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:30.360345 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:30.440438 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:30.444352 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:12:30.444352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:30.526210 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:30.527939 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Cannot resize image /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:12:30.527939 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:12:30.527939 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Ensure instance console log exists: /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:12:30.527939 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:30.527939 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:30.527939 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:30.624910 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-63eaa998-0297-425a-85f2-95dc06866f0e req-9a351b7c-69fa-4606-9b4c-9832ff6f1ba8 service nova] Releasing lock "refresh_cache-a3323d78-9845-4972-821e-daefe2bf4d67" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:30.625311 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquired lock "refresh_cache-a3323d78-9845-4972-821e-daefe2bf4d67" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:30.625504 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:12:30.799491 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found WWN 3300000007c0048e2 for multipath device dm-3 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:12:30.799934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:30.800136 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000007c0048e2', 'path': '/dev/dm-3', 'multipath_id': '3300000007c0048e2'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:30.800262 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007c0048e2', 'path': '/dev/dm-3', 'multipath_id': '3300000007c0048e2'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:12:30.804341 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:30.879130 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-34998531-a054-441c-b1f0-fc34619bc8c6 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Lock "bebf4b9c-132d-4bc4-aeed-d47f935bc548" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.234s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:31.002374 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:31.202914 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:12:31.308513 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attempting to attach volume e0c5cffc-a4ea-4a95-a506-11df236c2958 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:12:31.310307 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:12:31.310307 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:31.310307 np0000001565 nova-compute[98289]:   <alias name="ua-e0c5cffc-a4ea-4a95-a506-11df236c2958"/>
May 27 23:12:31.310307 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:12:31.310307 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:12:31.310307 np0000001565 nova-compute[98289]:   <serial>e0c5cffc-a4ea-4a95-a506-11df236c2958</serial>
May 27 23:12:31.310307 np0000001565 nova-compute[98289]: </disk>
May 27 23:12:31.310307 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:12:31.351050 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:31.489166 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Updating instance_info_cache with network_info: [{"id": "2c18db18-9f6f-499b-9f78-0471883b7390", "address": "fa:16:3e:c7:18:a2", "network": {"id": "1dd38190-e852-4640-b9c6-4821c4b409a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1658639789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "712851e990684e0eabb135f1e10663d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c18db18-9f", "ovs_interfaceid": "2c18db18-9f6f-499b-9f78-0471883b7390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:31.990568 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Releasing lock "refresh_cache-a3323d78-9845-4972-821e-daefe2bf4d67" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:31.991009 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Instance network_info: |[{"id": "2c18db18-9f6f-499b-9f78-0471883b7390", "address": "fa:16:3e:c7:18:a2", "network": {"id": "1dd38190-e852-4640-b9c6-4821c4b409a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1658639789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "712851e990684e0eabb135f1e10663d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c18db18-9f", "ovs_interfaceid": "2c18db18-9f6f-499b-9f78-0471883b7390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:12:31.992586 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Start _get_guest_xml network_info=[{"id": "2c18db18-9f6f-499b-9f78-0471883b7390", "address": "fa:16:3e:c7:18:a2", "network": {"id": "1dd38190-e852-4640-b9c6-4821c4b409a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1658639789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "712851e990684e0eabb135f1e10663d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c18db18-9f", "ovs_interfaceid": "2c18db18-9f6f-499b-9f78-0471883b7390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:12:31.994910 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:12:31.996085 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-369845223', uuid='a3323d78-9845-4972-821e-daefe2bf4d67'), owner=OwnerMeta(userid='984773a4d7b041688390f2c89696b5e0', username='tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member', projectid='712851e990684e0eabb135f1e10663d4', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-1979128910'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2c18db18-9f6f-499b-9f78-0471883b7390", "address": "fa:16:3e:c7:18:a2", "network": {"id": "1dd38190-e852-4640-b9c6-4821c4b409a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1658639789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "712851e990684e0eabb135f1e10663d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c18db18-9f", "ovs_interfaceid": "2c18db18-9f6f-499b-9f78-0471883b7390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923551.9957883) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:12:31.997232 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:12:31.997641 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:12:31.998590 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:12:31.998867 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:12:31.999796 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:12:32.002248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:12:32.002248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:12:32.002248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:12:32.002248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:12:32.002248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:12:32.002248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:12:32.002248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:12:32.002248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:12:32.002248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:12:32.002248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:12:32.002248 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:12:32.011033 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-369845223',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-369845223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testservervolumeattachscenariooldversion-server-3698452',id=56,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiNP5FJ9i9NYwl3EZ1Y6cqqE1kNKEV7ThOSTdN1xMqzSxKEDa9/LR1D2Esq4MtQRxE5zbivYmk5Zw79IQKfQK0S7EL3FzxHTNiJIIv1asajHR4mlZtbJQt06Ir2gu6Axw==',key_name='tempest-keypair-793516419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='712851e990684e0eabb135f1e10663d4',ramdisk_id='',reservation_id='r-5kv1nrn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1979128910',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='984773a4d7b041688390f2c89696b5e0',uuid=a3323d78-9845-4972-821e-daefe2bf4d67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c18db18-9f6f-499b-9f78-0471883b7390", "address": "fa:16:3e:c7:18:a2", "network": {"id": "1dd38190-e852-4640-b9c6-4821c4b409a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1658639789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "712851e990684e0eabb135f1e10663d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c18db18-9f", "ovs_interfaceid": "2c18db18-9f6f-499b-9f78-0471883b7390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:12:32.011442 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Converting VIF {"id": "2c18db18-9f6f-499b-9f78-0471883b7390", "address": "fa:16:3e:c7:18:a2", "network": {"id": "1dd38190-e852-4640-b9c6-4821c4b409a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1658639789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "712851e990684e0eabb135f1e10663d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c18db18-9f", "ovs_interfaceid": "2c18db18-9f6f-499b-9f78-0471883b7390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:32.012092 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=2c18db18-9f6f-499b-9f78-0471883b7390,network=Network(1dd38190-e852-4640-b9c6-4821c4b409a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c18db18-9f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:32.012689 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lazy-loading 'pci_devices' on Instance uuid a3323d78-9845-4972-821e-daefe2bf4d67 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:32.288978 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-48126c73-905b-4764-9aab-b200c6534c74 req-bb9a1f59-0c24-47e7-a872-ae8945f8f32f service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received event network-vif-unplugged-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:32.290114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-48126c73-905b-4764-9aab-b200c6534c74 req-bb9a1f59-0c24-47e7-a872-ae8945f8f32f service nova] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:32.290266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-48126c73-905b-4764-9aab-b200c6534c74 req-bb9a1f59-0c24-47e7-a872-ae8945f8f32f service nova] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:32.290394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-48126c73-905b-4764-9aab-b200c6534c74 req-bb9a1f59-0c24-47e7-a872-ae8945f8f32f service nova] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:32.290572 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-48126c73-905b-4764-9aab-b200c6534c74 req-bb9a1f59-0c24-47e7-a872-ae8945f8f32f service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] No waiting events found dispatching network-vif-unplugged-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:32.290635 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-48126c73-905b-4764-9aab-b200c6534c74 req-bb9a1f59-0c24-47e7-a872-ae8945f8f32f service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received unexpected event network-vif-unplugged-2c18db18-9f6f-499b-9f78-0471883b7390 for instance with vm_state building and task_state spawning.
May 27 23:12:32.517394 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] End _get_guest_xml xml=<domain type="qemu">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <uuid>a3323d78-9845-4972-821e-daefe2bf4d67</uuid>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <name>instance-00000038</name>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-369845223</nova:name>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:12:31</nova:creationTime>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:user uuid="984773a4d7b041688390f2c89696b5e0">tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member</nova:user>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:project uuid="712851e990684e0eabb135f1e10663d4">tempest-TestServerVolumeAttachScenarioOldVersion-1979128910</nova:project>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         <nova:port uuid="2c18db18-9f6f-499b-9f78-0471883b7390">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <system>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <entry name="serial">a3323d78-9845-4972-821e-daefe2bf4d67</entry>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <entry name="uuid">a3323d78-9845-4972-821e-daefe2bf4d67</entry>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     </system>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <os>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   </os>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <features>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   </features>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   <devices>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     </disk>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk.config"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     </disk>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:c7:18:a2"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <target dev="tap2c18db18-9f"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     </interface>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/console.log" append="off"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     </serial>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <video>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     </video>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     </rng>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:   </devices>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]: </domain>
May 27 23:12:32.517394 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:12:32.517394 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Preparing to wait for external event network-vif-plugged-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:12:32.517394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:32.517394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:32.517394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:32.517394 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-369845223',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-369845223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testservervolumeattachscenariooldversion-server-3698452',id=56,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiNP5FJ9i9NYwl3EZ1Y6cqqE1kNKEV7ThOSTdN1xMqzSxKEDa9/LR1D2Esq4MtQRxE5zbivYmk5Zw79IQKfQK0S7EL3FzxHTNiJIIv1asajHR4mlZtbJQt06Ir2gu6Axw==',key_name='tempest-keypair-793516419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='712851e990684e0eabb135f1e10663d4',ramdisk_id='',reservation_id='r-5kv1nrn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1979128910',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='984773a4d7b041688390f2c89696b5e0',uuid=a3323d78-9845-4972-821e-daefe2bf4d67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c18db18-9f6f-499b-9f78-0471883b7390", "address": "fa:16:3e:c7:18:a2", "network": {"id": "1dd38190-e852-4640-b9c6-4821c4b409a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1658639789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "712851e990684e0eabb135f1e10663d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c18db18-9f", "ovs_interfaceid": "2c18db18-9f6f-499b-9f78-0471883b7390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:12:32.517394 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Converting VIF {"id": "2c18db18-9f6f-499b-9f78-0471883b7390", "address": "fa:16:3e:c7:18:a2", "network": {"id": "1dd38190-e852-4640-b9c6-4821c4b409a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1658639789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "712851e990684e0eabb135f1e10663d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c18db18-9f", "ovs_interfaceid": "2c18db18-9f6f-499b-9f78-0471883b7390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:12:32.517394 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=2c18db18-9f6f-499b-9f78-0471883b7390,network=Network(1dd38190-e852-4640-b9c6-4821c4b409a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c18db18-9f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:12:32.517394 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=2c18db18-9f6f-499b-9f78-0471883b7390,network=Network(1dd38190-e852-4640-b9c6-4821c4b409a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c18db18-9f') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:12:32.519945 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:32.519945 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:32.519945 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:12:32.520874 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:32.520874 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '433d2771-5bc3-55ea-be48-53b263db72b8', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:32.522971 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:32.523651 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:32.523977 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:32.526619 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:32.526762 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c18db18-9f, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:32.527085 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c18db18-9f, col_values=(('qos', UUID('98b95c40-d63c-4128-becf-79719f4a7283')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:32.527244 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c18db18-9f, col_values=(('external_ids', {'iface-id': '2c18db18-9f6f-499b-9f78-0471883b7390', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:18:a2', 'vm-uuid': 'a3323d78-9845-4972-821e-daefe2bf4d67'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:12:32.527907 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:32.528958 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:12:32.533088 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:32.534590 np0000001565 nova-compute[98289]: INFO os_vif [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=2c18db18-9f6f-499b-9f78-0471883b7390,network=Network(1dd38190-e852-4640-b9c6-4821c4b409a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c18db18-9f')
May 27 23:12:32.962982 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:32.963134 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:32.963183 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:32.963254 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No VIF found with MAC fa:16:3e:93:34:97, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:12:34.001947 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:34.049888 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:34.050058 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:34.050168 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] No VIF found with MAC fa:16:3e:c7:18:a2, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:12:34.050617 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Using config drive
May 27 23:12:34.508857 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-81487819-901d-46df-8df1-50d5e69cbc11 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.445s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:34.559729 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:34.684974 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Creating config drive at /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk.config
May 27 23:12:34.688672 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptgmrovtn {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:34.740737 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptgmrovtn" returned: 0 in 0.052s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:35.125704 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:35.128344 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:35.148323 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:35.233186 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:35.316634 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2d42edbb-7f15-4303-86d3-f43a664f1b64 req-e80e9d3a-435e-4489-adb8-94bd024d9751 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received event network-vif-plugged-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:35.318584 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2d42edbb-7f15-4303-86d3-f43a664f1b64 req-e80e9d3a-435e-4489-adb8-94bd024d9751 service nova] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:35.318891 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2d42edbb-7f15-4303-86d3-f43a664f1b64 req-e80e9d3a-435e-4489-adb8-94bd024d9751 service nova] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:35.319111 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2d42edbb-7f15-4303-86d3-f43a664f1b64 req-e80e9d3a-435e-4489-adb8-94bd024d9751 service nova] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:35.319291 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2d42edbb-7f15-4303-86d3-f43a664f1b64 req-e80e9d3a-435e-4489-adb8-94bd024d9751 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Processing event network-vif-plugged-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:12:35.503671 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:35.506362 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:35.511461 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:35.532066 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:35.910185 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923555.9096816, a3323d78-9845-4972-821e-daefe2bf4d67 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:35.910860 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] VM Started (Lifecycle Event)
May 27 23:12:35.912889 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:12:35.915003 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:12:35.918318 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Instance spawned successfully.
May 27 23:12:35.919800 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:12:36.415015 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:36.418690 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:12:36.424812 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:36.425001 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:36.425309 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:36.425937 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:36.425937 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:36.426238 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:12:36.920781 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:12:36.921259 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923556.9208686, a3323d78-9845-4972-821e-daefe2bf4d67 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:36.921259 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] VM Paused (Lifecycle Event)
May 27 23:12:36.933950 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Took 6.81 seconds to spawn the instance on the hypervisor.
May 27 23:12:36.934638 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:37.406663 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec230056-133e-4f2e-8df3-0100afb43b3b req-117b26da-d664-4071-8a86-79057696efd8 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received event network-vif-plugged-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:37.408394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec230056-133e-4f2e-8df3-0100afb43b3b req-117b26da-d664-4071-8a86-79057696efd8 service nova] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:37.409174 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec230056-133e-4f2e-8df3-0100afb43b3b req-117b26da-d664-4071-8a86-79057696efd8 service nova] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:37.409378 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ec230056-133e-4f2e-8df3-0100afb43b3b req-117b26da-d664-4071-8a86-79057696efd8 service nova] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:37.409739 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ec230056-133e-4f2e-8df3-0100afb43b3b req-117b26da-d664-4071-8a86-79057696efd8 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] No waiting events found dispatching network-vif-plugged-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:12:37.409739 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-ec230056-133e-4f2e-8df3-0100afb43b3b req-117b26da-d664-4071-8a86-79057696efd8 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received unexpected event network-vif-plugged-2c18db18-9f6f-499b-9f78-0471883b7390 for instance with vm_state active and task_state None.
May 27 23:12:37.426403 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:37.431355 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923557.4278543, a3323d78-9845-4972-821e-daefe2bf4d67 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:37.431355 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] VM Resumed (Lifecycle Event)
May 27 23:12:37.448630 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Took 12.22 seconds to build instance.
May 27 23:12:37.530965 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:37.931572 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:37.936198 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:12:37.950812 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.724s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:37.980946 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:37.981143 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:38.485913 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Detaching volume e0c5cffc-a4ea-4a95-a506-11df236c2958
May 27 23:12:38.555257 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attempting to driver detach volume e0c5cffc-a4ea-4a95-a506-11df236c2958 from mountpoint /dev/vdb
May 27 23:12:38.562782 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found disk vdb by alias ua-e0c5cffc-a4ea-4a95-a506-11df236c2958 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:12:38.565967 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found disk vdb by alias ua-e0c5cffc-a4ea-4a95-a506-11df236c2958 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:12:38.566099 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Attempting to detach device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:12:38.566370 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:12:38.566370 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:38.566370 np0000001565 nova-compute[98289]:   <alias name="ua-e0c5cffc-a4ea-4a95-a506-11df236c2958"/>
May 27 23:12:38.566370 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:12:38.566370 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:12:38.566370 np0000001565 nova-compute[98289]:   <serial>e0c5cffc-a4ea-4a95-a506-11df236c2958</serial>
May 27 23:12:38.566370 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:12:38.566370 np0000001565 nova-compute[98289]: </disk>
May 27 23:12:38.566370 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:12:38.575396 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Successfully detached device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the persistent domain config.
May 27 23:12:38.575396 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] (1/8): Attempting to detach device vdb with device alias ua-e0c5cffc-a4ea-4a95-a506-11df236c2958 from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:12:38.576367 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:12:38.576367 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:38.576367 np0000001565 nova-compute[98289]:   <alias name="ua-e0c5cffc-a4ea-4a95-a506-11df236c2958"/>
May 27 23:12:38.576367 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:12:38.576367 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:12:38.576367 np0000001565 nova-compute[98289]:   <serial>e0c5cffc-a4ea-4a95-a506-11df236c2958</serial>
May 27 23:12:38.576367 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:12:38.576367 np0000001565 nova-compute[98289]: </disk>
May 27 23:12:38.576367 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:12:38.721875 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7ef21e1f-487d-4f43-a4e2-d7fe3c1d7b77 req-1691881f-4683-4e71-9685-40f1cd1c1c69 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received event network-changed-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:12:38.724906 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7ef21e1f-487d-4f43-a4e2-d7fe3c1d7b77 req-1691881f-4683-4e71-9685-40f1cd1c1c69 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Refreshing instance network info cache due to event network-changed-2c18db18-9f6f-499b-9f78-0471883b7390. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:12:38.725118 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7ef21e1f-487d-4f43-a4e2-d7fe3c1d7b77 req-1691881f-4683-4e71-9685-40f1cd1c1c69 service nova] Acquiring lock "refresh_cache-a3323d78-9845-4972-821e-daefe2bf4d67" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:12:38.725210 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7ef21e1f-487d-4f43-a4e2-d7fe3c1d7b77 req-1691881f-4683-4e71-9685-40f1cd1c1c69 service nova] Acquired lock "refresh_cache-a3323d78-9845-4972-821e-daefe2bf4d67" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:12:38.725389 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7ef21e1f-487d-4f43-a4e2-d7fe3c1d7b77 req-1691881f-4683-4e71-9685-40f1cd1c1c69 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Refreshing network info cache for port 2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:12:39.022024 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:39.107147 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923559.106195, 8eb7e5db-7164-4713-86c9-13ed200502f6 => ua-e0c5cffc-a4ea-4a95-a506-11df236c2958> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:12:39.111584 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e0c5cffc-a4ea-4a95-a506-11df236c2958 for instance 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:12:39.116527 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Successfully detached device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the live domain config.
May 27 23:12:39.117757 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:12:39.118201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0c5cffc-a4ea-4a95-a506-11df236c2958', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:39.118773 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:39.118870 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:39.119302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0c5cffc-a4ea-4a95-a506-11df236c2958', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:12:39.119770 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:12:39.146501 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:39.146501 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:39.146501 np0000001565 nova-compute[98289]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:39.146501 np0000001565 nova-compute[98289]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:39.146501 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:39.146501 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:39.146501 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:39.147381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:39.147381 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:39.147381 np0000001565 nova-compute[98289]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:39.147381 np0000001565 nova-compute[98289]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958 (non-flash)
May 27 23:12:39.147381 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:39.147381 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:39.147381 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:39.147381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', '119'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2', '122')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:12:39.147381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', '119')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:12:39.148231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958', '120')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:12:39.148569 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e387ec680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:12:39.148773 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Removing multipathed devices sdd, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:12:39.149374 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Flush multipath device 3300000007c0048e2 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:12:39.184604 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:12:39.228521 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7ef21e1f-487d-4f43-a4e2-d7fe3c1d7b77 req-1691881f-4683-4e71-9685-40f1cd1c1c69 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:39.238851 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:12:39.285410 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:12:39.285833 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:12:39.286653 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:12:39.298102 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:12:39.299357 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:12:39.308095 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:39.339743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958, portal: 192.168.40.100,3260]
May 27 23:12:39.339743 np0000001565 nova-compute[98289]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958, portal: 192.168.40.100,3260] successful.
May 27 23:12:39.339743 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:39.361058 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:39.375986 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:39.411470 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958, portal: 192.168.50.100,3260]
May 27 23:12:39.411470 np0000001565 nova-compute[98289]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-e0c5cffc-a4ea-4a95-a506-11df236c2958, portal: 192.168.50.100,3260] successful.
May 27 23:12:39.411470 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:39.426293 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:39.426488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:39.426917 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== disconnect_volume: return (307ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:39.426917 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:12:39.565580 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7ef21e1f-487d-4f43-a4e2-d7fe3c1d7b77 req-1691881f-4683-4e71-9685-40f1cd1c1c69 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:12:39.694433 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7ef21e1f-487d-4f43-a4e2-d7fe3c1d7b77 req-1691881f-4683-4e71-9685-40f1cd1c1c69 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Updated VIF entry in instance network info cache for port 2c18db18-9f6f-499b-9f78-0471883b7390. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:12:39.694874 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7ef21e1f-487d-4f43-a4e2-d7fe3c1d7b77 req-1691881f-4683-4e71-9685-40f1cd1c1c69 service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Updating instance_info_cache with network_info: [{"id": "2c18db18-9f6f-499b-9f78-0471883b7390", "address": "fa:16:3e:c7:18:a2", "network": {"id": "1dd38190-e852-4640-b9c6-4821c4b409a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1658639789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "712851e990684e0eabb135f1e10663d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c18db18-9f", "ovs_interfaceid": "2c18db18-9f6f-499b-9f78-0471883b7390", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:12:39.992643 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:40.196576 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7ef21e1f-487d-4f43-a4e2-d7fe3c1d7b77 req-1691881f-4683-4e71-9685-40f1cd1c1c69 service nova] Releasing lock "refresh_cache-a3323d78-9845-4972-821e-daefe2bf4d67" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:12:40.488275 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00044273200001043733 future=<Future at 0x726e386a5880 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:40.488275 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:12:40.488789 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] Emitting event <LifecycleEvent: 1779923545.4876316, bebf4b9c-132d-4bc4-aeed-d47f935bc548 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:12:40.489006 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] VM Stopped (Lifecycle Event)
May 27 23:12:40.993401 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce539265-2047-4b84-83a0-9548c975a328 tempest-VolumesActionsTest-366756017 tempest-VolumesActionsTest-366756017-project-member] [instance: bebf4b9c-132d-4bc4-aeed-d47f935bc548] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:12:41.000772 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac46a3c1-0f49-44a3-bbeb-76e9d9baa189 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.020s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:41.654542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:41.654848 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:42.158101 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lazy-loading 'flavor' on Instance uuid 589f570f-00bc-4fd6-8002-7d583f2d3949 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:42.534626 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:42.630177 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:42.630548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:43.054136 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:43.054386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:43.134459 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:43.164294 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:43.560382 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lazy-loading 'flavor' on Instance uuid eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:44.034745 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:44.063221 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Ignoring supplied device name: /dev/vdb
May 27 23:12:44.139065 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:44.296309 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:44.296309 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:44.296309 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Attaching volume a71d3800-26ac-4ce3-9faa-2d7d90ed062d to /dev/vdb
May 27 23:12:44.354289 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:44.372743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:12:44.400463 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:44.447877 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:12:44.448246 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:12:44.458580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:12:44.459906 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe7b:2415', 'fe80::ceb:9eff:fef9:ea15', 'fe80::fc16:3eff:fe03:7c08', 'fe80::e899:e2ff:fe2c:df98', 'fe80::fc16:3eff:feb8:178d', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fec7:18a2', 'fe80::492:26ff:fe55:37de'] 
May 27 23:12:44.460052 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:12:44.460190 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:12:44.460473 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:44.460760 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updating existing volume attachment record: 4eb38ac2-afd1-4131-a96d-0c578aaa89e1 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:12:44.566750 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:45.032164 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:12:45.032550 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:45.032739 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:45.033368 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:45.033685 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:12:45.047865 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:45.048487 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:45.048889 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:45.049116 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:45.051582 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:45.052648 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:45.065430 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:45.065430 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:45.073458 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:45.073458 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:45.082144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d] added
May 27 23:12:45.082144 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:45.082144 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:45.082144 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:45.082144 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:45.082144 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:45.082144 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:45.082324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:45.082646 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:45.082881 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:45.086809 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d] added
May 27 23:12:45.086809 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:45.086809 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:45.086809 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:45.086809 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:45.086809 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:45.086809 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:45.086976 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:45.087846 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:45.088646 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:45.241773 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:45.241929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:45.242108 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attaching volume ebe31f0d-e276-4338-b379-fb7cda14f8bc to /dev/vdb
May 27 23:12:45.289854 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:45.305853 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:12:45.331462 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:45.379998 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:12:45.380239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:12:45.394751 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:12:45.397125 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe7b:2415', 'fe80::ceb:9eff:fef9:ea15', 'fe80::fc16:3eff:fe03:7c08', 'fe80::e899:e2ff:fe2c:df98', 'fe80::fc16:3eff:feb8:178d', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fec7:18a2', 'fe80::492:26ff:fe55:37de'] 
May 27 23:12:45.397305 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:12:45.397447 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:12:45.397710 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:45.397968 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Updating existing volume attachment record: b37338fb-3ae9-436b-9373-4dee0210c361 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:12:45.679716 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:45.679923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:45.680109 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Attaching volume e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 to /dev/vdb
May 27 23:12:45.776448 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:45.791360 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:12:45.815067 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:45.883237 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:12:45.883686 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:12:45.895833 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:12:45.897801 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe7b:2415', 'fe80::ceb:9eff:fef9:ea15', 'fe80::fc16:3eff:fe03:7c08', 'fe80::e899:e2ff:fe2c:df98', 'fe80::fc16:3eff:feb8:178d', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fec7:18a2', 'fe80::492:26ff:fe55:37de'] 
May 27 23:12:45.898243 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:12:45.898243 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:12:45.898625 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:45.899019 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Updating existing volume attachment record: 00a0f924-13a0-49b1-8223-c95c008c68b2 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:12:45.961099 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:12:45.961462 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:45.961835 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:46.083592 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:46.089131 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:46.097782 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:46.097782 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:46.101966 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:46.101966 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:46.113176 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:46.119601 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:46.127598 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.127598 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.127598 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.127598 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.127598 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:46.127800 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.127800 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.127800 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.127800 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.127800 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:46.133563 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.133563 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.133563 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.133563 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.133563 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:46.133757 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.133757 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.133757 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.133757 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.133757 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:46.168188 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d, portal: 192.168.40.100,3260]
May 27 23:12:46.168188 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d, portal: 192.168.40.100,3260] successful.
May 27 23:12:46.168188 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:46.174722 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d, portal: 192.168.50.100,3260]
May 27 23:12:46.174722 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d, portal: 192.168.50.100,3260] successful.
May 27 23:12:46.174722 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:46.182350 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:46.187561 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:46.199014 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.199014 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.199014 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.199014 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.199014 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:46.199014 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:46.199014 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:46.199205 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.199205 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.199205 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.199205 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.199205 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:46.199205 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:46.199205 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:46.200794 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:46.200794 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:46.200794 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] HCTL ('9', '-', '-', 0) found on session 123 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:46.200794 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:46.206368 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.206368 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.206368 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.206368 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.206368 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:46.206368 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:46.206368 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:46.206611 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.206611 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:46.206611 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.206611 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:46.206611 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:46.206611 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:46.206611 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:46.206823 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:46.206947 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:46.207615 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] HCTL ('10', '-', '-', 0) found on session 124 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:46.207761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:46.213746 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Searching for a device in session 123 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:46.213910 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:46.222226 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Searching for a device in session 124 and hctl ['10', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:46.446089 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:12:46.446492 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:46.446648 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:47.124614 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:47.223128 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Searching for a device in session 124 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:47.224551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:47.536017 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:47.629309 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:47.629508 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:47.629636 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:47.629765 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:12:48.064109 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Found WWN 330000000c294e89f for multipath device dm-3 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:12:48.064537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:48.064784 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000c294e89f', 'path': '/dev/dm-3', 'multipath_id': '330000000c294e89f'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:48.064962 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c294e89f', 'path': '/dev/dm-3', 'multipath_id': '330000000c294e89f'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:12:48.065634 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.104s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:48.065870 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:12:48.067775 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lazy-loading 'flavor' on Instance uuid 589f570f-00bc-4fd6-8002-7d583f2d3949 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:48.076941 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:48.077464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:48.077983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:48.078177 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:48.080517 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:48.080517 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:48.088476 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:48.088476 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:48.095342 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:48.095342 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:48.103687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc] added
May 27 23:12:48.103687 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:48.103687 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:48.103687 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:48.103687 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:48.103687 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:48.103687 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:48.103936 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:48.103990 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:48.104109 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:48.105025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc] added
May 27 23:12:48.105025 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:48.105025 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:48.105025 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:48.105025 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:48.105025 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:48.105025 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:48.105185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:48.105294 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:48.105457 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:48.570214 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Attempting to attach volume a71d3800-26ac-4ce3-9faa-2d7d90ed062d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:12:48.571350 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:12:48.571350 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:48.571350 np0000001565 nova-compute[98289]:   <alias name="ua-a71d3800-26ac-4ce3-9faa-2d7d90ed062d"/>
May 27 23:12:48.571350 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:12:48.571350 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:12:48.571350 np0000001565 nova-compute[98289]:   <serial>a71d3800-26ac-4ce3-9faa-2d7d90ed062d</serial>
May 27 23:12:48.571350 np0000001565 nova-compute[98289]: </disk>
May 27 23:12:48.571350 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:12:48.673850 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:12:48.676206 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:48.760599 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:48.761032 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:48.844774 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:48.848493 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:48.931293 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:48.931764 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:49.024146 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:49.028112 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:49.044046 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:49.104893 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:49.106180 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:49.110671 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:49.111133 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:49.123919 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:49.123919 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:49.128022 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:49.128022 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:49.139764 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:49.144057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:49.157263 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.157263 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.157263 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.157263 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.157263 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.157263 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.157263 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:49.157746 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.157746 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.157746 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.157746 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.157746 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.157746 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.157746 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:49.162615 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.162615 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.162615 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.162615 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.162615 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.162615 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.162615 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:49.162930 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.162930 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.162930 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.162930 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.162930 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.162930 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.162930 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:49.200897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc, portal: 192.168.40.100,3260]
May 27 23:12:49.200897 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc, portal: 192.168.40.100,3260] successful.
May 27 23:12:49.200897 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:49.201449 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc, portal: 192.168.50.100,3260]
May 27 23:12:49.201449 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc, portal: 192.168.50.100,3260] successful.
May 27 23:12:49.201449 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:49.214275 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:49.219698 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:49.220208 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:49.224622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:49.237897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.237897 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.237897 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.237897 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.237897 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.237897 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.237897 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:49.237897 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:49.237897 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:49.239255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.239255 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.239255 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.239255 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.239255 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.239255 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.239255 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:49.239255 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:49.239255 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:49.240018 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:49.240185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:49.240823 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.240823 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.240823 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.240823 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.240823 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.240823 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.240823 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:49.240823 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:49.240823 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:49.241006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.241006 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:49.241006 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.241006 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:49.241006 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.241006 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:49.241006 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:49.241006 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:49.241006 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:49.241366 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:49.241621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:49.244453 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] HCTL ('14', '-', '-', 0) found on session 126 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:49.244668 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:49.245102 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] HCTL ('13', '-', '-', 0) found on session 125 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:49.245198 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:49.259815 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Searching for a device in session 126 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:49.259815 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:49.264789 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Searching for a device in session 125 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:49.264789 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:49.311516 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:49.312019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:49.411864 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:49.415897 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:12:49.417004 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:49.460643 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:12:49.461061 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=12160MB free_disk=72.79470443725586GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:12:49.461230 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:49.461467 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:50.078859 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:12:50.215621 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:50.215768 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:50.215847 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:50.215916 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No VIF found with MAC fa:16:3e:03:7c:08, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:12:50.521640 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 8eb7e5db-7164-4713-86c9-13ed200502f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:12:50.521640 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:12:50.521640 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 589f570f-00bc-4fd6-8002-7d583f2d3949 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:12:50.521640 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 10612118-f248-450c-89e3-663051a76135 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:12:50.521930 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance a3323d78-9845-4972-821e-daefe2bf4d67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:12:50.522182 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:12:50.522404 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:12:49 up 41 min,  2 users,  load average: 5.11, 6.02, 4.46\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_eaec81e9dd2444e1a6d54f579a902212': '1', 'io_workload': '0', 'num_proj_eceb76118ffc41a281af4ce737b19b88': '1', 'num_proj_face22aba3d94486baaef109923294a3': '1', 'num_proj_47cb500558784c258720ab29bf2d40fe': '1', 'num_proj_712851e990684e0eabb135f1e10663d4': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:12:50.753973 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:12:50.753973 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:12:51.093644 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found WWN 33000000030a6d121 for multipath device dm-5 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:12:51.094113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:51.094357 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== connect_volume: return (5132ms) {'type': 'block', 'scsi_wwn': '33000000030a6d121', 'path': '/dev/dm-5', 'multipath_id': '33000000030a6d121'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:51.094545 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000030a6d121', 'path': '/dev/dm-5', 'multipath_id': '33000000030a6d121'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:12:51.095295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.648s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:51.095666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:12:51.100759 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:51.107792 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:51.108258 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:51.108869 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:51.108869 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:51.109145 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:51.109299 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:51.120345 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:51.120345 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:51.124863 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:51.124863 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:51.134352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6] added
May 27 23:12:51.134352 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:51.134352 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:51.134352 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:51.134352 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:51.134352 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:51.134352 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:51.134352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:51.134352 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0233(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:51.134352 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:51.136604 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6] added
May 27 23:12:51.136604 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:51.136604 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:51.136604 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:51.136604 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:51.136604 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:51.136604 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:51.136747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:51.136821 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:51.136928 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:51.257782 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:12:51.603627 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attempting to attach volume ebe31f0d-e276-4338-b379-fb7cda14f8bc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:12:51.606193 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:12:51.606193 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:51.606193 np0000001565 nova-compute[98289]:   <alias name="ua-ebe31f0d-e276-4338-b379-fb7cda14f8bc"/>
May 27 23:12:51.606193 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-5"/>
May 27 23:12:51.606193 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:12:51.606193 np0000001565 nova-compute[98289]:   <serial>ebe31f0d-e276-4338-b379-fb7cda14f8bc</serial>
May 27 23:12:51.606193 np0000001565 nova-compute[98289]: </disk>
May 27 23:12:51.606193 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:12:51.754988 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d17eb788-2535-48cb-9fdc-e3bf4d63b330 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.459s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:51.761558 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:12:51.761558 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.300s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:51.762151 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.36 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:12:52.132762 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:52.137310 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:52.143848 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:52.143848 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:52.149248 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:52.149248 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:52.154530 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:52.159481 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.170760 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:52.174564 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.174564 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.174564 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.174564 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.174564 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.174564 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.174564 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.174564 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.174564 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:52.174761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.174761 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.174761 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.174761 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.174761 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.174761 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.174761 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.174761 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.174761 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:52.214618 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, portal: 192.168.40.100,3260]
May 27 23:12:52.214618 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, portal: 192.168.40.100,3260] successful.
May 27 23:12:52.214618 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:52.221878 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, portal: 192.168.50.100,3260]
May 27 23:12:52.221878 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, portal: 192.168.50.100,3260] successful.
May 27 23:12:52.221878 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:52.228786 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:52.235304 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:52.245955 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:52.246582 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:52.246582 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:52.247073 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] HCTL ('15', '-', '-', 0) found on session 127 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:52.247183 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:52.251613 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.251613 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.251613 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.251613 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.251613 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.251613 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.251613 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.251613 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.251613 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:52.251613 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:52.251613 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:52.251933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.251933 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:52.251933 np0000001565 nova-compute[98289]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.251933 np0000001565 nova-compute[98289]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:52.251933 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.251933 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:52.251933 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.251933 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:52.251933 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:52.251933 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:52.251933 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:52.251933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:52.252166 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:52.252848 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] HCTL ('16', '-', '-', 0) found on session 128 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:52.252945 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:52.262796 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Searching for a device in session 127 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:52.262796 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:52.269266 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Searching for a device in session 128 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:52.269500 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:12:52.373492 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:52.373986 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:52.539532 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:52.734648 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "10612118-f248-450c-89e3-663051a76135" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:52.735413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:52.878701 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lazy-loading 'flavor' on Instance uuid 589f570f-00bc-4fd6-8002-7d583f2d3949 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:53.109173 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:12:53.237682 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'flavor' on Instance uuid 10612118-f248-450c-89e3-663051a76135 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:53.244485 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:53.244612 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:53.244704 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:53.244791 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] No VIF found with MAC fa:16:3e:93:34:97, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:12:53.882903 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:54.057389 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:54.123216 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Found WWN 33000000028a8e7e7 for multipath device dm-6 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:12:54.123483 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:54.123649 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] <== connect_volume: return (7676ms) {'type': 'block', 'scsi_wwn': '33000000028a8e7e7', 'path': '/dev/dm-6', 'multipath_id': '33000000028a8e7e7'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:54.123835 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000028a8e7e7', 'path': '/dev/dm-6', 'multipath_id': '33000000028a8e7e7'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:12:54.125964 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lazy-loading 'flavor' on Instance uuid eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:12:54.241982 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:54.628494 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Attempting to attach volume e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:12:54.629784 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:12:54.629784 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:54.629784 np0000001565 nova-compute[98289]:   <alias name="ua-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6"/>
May 27 23:12:54.629784 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-6"/>
May 27 23:12:54.629784 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:12:54.629784 np0000001565 nova-compute[98289]:   <serial>e596fbad-d4a1-48b6-88cf-09fd9c3efdc6</serial>
May 27 23:12:54.629784 np0000001565 nova-compute[98289]: </disk>
May 27 23:12:54.629784 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:12:54.786952 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-48a6d920-4d9e-4872-a1e8-1af41fb259a8 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.545s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:54.933198 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:54.933757 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:54.933919 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Attaching volume 2dec416a-61c3-4700-b18c-320e0c1728f9 to /dev/vdc
May 27 23:12:54.968704 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:54.978590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:12:54.996581 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:55.040544 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:12:55.040999 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:12:55.051673 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:12:55.052979 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe7b:2415', 'fe80::ceb:9eff:fef9:ea15', 'fe80::fc16:3eff:fe03:7c08', 'fe80::e899:e2ff:fe2c:df98', 'fe80::fc16:3eff:feb8:178d', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fec7:18a2', 'fe80::492:26ff:fe55:37de'] 
May 27 23:12:55.053108 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:12:55.053229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:12:55.053505 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:55.053764 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updating existing volume attachment record: edbdbc9b-9a4d-4bde-955b-a474497ed0cf {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:12:55.311558 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "10612118-f248-450c-89e3-663051a76135" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:55.312053 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:55.312053 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Attaching volume 2d87ace9-074c-44b8-8461-e4d35c1e27db to /dev/vdb
May 27 23:12:55.345425 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:55.355931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:12:55.374122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:12:55.414218 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:12:55.414460 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:12:55.422745 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:12:55.423964 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe7b:2415', 'fe80::ceb:9eff:fef9:ea15', 'fe80::fc16:3eff:fe03:7c08', 'fe80::e899:e2ff:fe2c:df98', 'fe80::fc16:3eff:feb8:178d', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fec7:18a2', 'fe80::492:26ff:fe55:37de'] 
May 27 23:12:55.424078 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:12:55.424169 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:12:55.424419 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:12:55.425676 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Updating existing volume attachment record: cd31e0e1-dbdd-44df-8ee7-936254cddc00 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:12:55.601438 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:12:55.601789 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dec416a-61c3-4700-b18c-320e0c1728f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:55.601915 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:55.974704 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:12:55.974934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d87ace9-074c-44b8-8461-e4d35c1e27db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:55.975055 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:56.271275 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:56.271781 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:56.271781 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:12:56.271781 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No VIF found with MAC fa:16:3e:7b:24:15, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:12:57.543950 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:57.821411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8fc6e675-65c3-402a-a66c-0b5e9f07139a tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.141s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:12:58.124273 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:58.124541 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:58.124773 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:58.171504 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:12:58.171684 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:12:58.257411 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.655s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:58.257411 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dec416a-61c3-4700-b18c-320e0c1728f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:12:58.269601 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:58.270030 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:58.270487 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:58.270747 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:58.271040 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:12:58.271201 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:58.281764 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:58.281764 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:58.288786 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:12:58.288786 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:58.295739 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9] added
May 27 23:12:58.295739 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:58.295739 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:58.295739 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:58.295739 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:58.295739 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:58.295739 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:58.295977 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:58.296008 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:58.296146 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:58.299977 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9] added
May 27 23:12:58.299977 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:12:58.299977 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:58.299977 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:58.299977 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:12:58.299977 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:12:58.299977 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:58.300129 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:12:58.300233 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:12:58.300370 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:12:58.627040 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:12:58.674456 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Detaching volume ebe31f0d-e276-4338-b379-fb7cda14f8bc
May 27 23:12:58.712046 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Attempting to driver detach volume ebe31f0d-e276-4338-b379-fb7cda14f8bc from mountpoint /dev/vdb
May 27 23:12:58.716837 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found disk vdb by alias ua-ebe31f0d-e276-4338-b379-fb7cda14f8bc {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:12:58.717974 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Found disk vdb by alias ua-ebe31f0d-e276-4338-b379-fb7cda14f8bc {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:12:58.718144 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Attempting to detach device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:12:58.718529 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:12:58.718529 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:58.718529 np0000001565 nova-compute[98289]:   <alias name="ua-ebe31f0d-e276-4338-b379-fb7cda14f8bc"/>
May 27 23:12:58.718529 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-5"/>
May 27 23:12:58.718529 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:12:58.718529 np0000001565 nova-compute[98289]:   <serial>ebe31f0d-e276-4338-b379-fb7cda14f8bc</serial>
May 27 23:12:58.718529 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:12:58.718529 np0000001565 nova-compute[98289]: </disk>
May 27 23:12:58.718529 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:12:58.726212 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Successfully detached device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the persistent domain config.
May 27 23:12:58.726344 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] (1/8): Attempting to detach device vdb with device alias ua-ebe31f0d-e276-4338-b379-fb7cda14f8bc from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:12:58.726580 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:12:58.726580 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:12:58.726580 np0000001565 nova-compute[98289]:   <alias name="ua-ebe31f0d-e276-4338-b379-fb7cda14f8bc"/>
May 27 23:12:58.726580 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-5"/>
May 27 23:12:58.726580 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:12:58.726580 np0000001565 nova-compute[98289]:   <serial>ebe31f0d-e276-4338-b379-fb7cda14f8bc</serial>
May 27 23:12:58.726580 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:12:58.726580 np0000001565 nova-compute[98289]: </disk>
May 27 23:12:58.726580 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:12:59.073581 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:12:59.213892 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923579.213494, 8eb7e5db-7164-4713-86c9-13ed200502f6 => ua-ebe31f0d-e276-4338-b379-fb7cda14f8bc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:12:59.214929 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ebe31f0d-e276-4338-b379-fb7cda14f8bc for instance 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:12:59.217200 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Successfully detached device vdb from instance 8eb7e5db-7164-4713-86c9-13ed200502f6 from the live domain config.
May 27 23:12:59.218475 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:12:59.218769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:12:59.218905 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:12:59.296623 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:12:59.301754 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:59.310314 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:59.310314 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:12:59.317165 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:12:59.317165 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:59.328234 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:59.344500 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.344500 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.344500 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.344500 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.344500 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.344500 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.344500 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.344500 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.344500 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.344500 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.344500 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:59.344749 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.344749 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.344749 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.344749 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.344749 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.344749 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.344749 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.344749 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.344749 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.344749 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.344749 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:59.345248 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:59.361801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.361801 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.361801 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.361801 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.361801 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.361801 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.361801 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.361801 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.361801 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.361801 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.361801 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:59.362107 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.362107 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.362107 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.362107 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.362107 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.362107 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.362107 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.362107 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.362107 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.362107 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.362107 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:59.405830 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9, portal: 192.168.50.100,3260]
May 27 23:12:59.405830 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9, portal: 192.168.50.100,3260] successful.
May 27 23:12:59.405830 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:59.420066 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:59.439997 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9, portal: 192.168.40.100,3260]
May 27 23:12:59.439997 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9, portal: 192.168.40.100,3260] successful.
May 27 23:12:59.439997 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:12:59.444343 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:12:59.444780 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:59.445198 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:59.445343 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:59.446551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] HCTL ('17', '-', '-', 0) found on session 131 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:59.446668 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:59.452927 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:12:59.470485 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:12:59.470793 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:12:59.471076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:12:59.471076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:12:59.471876 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] HCTL ('18', '-', '-', 0) found on session 132 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:12:59.471975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:12:59.496519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Searching for a device in session 132 and hctl ['18', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:59.496519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Searching for a device in session 131 and hctl ['17', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:12:59.626154 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:12:59.626457 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:13:00.123903 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:13:00.124686 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:13:00.125120 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:13:00.125120 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:13:00.125657 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:13:00.492711 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Searching for a device in session 132 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:13:00.492915 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dec416a-61c3-4700-b18c-320e0c1728f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:13:00.495562 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Searching for a device in session 131 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:13:00.495755 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2dec416a-61c3-4700-b18c-320e0c1728f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:13:01.125169 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:13:01.125720 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:13:01.125720 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 27 23:13:01.271501 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:13:01.629976 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] There are 0 instances to clean {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 27 23:13:01.630211 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.49 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:13:02.286008 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Found WWN 330000000d0512571 for multipath device dm-7 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:13:02.286443 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.030s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:02.286443 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] <== connect_volume: return (6684ms) {'type': 'block', 'scsi_wwn': '330000000d0512571', 'path': '/dev/dm-7', 'multipath_id': '330000000d0512571'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:02.286576 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d0512571', 'path': '/dev/dm-7', 'multipath_id': '330000000d0512571'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:13:02.287017 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 6.312s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:02.287276 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d87ace9-074c-44b8-8461-e4d35c1e27db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:13:02.291263 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lazy-loading 'flavor' on Instance uuid 589f570f-00bc-4fd6-8002-7d583f2d3949 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:02.298853 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:02.300206 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:02.300599 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:02.300781 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:13:02.304351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:02.304351 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:13:02.312190 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:13:02.312190 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:02.317233 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:13:02.317233 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:02.323483 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db] added
May 27 23:13:02.323483 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:13:02.323483 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:02.323483 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:02.323483 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:02.323483 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:02.323483 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:02.323709 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:13:02.323766 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0222(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:13:02.323933 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:13:02.327348 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db] added
May 27 23:13:02.327348 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:13:02.327348 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:02.327348 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:02.327348 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:02.327348 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:02.327348 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:02.327522 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:13:02.327673 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:13:02.327797 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:13:02.547731 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:02.593757 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:02.594182 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:02.794207 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Attempting to attach volume 2dec416a-61c3-4700-b18c-320e0c1728f9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:13:02.796462 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:13:02.796462 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:02.796462 np0000001565 nova-compute[98289]:   <alias name="ua-2dec416a-61c3-4700-b18c-320e0c1728f9"/>
May 27 23:13:02.796462 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-7"/>
May 27 23:13:02.796462 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:13:02.796462 np0000001565 nova-compute[98289]:   <serial>2dec416a-61c3-4700-b18c-320e0c1728f9</serial>
May 27 23:13:02.796462 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:02.796462 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:13:03.099020 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lazy-loading 'flavor' on Instance uuid a3323d78-9845-4972-821e-daefe2bf4d67 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:03.324343 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:13:03.328197 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:13:03.334997 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:13:03.334997 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:13:03.342046 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:13:03.342046 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:03.348613 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:03.353953 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.365153 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.365479 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.375655 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.375983 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:03.412650 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db, portal: 192.168.50.100,3260]
May 27 23:13:03.412650 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db, portal: 192.168.50.100,3260] successful.
May 27 23:13:03.412650 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:03.425100 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:03.437494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db, portal: 192.168.40.100,3260]
May 27 23:13:03.437494 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db, portal: 192.168.40.100,3260] successful.
May 27 23:13:03.437494 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:03.445454 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:03.445735 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:03.445979 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:03.446268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:13:03.448136 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] HCTL ('19', '-', '-', 0) found on session 133 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:13:03.448281 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:13:03.454495 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:03.463537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching for a device in session 133 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:13:03.463537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2d87ace9-074c-44b8-8461-e4d35c1e27db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:03.480820 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:03.481152 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:03.481688 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:03.483162 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:13:03.484846 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] HCTL ('20', '-', '-', 0) found on session 134 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:13:03.484846 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:13:03.500924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Searching for a device in session 134 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:13:03.500924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d87ace9-074c-44b8-8461-e4d35c1e27db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:13:04.067118 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:04.067270 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:04.083734 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:04.105415 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:04.124025 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:13:04.124347 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98289) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 27 23:13:04.139394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:04.300805 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:13:04.446570 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:04.446914 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:04.446914 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:04.446914 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:04.446914 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] No VIF found with MAC fa:16:3e:03:7c:08, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:13:04.569292 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Detaching volume e596fbad-d4a1-48b6-88cf-09fd9c3efdc6
May 27 23:13:04.603713 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Attempting to driver detach volume e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 from mountpoint /dev/vdb
May 27 23:13:04.607427 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Found disk vdb by alias ua-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:13:04.608344 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Found disk vdb by alias ua-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:13:04.608470 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Attempting to detach device vdb from instance eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:13:04.608690 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:13:04.608690 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:04.608690 np0000001565 nova-compute[98289]:   <alias name="ua-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6"/>
May 27 23:13:04.608690 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-6"/>
May 27 23:13:04.608690 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:13:04.608690 np0000001565 nova-compute[98289]:   <serial>e596fbad-d4a1-48b6-88cf-09fd9c3efdc6</serial>
May 27 23:13:04.608690 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:13:04.608690 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:04.608690 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:13:04.613345 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Successfully detached device vdb from instance eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e from the persistent domain config.
May 27 23:13:04.613520 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] (1/8): Attempting to detach device vdb with device alias ua-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 from instance eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:13:04.613800 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:13:04.613800 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:04.613800 np0000001565 nova-compute[98289]:   <alias name="ua-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6"/>
May 27 23:13:04.613800 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-6"/>
May 27 23:13:04.613800 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:13:04.613800 np0000001565 nova-compute[98289]:   <serial>e596fbad-d4a1-48b6-88cf-09fd9c3efdc6</serial>
May 27 23:13:04.613800 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:13:04.613800 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:04.613800 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:13:04.626205 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:13:05.123261 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923585.1229546, eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e => ua-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:13:05.124526 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 for instance eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:13:05.126492 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Successfully detached device vdb from instance eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e from the live domain config.
May 27 23:13:05.127454 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:13:05.127692 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:13:05.127799 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:05.159389 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:05.159389 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:05.159573 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Attaching volume b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc to /dev/vdb
May 27 23:13:05.193148 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:13:05.203125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:13:05.223713 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:05.264734 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:13:05.265003 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:13:05.272985 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:13:05.275306 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe93:3497', 'fe80::4e0:45ff:feef:2a29', 'fe80::fc16:3eff:fe7b:2415', 'fe80::ceb:9eff:fef9:ea15', 'fe80::fc16:3eff:fe03:7c08', 'fe80::e899:e2ff:fe2c:df98', 'fe80::fc16:3eff:feb8:178d', 'fe80::bc78:52ff:fe4d:ba0f', 'fe80::fc16:3eff:fec7:18a2', 'fe80::492:26ff:fe55:37de'] 
May 27 23:13:05.275446 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:13:05.275542 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:13:05.275749 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:05.275964 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Updating existing volume attachment record: 214e4535-4078-4ad2-8cfa-e9aa5dde5342 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:13:05.316452 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Found WWN 33000000066770cc5 for multipath device dm-8 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:13:05.317107 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:05.317279 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] <== connect_volume: return (9342ms) {'type': 'block', 'scsi_wwn': '33000000066770cc5', 'path': '/dev/dm-8', 'multipath_id': '33000000066770cc5'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:05.317436 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000066770cc5', 'path': '/dev/dm-8', 'multipath_id': '33000000066770cc5'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:13:05.317925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 6.099s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:05.318314 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebe31f0d-e276-4338-b379-fb7cda14f8bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:13:05.318530 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:13:05.321468 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'flavor' on Instance uuid 10612118-f248-450c-89e3-663051a76135 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:05.349953 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:05.350637 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', '134')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:13:05.350637 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', '125')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:05.351836 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc', '126')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:05.352847 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e602b0e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc'): ({'sdh'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:13:05.353060 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Removing multipathed devices sdi, sdh {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:13:05.353290 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Flush multipath device 33000000030a6d121 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:13:05.387472 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:05.425718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:05.469528 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:13:05.469921 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:13:05.470950 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:13:05.480090 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:13:05.480278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:13:05.489508 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.524261 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc, portal: 192.168.40.100,3260]
May 27 23:13:05.524261 np0000001565 nova-compute[98289]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc, portal: 192.168.40.100,3260] successful.
May 27 23:13:05.524261 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.543068 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.551896 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.582963 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc, portal: 192.168.50.100,3260]
May 27 23:13:05.582963 np0000001565 nova-compute[98289]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-ebe31f0d-e276-4338-b379-fb7cda14f8bc, portal: 192.168.50.100,3260] successful.
May 27 23:13:05.582963 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.602750 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.602944 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:05.603150 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] <== disconnect_volume: return (6384ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:05.603278 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:13:05.604879 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.477s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:05.605791 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:13:05.606047 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:05.633147 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6 (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:05.633525 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:05.633525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', '134')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:13:05.633835 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', '127')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:05.634519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', '128')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:05.635326 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3879df80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6'): ({'sdk'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:13:05.635507 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Removing multipathed devices sdj, sdk {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:13:05.635705 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Flush multipath device 33000000028a8e7e7 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:13:05.669215 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:05.712598 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:05.765570 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:13:05.765710 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:13:05.766854 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:13:05.776193 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:13:05.776352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:13:05.785945 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.820124 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:13:05.820420 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:13:05.820568 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:05.825010 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Attempting to attach volume 2d87ace9-074c-44b8-8461-e4d35c1e27db with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:13:05.825410 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, portal: 192.168.40.100,3260]
May 27 23:13:05.825410 np0000001565 nova-compute[98289]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, portal: 192.168.40.100,3260] successful.
May 27 23:13:05.825410 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.826449 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:13:05.826449 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:05.826449 np0000001565 nova-compute[98289]:   <alias name="ua-2d87ace9-074c-44b8-8461-e4d35c1e27db"/>
May 27 23:13:05.826449 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-8"/>
May 27 23:13:05.826449 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:13:05.826449 np0000001565 nova-compute[98289]:   <serial>2d87ace9-074c-44b8-8461-e4d35c1e27db</serial>
May 27 23:13:05.826449 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:05.826449 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:13:05.844143 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.855617 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.890149 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, portal: 192.168.50.100,3260]
May 27 23:13:05.890149 np0000001565 nova-compute[98289]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, portal: 192.168.50.100,3260] successful.
May 27 23:13:05.890149 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.908202 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.908453 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:05.908572 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] <== disconnect_volume: return (780ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:05.908753 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:13:05.909020 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.088s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:05.909209 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:13:05.920351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:05.920876 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:05.921391 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:05.921627 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:13:05.921919 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:05.922104 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:13:05.933009 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:13:05.933009 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.938292 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:13:05.938292 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.946054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc] added
May 27 23:13:05.946054 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:13:05.946054 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:05.946054 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:05.946054 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:05.946054 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:05.946054 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.946268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:13:05.946391 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:13:05.946557 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:13:05.950738 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc] added
May 27 23:13:05.950738 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:13:05.950738 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:05.950738 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:05.950738 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:05.950738 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:05.950738 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:05.951003 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:13:05.951183 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:13:05.951308 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:13:05.988797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0eb5674d-d8a9-487f-a6d7-118f1367119e tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.055s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:06.152400 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'flavor' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:06.449349 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lazy-loading 'flavor' on Instance uuid eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:06.947015 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:13:06.954386 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:13:06.960054 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:13:06.960054 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:13:06.966308 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:13:06.966308 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:06.972599 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:06.978488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:06.990734 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:06.990734 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:06.990734 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:06.990734 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:06.990734 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:06.990734 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:06.990734 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:06.990734 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:06.990734 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:06.990734 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:06.990734 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:06.991038 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:06.991038 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:06.991038 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:06.991038 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:06.991038 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:06.991038 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:06.991038 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:06.991038 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:06.991038 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:06.991038 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:06.991038 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:06.995417 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:06.995417 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:06.995417 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:06.995417 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:06.995417 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:06.995417 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:06.995417 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:06.995417 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:06.995417 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:06.995417 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:06.995417 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:06.995627 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:06.995627 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:06.995627 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:06.995627 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:06.995627 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:06.995627 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:06.995627 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:06.995627 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:06.995627 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:06.995627 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:06.995627 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:07.039909 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc, portal: 192.168.40.100,3260]
May 27 23:13:07.039909 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc, portal: 192.168.40.100,3260] successful.
May 27 23:13:07.039909 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:07.051074 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:07.058312 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc, portal: 192.168.50.100,3260]
May 27 23:13:07.058312 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc, portal: 192.168.50.100,3260] successful.
May 27 23:13:07.058312 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:07.068950 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:07.069213 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:07.069464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:07.069530 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:13:07.069951 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:07.071018 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] HCTL ('13', '-', '-', 0) found on session 135 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:13:07.071124 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Searching for a device in session 135 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:07.091761 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:07.091761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:13:07.094120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] HCTL ('14', '-', '-', 0) found on session 136 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:13:07.094298 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:13:07.107887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Searching for a device in session 136 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:13:07.108061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:13:07.156422 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e5a3d68-7503-4731-abb7-8fcbc6479cd2 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.985s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:07.456982 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fe280255-66ce-4f53-b43c-21647156802d tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.389s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:07.458350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 3.319s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:07.458794 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:07.459042 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:07.459230 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:07.461662 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Terminating instance
May 27 23:13:07.463560 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:07.463744 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:07.463910 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:07.464095 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] No VIF found with MAC fa:16:3e:b8:17:8d, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:13:07.551563 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:07.922395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:13:07.969531 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:13:08.000023 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.002567 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.019910 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.022822 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.038720 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.045166 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.127773 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-396d00b4-fba2-4192-b497-1b39d8a4e57d req-76b193c2-bda5-49d3-afaa-dc6c81e9149a service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Received event network-vif-unplugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:08.128258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-396d00b4-fba2-4192-b497-1b39d8a4e57d req-76b193c2-bda5-49d3-afaa-dc6c81e9149a service nova] Acquiring lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:08.128433 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-396d00b4-fba2-4192-b497-1b39d8a4e57d req-76b193c2-bda5-49d3-afaa-dc6c81e9149a service nova] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:08.129131 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-396d00b4-fba2-4192-b497-1b39d8a4e57d req-76b193c2-bda5-49d3-afaa-dc6c81e9149a service nova] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:08.130084 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-396d00b4-fba2-4192-b497-1b39d8a4e57d req-76b193c2-bda5-49d3-afaa-dc6c81e9149a service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] No waiting events found dispatching network-vif-unplugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:08.130236 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-396d00b4-fba2-4192-b497-1b39d8a4e57d req-76b193c2-bda5-49d3-afaa-dc6c81e9149a service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Received event network-vif-unplugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:13:08.188700 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.290734 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999694522000027 future=<Future at 0x726e5818a060 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:08.291096 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999322069999835 future=<Future at 0x726e5818a060 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:08.291226 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999171213999944 future=<Future at 0x726e5818a060 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:08.292192 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Instance destroyed successfully.
May 27 23:13:08.292566 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lazy-loading 'resources' on Instance uuid eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:08.794772 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:11:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1405023490',display_name='tempest-VolumesSnapshotTestJSON-instance-1405023490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumessnapshottestjson-instance-1405023490',id=52,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA55DopB/bO2TfIyUX/Wj/RgYNhqi+oiy9uySDzGAI9COTo2WLTfju74pSH43WNlrdTrn0XWKCEX/h1RKcYNExgrZkcp2EIwYbHxDQE3PpAaoGuP/V/Ms+VfK5bJ1rnySw==',key_name='tempest-keypair-756094411',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:12:05Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eceb76118ffc41a281af4ce737b19b88',ramdisk_id='',reservation_id='r-2zxisbhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1830020059',owner_user_name='tempest-VolumesSnapshotTestJSON-1830020059-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12335b63d21044a6bc1d970ab66c8292',uuid=eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "address": "fa:16:3e:7b:24:15", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4632c1-81", "ovs_interfaceid": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:13:08.794966 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converting VIF {"id": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "address": "fa:16:3e:7b:24:15", "network": {"id": "46e739f4-630b-43d2-9143-443bd90b8d3a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343492747-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eceb76118ffc41a281af4ce737b19b88", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4632c1-81", "ovs_interfaceid": "dc4632c1-819f-48f6-bbca-0ffd14f60f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:13:08.795597 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:24:15,bridge_name='br-int',has_traffic_filtering=True,id=dc4632c1-819f-48f6-bbca-0ffd14f60f58,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4632c1-81') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:13:08.795827 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:24:15,bridge_name='br-int',has_traffic_filtering=True,id=dc4632c1-819f-48f6-bbca-0ffd14f60f58,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4632c1-81') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:13:08.797260 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.797597 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc4632c1-81, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:08.798838 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.799997 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:08.800509 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.800651 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db5da108-fcf8-43ce-a4c0-2cc10a2ab337) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:08.801106 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.801671 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:08.802086 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:08.803366 np0000001565 nova-compute[98289]: INFO os_vif [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:24:15,bridge_name='br-int',has_traffic_filtering=True,id=dc4632c1-819f-48f6-bbca-0ffd14f60f58,network=Network(46e739f4-630b-43d2-9143-443bd90b8d3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4632c1-81')
May 27 23:13:08.804710 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:13:08.804989 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:13:08.805109 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:08.936267 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Found WWN 330000000cbecc9c9 for multipath device dm-5 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:13:08.936515 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:08.936776 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] <== connect_volume: return (3116ms) {'type': 'block', 'scsi_wwn': '330000000cbecc9c9', 'path': '/dev/dm-5', 'multipath_id': '330000000cbecc9c9'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:08.936918 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cbecc9c9', 'path': '/dev/dm-5', 'multipath_id': '330000000cbecc9c9'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:13:08.937311 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.132s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:08.937783 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:13:08.937951 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:13:08.940112 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lazy-loading 'flavor' on Instance uuid a3323d78-9845-4972-821e-daefe2bf4d67 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:08.962962 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2 (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:08.963291 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:08.963547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8dc5e64-c688-4485-b4de-f8a2c43812d2', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', '136')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:13:08.963547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, 0): [] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:08.963664 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6') {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 23:13:08.963821 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6, 0): [] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:08.963963 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e596fbad-d4a1-48b6-88cf-09fd9c3efdc6') {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 23:13:08.964100 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3870b2e0>, {}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:13:08.964239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Disconnecting from: [] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:13:08.964449 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.027s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:08.964580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] <== disconnect_volume: return (159ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:08.964716 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:13:08.964996 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Deleting instance files /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e_del
May 27 23:13:08.965774 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Deletion of /opt/stack/data/nova/instances/eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e_del complete
May 27 23:13:09.017865 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-01521a83-89da-45f7-a629-e126287ae07c tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.706s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:09.095140 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:09.387754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "10612118-f248-450c-89e3-663051a76135" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:09.387932 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:09.442525 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Attempting to attach volume b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:13:09.444533 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:13:09.444533 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:09.444533 np0000001565 nova-compute[98289]:   <alias name="ua-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc"/>
May 27 23:13:09.444533 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-5"/>
May 27 23:13:09.444533 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:13:09.444533 np0000001565 nova-compute[98289]:   <serial>b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc</serial>
May 27 23:13:09.444533 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:09.444533 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:13:09.475719 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Took 1.50 seconds to destroy the instance on the hypervisor.
May 27 23:13:09.475870 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:13:09.476285 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:13:09.476433 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:13:09.476662 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:09.541161 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:09.890246 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Detaching volume 2d87ace9-074c-44b8-8461-e4d35c1e27db
May 27 23:13:09.950403 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Attempting to driver detach volume 2d87ace9-074c-44b8-8461-e4d35c1e27db from mountpoint /dev/vdb
May 27 23:13:09.963721 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Found disk vdb by alias ua-2d87ace9-074c-44b8-8461-e4d35c1e27db {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:13:09.965383 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Found disk vdb by alias ua-2d87ace9-074c-44b8-8461-e4d35c1e27db {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:13:09.966953 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Attempting to detach device vdb from instance 10612118-f248-450c-89e3-663051a76135 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:13:09.966953 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:13:09.966953 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:09.966953 np0000001565 nova-compute[98289]:   <alias name="ua-2d87ace9-074c-44b8-8461-e4d35c1e27db"/>
May 27 23:13:09.966953 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-8"/>
May 27 23:13:09.966953 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:13:09.966953 np0000001565 nova-compute[98289]:   <serial>2d87ace9-074c-44b8-8461-e4d35c1e27db</serial>
May 27 23:13:09.966953 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:13:09.966953 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:09.966953 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:13:09.974252 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully detached device vdb from instance 10612118-f248-450c-89e3-663051a76135 from the persistent domain config.
May 27 23:13:09.974252 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] (1/8): Attempting to detach device vdb with device alias ua-2d87ace9-074c-44b8-8461-e4d35c1e27db from instance 10612118-f248-450c-89e3-663051a76135 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:13:09.974252 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:13:09.974252 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:09.974252 np0000001565 nova-compute[98289]:   <alias name="ua-2d87ace9-074c-44b8-8461-e4d35c1e27db"/>
May 27 23:13:09.974252 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-8"/>
May 27 23:13:09.974252 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:13:09.974252 np0000001565 nova-compute[98289]:   <serial>2d87ace9-074c-44b8-8461-e4d35c1e27db</serial>
May 27 23:13:09.974252 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:13:09.974252 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:09.974252 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:13:10.032727 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b65e0cf8-d6a0-4710-b63a-410cef2b169e req-1fe23f57-55c4-4a9c-bb5d-4bef9b9aa89a service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Received event network-vif-deleted-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:10.033137 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-b65e0cf8-d6a0-4710-b63a-410cef2b169e req-1fe23f57-55c4-4a9c-bb5d-4bef9b9aa89a service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Neutron deleted interface dc4632c1-819f-48f6-bbca-0ffd14f60f58; detaching it from the instance and deleting it from the info cache
May 27 23:13:10.044985 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b65e0cf8-d6a0-4710-b63a-410cef2b169e req-1fe23f57-55c4-4a9c-bb5d-4bef9b9aa89a service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Detach interface failed, port_id=dc4632c1-819f-48f6-bbca-0ffd14f60f58, reason: Instance eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:13:10.179564 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ee9f1529-9f09-4a27-821f-2b44c04da497 req-90dc3d93-b79e-443b-b012-232149c911cd service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Received event network-vif-unplugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:10.179732 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ee9f1529-9f09-4a27-821f-2b44c04da497 req-90dc3d93-b79e-443b-b012-232149c911cd service nova] Acquiring lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:10.179937 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ee9f1529-9f09-4a27-821f-2b44c04da497 req-90dc3d93-b79e-443b-b012-232149c911cd service nova] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:10.180118 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ee9f1529-9f09-4a27-821f-2b44c04da497 req-90dc3d93-b79e-443b-b012-232149c911cd service nova] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:10.180294 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ee9f1529-9f09-4a27-821f-2b44c04da497 req-90dc3d93-b79e-443b-b012-232149c911cd service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] No waiting events found dispatching network-vif-unplugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:10.181287 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ee9f1529-9f09-4a27-821f-2b44c04da497 req-90dc3d93-b79e-443b-b012-232149c911cd service nova] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Received event network-vif-unplugged-dc4632c1-819f-48f6-bbca-0ffd14f60f58 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:13:10.431407 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923590.4310713, 10612118-f248-450c-89e3-663051a76135 => ua-2d87ace9-074c-44b8-8461-e4d35c1e27db> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:13:10.432531 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2d87ace9-074c-44b8-8461-e4d35c1e27db for instance 10612118-f248-450c-89e3-663051a76135 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:13:10.434603 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully detached device vdb from instance 10612118-f248-450c-89e3-663051a76135 from the live domain config.
May 27 23:13:10.435491 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:13:10.435766 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d87ace9-074c-44b8-8461-e4d35c1e27db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:13:10.435929 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:10.436268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:10.436575 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2d87ace9-074c-44b8-8461-e4d35c1e27db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:13:10.436768 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:13:10.466539 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:10.466539 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:10.466539 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:10.466539 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:10.466539 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:10.466539 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:10.466539 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:10.466539 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:10.466539 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:10.466539 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:10.466539 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db (non-flash)
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:10.466931 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', '136')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:13:10.466931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', '134')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:10.467820 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db', '133')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:10.468605 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e386177e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db'): ({'sdn'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:13:10.468773 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Removing multipathed devices sdo, sdn {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:13:10.468991 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Flush multipath device 33000000066770cc5 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:13:10.487726 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:10.512352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:10.557832 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:10.600720 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:13:10.600937 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:13:10.601974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:13:10.612597 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:13:10.612766 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:13:10.623714 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:10.661308 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db, portal: 192.168.40.100,3260]
May 27 23:13:10.661308 np0000001565 nova-compute[98289]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db, portal: 192.168.40.100,3260] successful.
May 27 23:13:10.661308 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:10.677995 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:10.688381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:10.718032 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db, portal: 192.168.50.100,3260]
May 27 23:13:10.718032 np0000001565 nova-compute[98289]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-2d87ace9-074c-44b8-8461-e4d35c1e27db, portal: 192.168.50.100,3260] successful.
May 27 23:13:10.718032 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:10.734754 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:10.735042 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:10.735160 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] <== disconnect_volume: return (299ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:10.735270 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:13:10.991297 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Took 1.51 seconds to deallocate network for instance.
May 27 23:13:11.004934 np0000001565 nova-compute[98289]: WARNING nova.volume.cinder [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Attachment 00a0f924-13a0-49b1-8223-c95c008c68b2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 00a0f924-13a0-49b1-8223-c95c008c68b2. (HTTP 404) (Request-ID: req-9afdd171-dec2-4eb4-b004-35f682be608b)
May 27 23:13:11.005228 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Took 0.01 seconds to detach 1 volumes for instance.
May 27 23:13:11.109915 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:11.110275 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:11.110275 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:11.110275 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] No VIF found with MAC fa:16:3e:c7:18:a2, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:13:11.132861 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:11.133037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:11.275108 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'flavor' on Instance uuid 10612118-f248-450c-89e3-663051a76135 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:11.510581 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:11.510752 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:11.635270 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Detaching volume a71d3800-26ac-4ce3-9faa-2d7d90ed062d
May 27 23:13:11.664828 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Refreshing inventories for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 27 23:13:11.679768 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Attempting to driver detach volume a71d3800-26ac-4ce3-9faa-2d7d90ed062d from mountpoint /dev/vdb
May 27 23:13:11.683557 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Found disk vdb by alias ua-a71d3800-26ac-4ce3-9faa-2d7d90ed062d {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:13:11.684501 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Found disk vdb by alias ua-a71d3800-26ac-4ce3-9faa-2d7d90ed062d {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:13:11.684628 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Attempting to detach device vdb from instance 589f570f-00bc-4fd6-8002-7d583f2d3949 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:13:11.684867 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:13:11.684867 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:11.684867 np0000001565 nova-compute[98289]:   <alias name="ua-a71d3800-26ac-4ce3-9faa-2d7d90ed062d"/>
May 27 23:13:11.684867 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:13:11.684867 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:13:11.684867 np0000001565 nova-compute[98289]:   <serial>a71d3800-26ac-4ce3-9faa-2d7d90ed062d</serial>
May 27 23:13:11.684867 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:13:11.684867 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:11.684867 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:13:11.689944 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Successfully detached device vdb from instance 589f570f-00bc-4fd6-8002-7d583f2d3949 from the persistent domain config.
May 27 23:13:11.690071 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] (1/8): Attempting to detach device vdb with device alias ua-a71d3800-26ac-4ce3-9faa-2d7d90ed062d from instance 589f570f-00bc-4fd6-8002-7d583f2d3949 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:13:11.690287 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:13:11.690287 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:11.690287 np0000001565 nova-compute[98289]:   <alias name="ua-a71d3800-26ac-4ce3-9faa-2d7d90ed062d"/>
May 27 23:13:11.690287 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-3"/>
May 27 23:13:11.690287 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:13:11.690287 np0000001565 nova-compute[98289]:   <serial>a71d3800-26ac-4ce3-9faa-2d7d90ed062d</serial>
May 27 23:13:11.690287 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:13:11.690287 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:11.690287 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:13:11.708183 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Updating ProviderTree inventory for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 27 23:13:11.708351 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Updating inventory in ProviderTree for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 23:13:11.745583 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Refreshing aggregate associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, aggregates: None {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 27 23:13:11.794237 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Refreshing trait associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_PPC64LE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_AARCH64,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_STATELESS_FIRMWARE {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 27 23:13:12.052867 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:13:12.053090 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:13:12.197003 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923592.1966848, 589f570f-00bc-4fd6-8002-7d583f2d3949 => ua-a71d3800-26ac-4ce3-9faa-2d7d90ed062d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:13:12.198265 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a71d3800-26ac-4ce3-9faa-2d7d90ed062d for instance 589f570f-00bc-4fd6-8002-7d583f2d3949 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:13:12.200106 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Successfully detached device vdb from instance 589f570f-00bc-4fd6-8002-7d583f2d3949 from the live domain config.
May 27 23:13:12.200991 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:13:12.201371 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:13:12.201526 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:12.201972 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:12.202211 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:13:12.202371 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:13:12.227284 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:12.227284 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:12.227284 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:12.227284 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:12.227284 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:12.227284 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:12.227284 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:12.227284 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:12.227284 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:12.227637 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:12.227637 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:12.227637 np0000001565 nova-compute[98289]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:12.227637 np0000001565 nova-compute[98289]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d (non-flash)
May 27 23:13:12.227637 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:12.227637 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:12.227637 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:12.227637 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:12.227637 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:12.227637 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', '136')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:13:12.227637 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '123')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:12.228415 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d', '124')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:12.229114 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e38615300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:13:12.229269 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Removing multipathed devices sdd, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:13:12.229486 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Flush multipath device 330000000c294e89f {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:13:12.263528 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:12.284761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5bd12014-9e24-45e2-94f8-1f151aa969a8 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.897s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:12.318787 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:12.366962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:13:12.367166 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:13:12.368268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:13:12.380761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:13:12.381113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:13:12.392521 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:12.465066 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 123, target: iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d, portal: 192.168.40.100,3260]
May 27 23:13:12.465066 np0000001565 nova-compute[98289]: Logout of [sid: 123, target: iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d, portal: 192.168.40.100,3260] successful.
May 27 23:13:12.465066 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:12.480141 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:12.487035 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:12.491886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:12.522155 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d, portal: 192.168.50.100,3260]
May 27 23:13:12.522155 np0000001565 nova-compute[98289]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-a71d3800-26ac-4ce3-9faa-2d7d90ed062d, portal: 192.168.50.100,3260] successful.
May 27 23:13:12.522155 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:12.536924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:12.537113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:12.537223 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] <== disconnect_volume: return (335ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:12.537348 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:13:12.555659 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:13:12.619371 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "10612118-f248-450c-89e3-663051a76135" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:12.619702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:12.620002 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "10612118-f248-450c-89e3-663051a76135-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:12.620252 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:12.620429 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:12.624214 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Terminating instance
May 27 23:13:12.661775 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-07ff746f-a7b7-45b9-aba5-a91a38d9f82f tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.502s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:13.063972 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.553s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:13.087077 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lazy-loading 'flavor' on Instance uuid 589f570f-00bc-4fd6-8002-7d583f2d3949 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:13.113458 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Deleted allocations for instance eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e
May 27 23:13:13.127306 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:13:13.140819 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.142899 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.158283 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.161972 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.178486 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.183841 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.272802 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bef89bfb-26bb-429f-8f72-cf8eed297f32 req-936a2bba-a8b5-4a4d-8c09-d8b35cd9c835 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Received event network-vif-unplugged-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:13.273303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bef89bfb-26bb-429f-8f72-cf8eed297f32 req-936a2bba-a8b5-4a4d-8c09-d8b35cd9c835 service nova] Acquiring lock "10612118-f248-450c-89e3-663051a76135-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:13.273507 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bef89bfb-26bb-429f-8f72-cf8eed297f32 req-936a2bba-a8b5-4a4d-8c09-d8b35cd9c835 service nova] Lock "10612118-f248-450c-89e3-663051a76135-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:13.273615 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-bef89bfb-26bb-429f-8f72-cf8eed297f32 req-936a2bba-a8b5-4a4d-8c09-d8b35cd9c835 service nova] Lock "10612118-f248-450c-89e3-663051a76135-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:13.273729 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bef89bfb-26bb-429f-8f72-cf8eed297f32 req-936a2bba-a8b5-4a4d-8c09-d8b35cd9c835 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] No waiting events found dispatching network-vif-unplugged-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:13.273856 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-bef89bfb-26bb-429f-8f72-cf8eed297f32 req-936a2bba-a8b5-4a4d-8c09-d8b35cd9c835 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Received event network-vif-unplugged-c5b4131d-a64d-4a3a-8a46-903138712db9 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:13:13.322054 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:13.322230 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:13.426918 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.433303 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.458514 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999747318000118 future=<Future at 0x726e3878bf50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:13.460618 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 10612118-f248-450c-89e3-663051a76135] Instance destroyed successfully.
May 27 23:13:13.461049 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lazy-loading 'resources' on Instance uuid 10612118-f248-450c-89e3-663051a76135 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:13.801774 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.824456 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Detaching volume b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc
May 27 23:13:13.870706 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Attempting to driver detach volume b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc from mountpoint /dev/vdb
May 27 23:13:13.876477 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Found disk vdb by alias ua-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:13:13.878784 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Found disk vdb by alias ua-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:13:13.878925 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Attempting to detach device vdb from instance a3323d78-9845-4972-821e-daefe2bf4d67 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:13:13.879420 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:13:13.879420 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:13.879420 np0000001565 nova-compute[98289]:   <alias name="ua-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc"/>
May 27 23:13:13.879420 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-5"/>
May 27 23:13:13.879420 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:13:13.879420 np0000001565 nova-compute[98289]:   <serial>b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc</serial>
May 27 23:13:13.879420 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:13:13.879420 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:13.879420 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:13:13.886892 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Successfully detached device vdb from instance a3323d78-9845-4972-821e-daefe2bf4d67 from the persistent domain config.
May 27 23:13:13.887263 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] (1/8): Attempting to detach device vdb with device alias ua-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc from instance a3323d78-9845-4972-821e-daefe2bf4d67 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:13:13.887379 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:13:13.887379 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:13.887379 np0000001565 nova-compute[98289]:   <alias name="ua-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc"/>
May 27 23:13:13.887379 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-5"/>
May 27 23:13:13.887379 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:13:13.887379 np0000001565 nova-compute[98289]:   <serial>b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc</serial>
May 27 23:13:13.887379 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:13:13.887379 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:13.887379 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:13:13.963378 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1743837486',display_name='tempest-AttachVolumeNegativeTest-server-1743837486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-attachvolumenegativetest-server-1743837486',id=54,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKTGV4k70529mmE5xOum4QIcyOfCBbjPWduWMUTQ+lLNvPrKq2puQoquUWv5IqchbKv4htqXWuTLfWX9VOxvVpQB71PRjNd3lCtngCXQ/oCPsfOBEnnQk+N5yuksafQUg==',key_name='tempest-keypair-1767225239',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:12:19Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47cb500558784c258720ab29bf2d40fe',ramdisk_id='',reservation_id='r-9485vzr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1834166666',owner_user_name='tempest-AttachVolumeNegativeTest-1834166666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:12:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9df5f69b62834b2caaf76302e55c9707',uuid=10612118-f248-450c-89e3-663051a76135,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:13:13.963608 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converting VIF {"id": "c5b4131d-a64d-4a3a-8a46-903138712db9", "address": "fa:16:3e:b8:17:8d", "network": {"id": "7294aa86-464e-40b8-8863-8c509f5e46d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280635702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47cb500558784c258720ab29bf2d40fe", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5b4131d-a6", "ovs_interfaceid": "c5b4131d-a64d-4a3a-8a46-903138712db9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:13:13.963985 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=c5b4131d-a64d-4a3a-8a46-903138712db9,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b4131d-a6') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:13:13.964168 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=c5b4131d-a64d-4a3a-8a46-903138712db9,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b4131d-a6') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:13:13.965546 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.965794 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5b4131d-a6, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:13.966742 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.967830 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:13.968483 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.968625 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa9fdb9d-0f53-478d-9556-f87e996cad5a) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:13.980396 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.980926 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:13.981614 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:13.983305 np0000001565 nova-compute[98289]: INFO os_vif [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=c5b4131d-a64d-4a3a-8a46-903138712db9,network=Network(7294aa86-464e-40b8-8863-8c509f5e46d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5b4131d-a6')
May 27 23:13:13.983625 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Deleting instance files /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135_del
May 27 23:13:13.984279 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Deletion of /opt/stack/data/nova/instances/10612118-f248-450c-89e3-663051a76135_del complete
May 27 23:13:14.093248 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-18d319bf-ef5a-4678-b1e8-a9b2f4498296 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.960s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:14.097430 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:14.122749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-280c88f3-03b6-4502-b4e6-028b8ddbf11b tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Lock "eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.665s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:14.388689 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923594.3883572, a3323d78-9845-4972-821e-daefe2bf4d67 => ua-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:13:14.389835 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc for instance a3323d78-9845-4972-821e-daefe2bf4d67 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:13:14.392051 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Successfully detached device vdb from instance a3323d78-9845-4972-821e-daefe2bf4d67 from the live domain config.
May 27 23:13:14.392991 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:13:14.393420 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:13:14.393545 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:14.394536 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:14.394536 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:13:14.394681 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:13:14.418449 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:14.418449 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:14.418449 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:14.418449 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:14.418449 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:14.418449 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:14.418449 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:14.418694 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:14.418694 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:14.418694 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:14.418694 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:14.418694 np0000001565 nova-compute[98289]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:14.418694 np0000001565 nova-compute[98289]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc (non-flash)
May 27 23:13:14.418694 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:14.418852 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', '136')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:13:14.418922 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', '135')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:14.420000 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc', '136')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:14.420867 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e38616700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc'): ({'sdi'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:13:14.421037 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Removing multipathed devices sdi, sdh {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:13:14.421610 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Flush multipath device 330000000cbecc9c9 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:13:14.452850 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:14.489014 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 23:13:14.490213 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:13:14.490213 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 10612118-f248-450c-89e3-663051a76135] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:13:14.490213 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 10612118-f248-450c-89e3-663051a76135] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:13:14.490460 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:14.492687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:14.547699 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:13:14.548048 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:13:14.549971 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:13:14.564914 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:13:14.565108 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:13:14.567973 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:14.576744 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:14.612118 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc, portal: 192.168.40.100,3260]
May 27 23:13:14.612118 np0000001565 nova-compute[98289]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc, portal: 192.168.40.100,3260] successful.
May 27 23:13:14.612118 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:14.628943 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:14.641814 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:14.673515 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc, portal: 192.168.50.100,3260]
May 27 23:13:14.673515 np0000001565 nova-compute[98289]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-b1e0a723-a9a2-4768-a5cb-375e2cd9a4dc, portal: 192.168.50.100,3260] successful.
May 27 23:13:14.673515 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:14.690840 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:14.691476 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:14.691661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] <== disconnect_volume: return (298ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:14.691837 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:13:15.239092 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lazy-loading 'flavor' on Instance uuid a3323d78-9845-4972-821e-daefe2bf4d67 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:15.327273 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7235398b-5dcd-4fcd-9ddc-fca9ad791f03 req-e3ddd431-77ed-4fbe-8868-d951828afdb3 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Received event network-vif-unplugged-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:15.327593 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7235398b-5dcd-4fcd-9ddc-fca9ad791f03 req-e3ddd431-77ed-4fbe-8868-d951828afdb3 service nova] Acquiring lock "10612118-f248-450c-89e3-663051a76135-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:15.327776 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7235398b-5dcd-4fcd-9ddc-fca9ad791f03 req-e3ddd431-77ed-4fbe-8868-d951828afdb3 service nova] Lock "10612118-f248-450c-89e3-663051a76135-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:15.327888 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7235398b-5dcd-4fcd-9ddc-fca9ad791f03 req-e3ddd431-77ed-4fbe-8868-d951828afdb3 service nova] Lock "10612118-f248-450c-89e3-663051a76135-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:15.328029 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7235398b-5dcd-4fcd-9ddc-fca9ad791f03 req-e3ddd431-77ed-4fbe-8868-d951828afdb3 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] No waiting events found dispatching network-vif-unplugged-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:15.328088 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7235398b-5dcd-4fcd-9ddc-fca9ad791f03 req-e3ddd431-77ed-4fbe-8868-d951828afdb3 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Received event network-vif-unplugged-c5b4131d-a64d-4a3a-8a46-903138712db9 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:13:15.328173 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7235398b-5dcd-4fcd-9ddc-fca9ad791f03 req-e3ddd431-77ed-4fbe-8868-d951828afdb3 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Received event network-vif-deleted-c5b4131d-a64d-4a3a-8a46-903138712db9 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:15.328268 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-7235398b-5dcd-4fcd-9ddc-fca9ad791f03 req-e3ddd431-77ed-4fbe-8868-d951828afdb3 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Neutron deleted interface c5b4131d-a64d-4a3a-8a46-903138712db9; detaching it from the instance and deleting it from the info cache
May 27 23:13:15.332078 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7235398b-5dcd-4fcd-9ddc-fca9ad791f03 req-e3ddd431-77ed-4fbe-8868-d951828afdb3 service nova] [instance: 10612118-f248-450c-89e3-663051a76135] Detach interface failed, port_id=c5b4131d-a64d-4a3a-8a46-903138712db9, reason: Instance 10612118-f248-450c-89e3-663051a76135 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:13:15.413094 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:15.413652 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:15.413652 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:15.413652 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:15.413652 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:15.415413 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Terminating instance
May 27 23:13:15.438648 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 10612118-f248-450c-89e3-663051a76135] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:15.830316 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:15.920627 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:13:15.938145 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:15.941022 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 10612118-f248-450c-89e3-663051a76135] Took 1.45 seconds to deallocate network for instance.
May 27 23:13:15.943162 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:15.962268 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:15.965202 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:15.995055 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:16.244635 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1202190f-5254-4fc3-98a0-a729658c7fa0 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.922s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:16.250050 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999730105999788 future=<Future at 0x726e602d2000 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:16.254839 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Instance destroyed successfully.
May 27 23:13:16.255895 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lazy-loading 'resources' on Instance uuid 8eb7e5db-7164-4713-86c9-13ed200502f6 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:16.453856 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:16.454323 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:16.698251 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:13:16.698487 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:13:16.757862 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:10:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-861098346',display_name='tempest-SnapshotDataIntegrityTests-server-861098346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-snapshotdataintegritytests-server-861098346',id=49,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtEugPB7K35agCukYtiZDkIOF5umW1btKtXA5Od7BX+LOZfjsS9CwxWAbvc0UoZBFP73KmhsQKPN/5eIoUs7ijMTgQePdBd5m5MenAKKYxEQvwsNk4PZOUfarBt/v5AEw==',key_name='tempest-keypair-1366048519',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:10:57Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaec81e9dd2444e1a6d54f579a902212',ramdisk_id='',reservation_id='r-d3o6kamn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1608231940',owner_user_name='tempest-SnapshotDataIntegrityTests-1608231940-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e7c18085c2d4094a1db01b632006296',uuid=8eb7e5db-7164-4713-86c9-13ed200502f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:13:16.759215 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Converting VIF {"id": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "address": "fa:16:3e:93:34:97", "network": {"id": "fef5d246-ed72-4e47-bf44-75abb4439875", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1289364141-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaec81e9dd2444e1a6d54f579a902212", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9eb869-31", "ovs_interfaceid": "da9eb869-313e-4789-9dd2-c1c0cd327b91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:13:16.759215 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:34:97,bridge_name='br-int',has_traffic_filtering=True,id=da9eb869-313e-4789-9dd2-c1c0cd327b91,network=Network(fef5d246-ed72-4e47-bf44-75abb4439875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9eb869-31') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:13:16.759215 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:34:97,bridge_name='br-int',has_traffic_filtering=True,id=da9eb869-313e-4789-9dd2-c1c0cd327b91,network=Network(fef5d246-ed72-4e47-bf44-75abb4439875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9eb869-31') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:13:16.760315 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:16.760510 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda9eb869-31, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:16.762788 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:16.763384 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:16.763384 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1feadb50-8d94-4208-bc42-0b2896ab4759) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:16.764665 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:16.766700 np0000001565 nova-compute[98289]: INFO os_vif [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:34:97,bridge_name='br-int',has_traffic_filtering=True,id=da9eb869-313e-4789-9dd2-c1c0cd327b91,network=Network(fef5d246-ed72-4e47-bf44-75abb4439875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9eb869-31')
May 27 23:13:16.767555 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Deleting instance files /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6_del
May 27 23:13:16.767678 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Deletion of /opt/stack/data/nova/instances/8eb7e5db-7164-4713-86c9-13ed200502f6_del complete
May 27 23:13:17.202213 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:13:17.274119 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Took 1.35 seconds to destroy the instance on the hypervisor.
May 27 23:13:17.274701 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:13:17.275109 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:13:17.275232 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:13:17.275516 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:17.374824 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:17.393573 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Received event network-vif-unplugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:17.393765 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:17.393877 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:17.394012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:17.394139 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] No waiting events found dispatching network-vif-unplugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:17.394250 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Received event network-vif-unplugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:13:17.394381 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Received event network-vif-unplugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:17.394470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] Acquiring lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:17.394586 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:17.394689 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:17.394783 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] No waiting events found dispatching network-vif-unplugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:17.394877 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-761e4b24-680c-4e19-ac3b-f06626664be3 req-1202bbeb-69cd-485e-a4c7-b2677c8da963 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Received event network-vif-unplugged-da9eb869-313e-4789-9dd2-c1c0cd327b91 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:13:17.591232 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:17.712473 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.258s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:17.738399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:17.738623 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:17.738834 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:17.738911 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:17.739004 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:17.741148 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Terminating instance
May 27 23:13:17.773686 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Deleted allocations for instance 10612118-f248-450c-89e3-663051a76135
May 27 23:13:17.827995 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e726016f-2be6-410a-a16e-0058305e22ec req-60594efb-0d00-4073-a0bb-8184bcb4f763 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Received event network-vif-deleted-da9eb869-313e-4789-9dd2-c1c0cd327b91 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:17.828125 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-e726016f-2be6-410a-a16e-0058305e22ec req-60594efb-0d00-4073-a0bb-8184bcb4f763 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Neutron deleted interface da9eb869-313e-4789-9dd2-c1c0cd327b91; detaching it from the instance and deleting it from the info cache
May 27 23:13:17.829550 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e726016f-2be6-410a-a16e-0058305e22ec req-60594efb-0d00-4073-a0bb-8184bcb4f763 service nova] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Detach interface failed, port_id=da9eb869-313e-4789-9dd2-c1c0cd327b91, reason: Instance 8eb7e5db-7164-4713-86c9-13ed200502f6 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:13:18.244261 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:13:18.264828 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:18.266953 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:18.282921 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:18.284763 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:18.289718 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:18.306307 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:18.312441 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:18.561755 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999595238999973 future=<Future at 0x726e5817c3b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:18.563259 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Instance destroyed successfully.
May 27 23:13:18.563852 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lazy-loading 'resources' on Instance uuid a3323d78-9845-4972-821e-daefe2bf4d67 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:18.667803 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:18.668160 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:18.781375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-289e46f7-7c4a-411c-abbe-fe16c71a9d42 tempest-AttachVolumeNegativeTest-1834166666 tempest-AttachVolumeNegativeTest-1834166666-project-member] Lock "10612118-f248-450c-89e3-663051a76135" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.162s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:18.784964 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Took 1.51 seconds to deallocate network for instance.
May 27 23:13:19.069113 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-369845223',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-369845223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testservervolumeattachscenariooldversion-server-3698452',id=56,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiNP5FJ9i9NYwl3EZ1Y6cqqE1kNKEV7ThOSTdN1xMqzSxKEDa9/LR1D2Esq4MtQRxE5zbivYmk5Zw79IQKfQK0S7EL3FzxHTNiJIIv1asajHR4mlZtbJQt06Ir2gu6Axw==',key_name='tempest-keypair-793516419',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:12:36Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='712851e990684e0eabb135f1e10663d4',ramdisk_id='',reservation_id='r-5kv1nrn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1979128910',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:12:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='984773a4d7b041688390f2c89696b5e0',uuid=a3323d78-9845-4972-821e-daefe2bf4d67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c18db18-9f6f-499b-9f78-0471883b7390", "address": "fa:16:3e:c7:18:a2", "network": {"id": "1dd38190-e852-4640-b9c6-4821c4b409a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1658639789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "712851e990684e0eabb135f1e10663d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c18db18-9f", "ovs_interfaceid": "2c18db18-9f6f-499b-9f78-0471883b7390", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:13:19.069305 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Converting VIF {"id": "2c18db18-9f6f-499b-9f78-0471883b7390", "address": "fa:16:3e:c7:18:a2", "network": {"id": "1dd38190-e852-4640-b9c6-4821c4b409a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1658639789-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "712851e990684e0eabb135f1e10663d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c18db18-9f", "ovs_interfaceid": "2c18db18-9f6f-499b-9f78-0471883b7390", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:13:19.069907 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=2c18db18-9f6f-499b-9f78-0471883b7390,network=Network(1dd38190-e852-4640-b9c6-4821c4b409a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c18db18-9f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:13:19.070204 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=2c18db18-9f6f-499b-9f78-0471883b7390,network=Network(1dd38190-e852-4640-b9c6-4821c4b409a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c18db18-9f') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:13:19.071143 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:19.071389 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c18db18-9f, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:19.072522 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:19.073446 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:19.074317 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:19.074489 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98b95c40-d63c-4128-becf-79719f4a7283) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:19.075168 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:19.075463 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:19.076946 np0000001565 nova-compute[98289]: INFO os_vif [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=2c18db18-9f6f-499b-9f78-0471883b7390,network=Network(1dd38190-e852-4640-b9c6-4821c4b409a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c18db18-9f')
May 27 23:13:19.077182 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Deleting instance files /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67_del
May 27 23:13:19.078390 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Deletion of /opt/stack/data/nova/instances/a3323d78-9845-4972-821e-daefe2bf4d67_del complete
May 27 23:13:19.098980 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:19.170387 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Detaching volume 2dec416a-61c3-4700-b18c-320e0c1728f9
May 27 23:13:19.202584 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Attempting to driver detach volume 2dec416a-61c3-4700-b18c-320e0c1728f9 from mountpoint /dev/vdc
May 27 23:13:19.206167 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Found disk vdc by alias ua-2dec416a-61c3-4700-b18c-320e0c1728f9 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:13:19.207050 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Found disk vdc by alias ua-2dec416a-61c3-4700-b18c-320e0c1728f9 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:13:19.207172 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Attempting to detach device vdc from instance 589f570f-00bc-4fd6-8002-7d583f2d3949 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:13:19.207439 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:13:19.207439 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:19.207439 np0000001565 nova-compute[98289]:   <alias name="ua-2dec416a-61c3-4700-b18c-320e0c1728f9"/>
May 27 23:13:19.207439 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-7"/>
May 27 23:13:19.207439 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:13:19.207439 np0000001565 nova-compute[98289]:   <serial>2dec416a-61c3-4700-b18c-320e0c1728f9</serial>
May 27 23:13:19.207439 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 23:13:19.207439 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:19.207439 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:13:19.212668 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Successfully detached device vdc from instance 589f570f-00bc-4fd6-8002-7d583f2d3949 from the persistent domain config.
May 27 23:13:19.212777 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] (1/8): Attempting to detach device vdc with device alias ua-2dec416a-61c3-4700-b18c-320e0c1728f9 from instance 589f570f-00bc-4fd6-8002-7d583f2d3949 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:13:19.212956 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:13:19.212956 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:19.212956 np0000001565 nova-compute[98289]:   <alias name="ua-2dec416a-61c3-4700-b18c-320e0c1728f9"/>
May 27 23:13:19.212956 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-7"/>
May 27 23:13:19.212956 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:13:19.212956 np0000001565 nova-compute[98289]:   <serial>2dec416a-61c3-4700-b18c-320e0c1728f9</serial>
May 27 23:13:19.212956 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 23:13:19.212956 np0000001565 nova-compute[98289]: </disk>
May 27 23:13:19.212956 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:13:19.291178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:19.291384 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:19.476539 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:13:19.476753 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:13:19.584932 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Took 1.34 seconds to destroy the instance on the hypervisor.
May 27 23:13:19.585588 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:13:19.586034 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:13:19.586137 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:13:19.586434 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:19.648193 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:19.731381 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923599.731033, 589f570f-00bc-4fd6-8002-7d583f2d3949 => ua-2dec416a-61c3-4700-b18c-320e0c1728f9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:13:19.732962 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-2dec416a-61c3-4700-b18c-320e0c1728f9 for instance 589f570f-00bc-4fd6-8002-7d583f2d3949 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:13:19.735703 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Successfully detached device vdc from instance 589f570f-00bc-4fd6-8002-7d583f2d3949 from the live domain config.
May 27 23:13:19.736789 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:13:19.737223 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dec416a-61c3-4700-b18c-320e0c1728f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:13:19.737223 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:19.737412 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:19.737662 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2dec416a-61c3-4700-b18c-320e0c1728f9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:13:19.737769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:13:19.767369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:19.767369 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:19.767369 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:19.767369 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:19.767369 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:19.769302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:19.769302 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:19.769302 np0000001565 nova-compute[98289]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:19.769302 np0000001565 nova-compute[98289]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9 (non-flash)
May 27 23:13:19.769302 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:19.769302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '132')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:13:19.769302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '132')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:19.769302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9', '131')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:19.770365 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e605d8540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9'): ({'sdl'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:13:19.770365 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Removing multipathed devices sdm, sdl {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:13:19.770365 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Flush multipath device 330000000d0512571 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:13:19.798033 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:19.845059 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:19.899229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:13:19.899967 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:13:19.902396 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received event network-vif-unplugged-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:19.902904 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:19.903169 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:19.903350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:19.903561 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] No waiting events found dispatching network-vif-unplugged-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:19.903738 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received event network-vif-unplugged-2c18db18-9f6f-499b-9f78-0471883b7390 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:13:19.904129 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received event network-vif-unplugged-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:19.904262 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] Acquiring lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:19.904443 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:19.904593 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] Lock "a3323d78-9845-4972-821e-daefe2bf4d67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:19.904696 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] No waiting events found dispatching network-vif-unplugged-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:19.905186 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-55a1baf5-54ba-49d9-bbd0-24d3add05ad1 req-3abe99e7-32da-47f8-89a6-83aec28c874c service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received event network-vif-unplugged-2c18db18-9f6f-499b-9f78-0471883b7390 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:13:19.905996 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:13:19.916509 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:13:19.916679 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:13:19.926883 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:19.958320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9, portal: 192.168.40.100,3260]
May 27 23:13:19.958320 np0000001565 nova-compute[98289]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9, portal: 192.168.40.100,3260] successful.
May 27 23:13:19.958320 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:19.973157 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:19.979003 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:13:19.988192 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:20.025065 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9, portal: 192.168.50.100,3260]
May 27 23:13:20.025065 np0000001565 nova-compute[98289]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-2dec416a-61c3-4700-b18c-320e0c1728f9, portal: 192.168.50.100,3260] successful.
May 27 23:13:20.025065 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:20.032431 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:20.032617 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:20.036267 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:20.036493 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:20.036629 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] <== disconnect_volume: return (298ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:20.036731 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:13:20.485024 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.194s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:20.506424 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:20.533381 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Deleted allocations for instance 8eb7e5db-7164-4713-86c9-13ed200502f6
May 27 23:13:20.535594 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:13:20.583505 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lazy-loading 'flavor' on Instance uuid 589f570f-00bc-4fd6-8002-7d583f2d3949 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:21.008472 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Took 1.42 seconds to deallocate network for instance.
May 27 23:13:21.081999 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:21.082197 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:21.085176 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:13:21.085612 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Claim successful on node np0000001565
May 27 23:13:21.513455 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:21.543902 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57e161e7-9a22-4e4a-a572-5a3371d636d1 tempest-SnapshotDataIntegrityTests-1608231940 tempest-SnapshotDataIntegrityTests-1608231940-project-member] Lock "8eb7e5db-7164-4713-86c9-13ed200502f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.131s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:21.591688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f056aa7f-7df5-473c-bb3f-49b9991411d2 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.924s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:21.962281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3050d311-152e-4d02-b690-4e992b4472ad req-7ecd5bfe-8b26-4355-b337-5ac277121cba service nova] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Received event network-vif-deleted-2c18db18-9f6f-499b-9f78-0471883b7390 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:21.962535 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3050d311-152e-4d02-b690-4e992b4472ad req-7ecd5bfe-8b26-4355-b337-5ac277121cba service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-changed-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:21.962695 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3050d311-152e-4d02-b690-4e992b4472ad req-7ecd5bfe-8b26-4355-b337-5ac277121cba service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Refreshing instance network info cache due to event network-changed-095b1112-b13d-4a74-bf06-ffb6ed339a83. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:13:21.962960 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3050d311-152e-4d02-b690-4e992b4472ad req-7ecd5bfe-8b26-4355-b337-5ac277121cba service nova] Acquiring lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:13:21.963050 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3050d311-152e-4d02-b690-4e992b4472ad req-7ecd5bfe-8b26-4355-b337-5ac277121cba service nova] Acquired lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:13:21.963527 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3050d311-152e-4d02-b690-4e992b4472ad req-7ecd5bfe-8b26-4355-b337-5ac277121cba service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Refreshing network info cache for port 095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:13:22.246571 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:13:22.246892 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:13:22.465502 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3050d311-152e-4d02-b690-4e992b4472ad req-7ecd5bfe-8b26-4355-b337-5ac277121cba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:22.726604 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3050d311-152e-4d02-b690-4e992b4472ad req-7ecd5bfe-8b26-4355-b337-5ac277121cba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:22.749056 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:13:22.842184 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:22.844391 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:22.844391 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:22.844391 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:22.844391 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:22.845170 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Terminating instance
May 27 23:13:22.848407 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3050d311-152e-4d02-b690-4e992b4472ad req-7ecd5bfe-8b26-4355-b337-5ac277121cba service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updated VIF entry in instance network info cache for port 095b1112-b13d-4a74-bf06-ffb6ed339a83. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:13:22.848703 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3050d311-152e-4d02-b690-4e992b4472ad req-7ecd5bfe-8b26-4355-b337-5ac277121cba service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updating instance_info_cache with network_info: [{"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:23.257015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:23.257962 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.744s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:23.258256 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:13:23.290832 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004034080002384144 future=<Future at 0x726e5818a060 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:23.291623 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Emitting event <LifecycleEvent: 1779923588.290313, eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:13:23.291760 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:23.291937 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] VM Stopped (Lifecycle Event)
May 27 23:13:23.293220 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.165026411999861 future=<Future at 0x726e3878bf50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:23.293513 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.164909288000217 future=<Future at 0x726e3878bf50 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:23.351451 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3050d311-152e-4d02-b690-4e992b4472ad req-7ecd5bfe-8b26-4355-b337-5ac277121cba service nova] Releasing lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:13:23.352347 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:13:23.370030 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:23.375136 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:23.389863 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:23.394006 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:23.410778 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:23.415725 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:23.421913 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:13:23.422065 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:13:23.643179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:23.649170 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:23.667093 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999737360999916 future=<Future at 0x726e604e9760 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:23.670905 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Instance destroyed successfully.
May 27 23:13:23.670905 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lazy-loading 'resources' on Instance uuid 589f570f-00bc-4fd6-8002-7d583f2d3949 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:23.763808 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:13:23.766978 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:13:23.766978 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:23.766978 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:23.794835 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: eb17a0b3-fb22-4922-b0ab-84c5d54cfa7e] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:23.834622 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:23.848636 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f45f6afa2b7e42148a7685164b694ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed98b56db004061b06363a72405f6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:13:23.924966 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:13:24.039476 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3e33a5c4-4769-4a4a-9045-42e67241d50f req-bac2799b-8575-4a5f-b25e-09c9231052f6 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-changed-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:24.040449 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3e33a5c4-4769-4a4a-9045-42e67241d50f req-bac2799b-8575-4a5f-b25e-09c9231052f6 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Refreshing instance network info cache due to event network-changed-095b1112-b13d-4a74-bf06-ffb6ed339a83. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:13:24.040682 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e33a5c4-4769-4a4a-9045-42e67241d50f req-bac2799b-8575-4a5f-b25e-09c9231052f6 service nova] Acquiring lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:13:24.040832 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e33a5c4-4769-4a4a-9045-42e67241d50f req-bac2799b-8575-4a5f-b25e-09c9231052f6 service nova] Acquired lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:13:24.041005 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3e33a5c4-4769-4a4a-9045-42e67241d50f req-bac2799b-8575-4a5f-b25e-09c9231052f6 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Refreshing network info cache for port 095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:13:24.075624 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:24.100648 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:24.180241 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1915026212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testinstanceswithcindervolumes-server-1915026212',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB709dB6jpd/F31kUar1LFfw6r2eppohl04fJPNYwOb0q/GS7M6SeAgY1ZFhAbyCF+HHqXhbYT9i16j0AZIFo1e7NToaAk/1wmiytCXlMfJD/HdhTgNjju+yO0N9vyUJRA==',key_name='tempest-TestInstancesWithCinderVolumes-980796134',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:12:11Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='face22aba3d94486baaef109923294a3',ramdisk_id='',reservation_id='r-ymxhc3u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-1573798239',owner_user_name='tempest-TestInstancesWithCinderVolumes-1573798239-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:12:11Z,user_data=None,user_id='88750b2b9d1242958b8da2d950c729f2',uuid=589f570f-00bc-4fd6-8002-7d583f2d3949,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:13:24.180241 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Converting VIF {"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:13:24.180241 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=095b1112-b13d-4a74-bf06-ffb6ed339a83,network=Network(e9ecd47d-5f55-4b0a-bc19-078ca260efe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095b1112-b1') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:13:24.180241 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=095b1112-b13d-4a74-bf06-ffb6ed339a83,network=Network(e9ecd47d-5f55-4b0a-bc19-078ca260efe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095b1112-b1') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:13:24.183467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:24.183467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap095b1112-b1, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:24.183467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:24.183467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:24.183467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:24.184382 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:24.184771 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06439b6b-6d98-463d-9e9e-5e81a041c4ee) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:24.186419 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:24.189002 np0000001565 nova-compute[98289]: INFO os_vif [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:7c:08,bridge_name='br-int',has_traffic_filtering=True,id=095b1112-b13d-4a74-bf06-ffb6ed339a83,network=Network(e9ecd47d-5f55-4b0a-bc19-078ca260efe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095b1112-b1')
May 27 23:13:24.190893 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:13:24.191210 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:13:24.191320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:24.191638 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:24.192732 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:13:24.192732 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:13:24.221238 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:24.221238 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:24.221238 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:24.221238 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsi session list stdout=tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:24.221238 np0000001565 nova-compute[98289]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b (non-flash)
May 27 23:13:24.221238 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:24.222899 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '116')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:13:24.222899 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '115')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:24.223654 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b', '116')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:13:24.224254 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3879c860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b'): ({'sdc'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:13:24.224488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:13:24.224757 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Flush multipath device 330000000a8ee9907 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:13:24.267807 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:13:24.280209 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:24.320828 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:13:24.369763 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:13:24.369922 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:13:24.370752 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:13:24.382802 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:13:24.382983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:13:24.395730 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:24.431145 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b, portal: 192.168.40.100,3260]
May 27 23:13:24.431145 np0000001565 nova-compute[98289]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b, portal: 192.168.40.100,3260] successful.
May 27 23:13:24.431145 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:24.433732 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.176s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:24.444119 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:24.454897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:24.480435 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b, portal: 192.168.50.100,3260]
May 27 23:13:24.480435 np0000001565 nova-compute[98289]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-fd10d6c5-8470-4dd0-8b97-6dd3d465063b, portal: 192.168.50.100,3260] successful.
May 27 23:13:24.480435 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:24.483084 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Deleted allocations for instance a3323d78-9845-4972-821e-daefe2bf4d67
May 27 23:13:24.492030 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:24.492879 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:24.493061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] <== disconnect_volume: return (301ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:24.493250 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:13:24.493628 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Deleting instance files /opt/stack/data/nova/instances/589f570f-00bc-4fd6-8002-7d583f2d3949_del
May 27 23:13:24.494522 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Deletion of /opt/stack/data/nova/instances/589f570f-00bc-4fd6-8002-7d583f2d3949_del complete
May 27 23:13:24.543552 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3e33a5c4-4769-4a4a-9045-42e67241d50f req-bac2799b-8575-4a5f-b25e-09c9231052f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:24.646712 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:24.649636 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aaa8cb38-5f5b-489c-9e81-15cb9beef3b2 req-bcf7af72-bd5c-41a9-9b27-26a3d5dea9e0 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-vif-unplugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:24.649689 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aaa8cb38-5f5b-489c-9e81-15cb9beef3b2 req-bcf7af72-bd5c-41a9-9b27-26a3d5dea9e0 service nova] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:24.649822 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aaa8cb38-5f5b-489c-9e81-15cb9beef3b2 req-bcf7af72-bd5c-41a9-9b27-26a3d5dea9e0 service nova] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:24.649923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aaa8cb38-5f5b-489c-9e81-15cb9beef3b2 req-bcf7af72-bd5c-41a9-9b27-26a3d5dea9e0 service nova] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:24.650214 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aaa8cb38-5f5b-489c-9e81-15cb9beef3b2 req-bcf7af72-bd5c-41a9-9b27-26a3d5dea9e0 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] No waiting events found dispatching network-vif-unplugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:24.650214 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aaa8cb38-5f5b-489c-9e81-15cb9beef3b2 req-bcf7af72-bd5c-41a9-9b27-26a3d5dea9e0 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-vif-unplugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:13:24.737832 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Successfully created port: 28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:13:24.771028 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:13:25.011084 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Took 1.66 seconds to destroy the instance on the hypervisor.
May 27 23:13:25.011449 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:13:25.014693 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:13:25.014846 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:13:25.014985 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:25.168881 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:25.207563 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3e33a5c4-4769-4a4a-9045-42e67241d50f req-bac2799b-8575-4a5f-b25e-09c9231052f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:25.325560 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Successfully updated port: 28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:13:25.375849 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a902803-84b3-4a3d-9088-9198a81b2c8d req-4297df89-a4cb-4223-be07-80881b0a2e82 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Received event network-changed-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:25.375968 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9a902803-84b3-4a3d-9088-9198a81b2c8d req-4297df89-a4cb-4223-be07-80881b0a2e82 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Refreshing instance network info cache due to event network-changed-28065d6e-9306-4e37-bd90-45b884decd5e. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:13:25.376120 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a902803-84b3-4a3d-9088-9198a81b2c8d req-4297df89-a4cb-4223-be07-80881b0a2e82 service nova] Acquiring lock "refresh_cache-1bf977e2-b498-4a2d-b7c2-8fc923e51751" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:13:25.376248 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a902803-84b3-4a3d-9088-9198a81b2c8d req-4297df89-a4cb-4223-be07-80881b0a2e82 service nova] Acquired lock "refresh_cache-1bf977e2-b498-4a2d-b7c2-8fc923e51751" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:13:25.376410 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-9a902803-84b3-4a3d-9088-9198a81b2c8d req-4297df89-a4cb-4223-be07-80881b0a2e82 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Refreshing network info cache for port 28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:13:25.450872 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3e33a5c4-4769-4a4a-9045-42e67241d50f req-bac2799b-8575-4a5f-b25e-09c9231052f6 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updated VIF entry in instance network info cache for port 095b1112-b13d-4a74-bf06-ffb6ed339a83. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:13:25.451142 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3e33a5c4-4769-4a4a-9045-42e67241d50f req-bac2799b-8575-4a5f-b25e-09c9231052f6 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updating instance_info_cache with network_info: [{"id": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "address": "fa:16:3e:03:7c:08", "network": {"id": "e9ecd47d-5f55-4b0a-bc19-078ca260efe3", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1855472940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "face22aba3d94486baaef109923294a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap095b1112-b1", "ovs_interfaceid": "095b1112-b13d-4a74-bf06-ffb6ed339a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:25.491342 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-04d60942-72d2-4170-a20c-680e4d13fd0a tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Lock "a3323d78-9845-4972-821e-daefe2bf4d67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.753s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:25.631878 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:25.781207 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:13:25.782098 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:13:25.782317 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Creating image(s)
May 27 23:13:25.782762 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:25.782910 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "/opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:25.783435 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "/opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:25.785252 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:13:25.786618 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:13:25.787587 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:25.828707 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "refresh_cache-1bf977e2-b498-4a2d-b7c2-8fc923e51751" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:13:25.869636 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:25.878661 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-9a902803-84b3-4a3d-9088-9198a81b2c8d req-4297df89-a4cb-4223-be07-80881b0a2e82 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:25.883005 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:13:25.883358 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:25.883818 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:25.884302 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:13:25.888418 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:13:25.888788 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:25.953672 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e33a5c4-4769-4a4a-9045-42e67241d50f req-bac2799b-8575-4a5f-b25e-09c9231052f6 service nova] Releasing lock "refresh_cache-589f570f-00bc-4fd6-8002-7d583f2d3949" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:13:25.961255 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-9a902803-84b3-4a3d-9088-9198a81b2c8d req-4297df89-a4cb-4223-be07-80881b0a2e82 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:13:25.993851 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.105s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:13:25.994304 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:26.050210 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk 1073741824" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:13:26.050766 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.167s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:26.051146 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:26.126494 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-75f9c9c9-1262-4ccd-85cd-5b7ee8897e24 req-9818dc3d-259a-4110-a6fc-e9bbbf0d2415 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-vif-deleted-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:26.140893 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:13:26.141385 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:13:26.141795 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:26.163570 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-9a902803-84b3-4a3d-9088-9198a81b2c8d req-4297df89-a4cb-4223-be07-80881b0a2e82 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:26.233619 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:13:26.233959 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Cannot resize image /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:13:26.234274 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:13:26.234458 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Ensure instance console log exists: /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:13:26.234734 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:26.234938 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:26.235079 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:26.372656 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Took 1.36 seconds to deallocate network for instance.
May 27 23:13:26.666497 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9a902803-84b3-4a3d-9088-9198a81b2c8d req-4297df89-a4cb-4223-be07-80881b0a2e82 service nova] Releasing lock "refresh_cache-1bf977e2-b498-4a2d-b7c2-8fc923e51751" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:13:26.667100 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquired lock "refresh_cache-1bf977e2-b498-4a2d-b7c2-8fc923e51751" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:13:26.667275 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:13:26.720156 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-df196bb0-e62a-49da-97af-2e2bfad2f5a7 req-ba5226ba-50d0-4763-b663-81829b9aefb9 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-vif-unplugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:26.720603 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-df196bb0-e62a-49da-97af-2e2bfad2f5a7 req-ba5226ba-50d0-4763-b663-81829b9aefb9 service nova] Acquiring lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:26.720783 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-df196bb0-e62a-49da-97af-2e2bfad2f5a7 req-ba5226ba-50d0-4763-b663-81829b9aefb9 service nova] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:26.720904 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-df196bb0-e62a-49da-97af-2e2bfad2f5a7 req-ba5226ba-50d0-4763-b663-81829b9aefb9 service nova] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:26.721070 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-df196bb0-e62a-49da-97af-2e2bfad2f5a7 req-ba5226ba-50d0-4763-b663-81829b9aefb9 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] No waiting events found dispatching network-vif-unplugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:26.721258 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-df196bb0-e62a-49da-97af-2e2bfad2f5a7 req-ba5226ba-50d0-4763-b663-81829b9aefb9 service nova] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Received event network-vif-unplugged-095b1112-b13d-4a74-bf06-ffb6ed339a83 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:13:26.928247 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Took 0.56 seconds to detach 1 volumes for instance.
May 27 23:13:27.242148 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:13:27.396096 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:27.424101 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:27.435069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:27.435342 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:27.527364 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Updating instance_info_cache with network_info: [{"id": "28065d6e-9306-4e37-bd90-45b884decd5e", "address": "fa:16:3e:af:b8:86", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28065d6e-93", "ovs_interfaceid": "28065d6e-9306-4e37-bd90-45b884decd5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:27.599437 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:13:27.599760 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:13:28.029096 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Releasing lock "refresh_cache-1bf977e2-b498-4a2d-b7c2-8fc923e51751" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:13:28.029386 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Instance network_info: |[{"id": "28065d6e-9306-4e37-bd90-45b884decd5e", "address": "fa:16:3e:af:b8:86", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28065d6e-93", "ovs_interfaceid": "28065d6e-9306-4e37-bd90-45b884decd5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:13:28.031388 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Start _get_guest_xml network_info=[{"id": "28065d6e-9306-4e37-bd90-45b884decd5e", "address": "fa:16:3e:af:b8:86", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28065d6e-93", "ovs_interfaceid": "28065d6e-9306-4e37-bd90-45b884decd5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:13:28.033967 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:13:28.035124 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-551080605', uuid='1bf977e2-b498-4a2d-b7c2-8fc923e51751'), owner=OwnerMeta(userid='f45f6afa2b7e42148a7685164b694ff3', username='tempest-VolumesBackupsTest-188258886-project-member', projectid='8ed98b56db004061b06363a72405f6ae', projectname='tempest-VolumesBackupsTest-188258886'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "28065d6e-9306-4e37-bd90-45b884decd5e", "address": "fa:16:3e:af:b8:86", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28065d6e-93", "ovs_interfaceid": "28065d6e-9306-4e37-bd90-45b884decd5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923608.034763) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:13:28.036021 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:13:28.036308 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:13:28.037147 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:13:28.037314 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:13:28.038142 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:13:28.038449 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:13:28.038569 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:13:28.038715 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:13:28.038770 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:13:28.038827 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:13:28.038905 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:13:28.039087 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:13:28.039180 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:13:28.039296 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:13:28.039405 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:13:28.039531 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:13:28.049506 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-551080605',display_name='tempest-VolumesBackupsTest-instance-551080605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesbackupstest-instance-551080605',id=57,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjLGZ43jd6XWJnMhli5n2943zbwbdTm8dGE9cApERSxkGbHdE2smfcoTa1bEkkrnPjJVu8IIa6ScoYyMkw9z59oJbZTMZ93PZwO3QQpu8VE/oZgyPnhr+qPlBTQbefRfA==',key_name='tempest-keypair-1168622748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ed98b56db004061b06363a72405f6ae',ramdisk_id='',reservation_id='r-x0zguo7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-188258886',owner_user_name='tempest-VolumesBackupsTest-188258886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f45f6afa2b7e42148a7685164b694ff3',uuid=1bf977e2-b498-4a2d-b7c2-8fc923e51751,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28065d6e-9306-4e37-bd90-45b884decd5e", "address": "fa:16:3e:af:b8:86", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28065d6e-93", "ovs_interfaceid": "28065d6e-9306-4e37-bd90-45b884decd5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:13:28.049730 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converting VIF {"id": "28065d6e-9306-4e37-bd90-45b884decd5e", "address": "fa:16:3e:af:b8:86", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28065d6e-93", "ovs_interfaceid": "28065d6e-9306-4e37-bd90-45b884decd5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:13:28.050155 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:b8:86,bridge_name='br-int',has_traffic_filtering=True,id=28065d6e-9306-4e37-bd90-45b884decd5e,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28065d6e-93') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:13:28.050658 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bf977e2-b498-4a2d-b7c2-8fc923e51751 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:28.102866 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:13:28.458730 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00041238899984819 future=<Future at 0x726e3878bf50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:28.459080 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:28.459080 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.7908828800000265 future=<Future at 0x726e602d2000 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:28.459080 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.790810067000166 future=<Future at 0x726e602d2000 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:28.459170 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Emitting event <LifecycleEvent: 1779923593.4581785, 10612118-f248-450c-89e3-663051a76135 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:13:28.459309 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] VM Stopped (Lifecycle Event)
May 27 23:13:28.553062 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] End _get_guest_xml xml=<domain type="qemu">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <uuid>1bf977e2-b498-4a2d-b7c2-8fc923e51751</uuid>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <name>instance-00000039</name>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumesBackupsTest-instance-551080605</nova:name>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:13:28</nova:creationTime>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:user uuid="f45f6afa2b7e42148a7685164b694ff3">tempest-VolumesBackupsTest-188258886-project-member</nova:user>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:project uuid="8ed98b56db004061b06363a72405f6ae">tempest-VolumesBackupsTest-188258886</nova:project>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         <nova:port uuid="28065d6e-9306-4e37-bd90-45b884decd5e">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <system>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <entry name="serial">1bf977e2-b498-4a2d-b7c2-8fc923e51751</entry>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <entry name="uuid">1bf977e2-b498-4a2d-b7c2-8fc923e51751</entry>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     </system>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <os>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   </os>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <features>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   </features>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   <devices>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     </disk>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk.config"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     </disk>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:af:b8:86"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <target dev="tap28065d6e-93"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     </interface>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/console.log" append="off"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     </serial>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <video>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     </video>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     </rng>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:   </devices>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]: </domain>
May 27 23:13:28.553062 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:13:28.555029 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Preparing to wait for external event network-vif-plugged-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:13:28.555029 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:28.555029 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:28.555029 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:28.555029 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-551080605',display_name='tempest-VolumesBackupsTest-instance-551080605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesbackupstest-instance-551080605',id=57,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjLGZ43jd6XWJnMhli5n2943zbwbdTm8dGE9cApERSxkGbHdE2smfcoTa1bEkkrnPjJVu8IIa6ScoYyMkw9z59oJbZTMZ93PZwO3QQpu8VE/oZgyPnhr+qPlBTQbefRfA==',key_name='tempest-keypair-1168622748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ed98b56db004061b06363a72405f6ae',ramdisk_id='',reservation_id='r-x0zguo7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-188258886',owner_user_name='tempest-VolumesBackupsTest-188258886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f45f6afa2b7e42148a7685164b694ff3',uuid=1bf977e2-b498-4a2d-b7c2-8fc923e51751,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28065d6e-9306-4e37-bd90-45b884decd5e", "address": "fa:16:3e:af:b8:86", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28065d6e-93", "ovs_interfaceid": "28065d6e-9306-4e37-bd90-45b884decd5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:13:28.555029 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converting VIF {"id": "28065d6e-9306-4e37-bd90-45b884decd5e", "address": "fa:16:3e:af:b8:86", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28065d6e-93", "ovs_interfaceid": "28065d6e-9306-4e37-bd90-45b884decd5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:13:28.555369 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:b8:86,bridge_name='br-int',has_traffic_filtering=True,id=28065d6e-9306-4e37-bd90-45b884decd5e,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28065d6e-93') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:13:28.555419 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:b8:86,bridge_name='br-int',has_traffic_filtering=True,id=28065d6e-9306-4e37-bd90-45b884decd5e,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28065d6e-93') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:13:28.555664 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:28.555869 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:28.556074 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:13:28.556528 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:28.556663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4623141-ef62-5dfd-8c7b-f0f10ef6e955', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:28.564694 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:28.565853 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:28.567519 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:28.569411 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:28.569541 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28065d6e-93, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:28.569822 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28065d6e-93, col_values=(('qos', UUID('f2ee8bba-1c16-4b30-b038-e6fd0362c461')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:28.569973 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28065d6e-93, col_values=(('external_ids', {'iface-id': '28065d6e-9306-4e37-bd90-45b884decd5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:b8:86', 'vm-uuid': '1bf977e2-b498-4a2d-b7c2-8fc923e51751'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:28.571434 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:28.572757 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:28.577868 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:28.578871 np0000001565 nova-compute[98289]: INFO os_vif [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:b8:86,bridge_name='br-int',has_traffic_filtering=True,id=28065d6e-9306-4e37-bd90-45b884decd5e,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28065d6e-93')
May 27 23:13:28.610631 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:28.669886 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Deleted allocations for instance 589f570f-00bc-4fd6-8002-7d583f2d3949
May 27 23:13:28.961707 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: 10612118-f248-450c-89e3-663051a76135] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:29.048489 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:29.677820 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4ec4d7fe-0f92-433a-b6b3-036f99fb8d65 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Lock "589f570f-00bc-4fd6-8002-7d583f2d3949" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.835s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:30.098362 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:30.098478 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:30.098637 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No VIF found with MAC fa:16:3e:af:b8:86, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:13:30.099185 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Using config drive
May 27 23:13:30.603973 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:30.715613 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Creating config drive at /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk.config
May 27 23:13:30.720404 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprpq5u5et {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:30.777349 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprpq5u5et" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:13:31.001469 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:31.215784 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:31.240800 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:31.244021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:31.250216 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004026850001537241 future=<Future at 0x726e602d2000 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:31.250309 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:31.250464 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.3108444590002364 future=<Future at 0x726e5817c3b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:31.250584 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=2.3107323950002865 future=<Future at 0x726e5817c3b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:31.252518 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Emitting event <LifecycleEvent: 1779923596.249694, 8eb7e5db-7164-4713-86c9-13ed200502f6 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:13:31.252872 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] VM Stopped (Lifecycle Event)
May 27 23:13:31.344494 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:31.347480 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:31.644301 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:31.649706 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:31.667551 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:31.756954 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 8eb7e5db-7164-4713-86c9-13ed200502f6] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:31.865343 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ef261f89-eaf5-429a-972f-0e5379042f75 req-5f662d8b-e696-4327-aeb1-b569a19ab75f service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Received event network-vif-plugged-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:31.865650 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ef261f89-eaf5-429a-972f-0e5379042f75 req-5f662d8b-e696-4327-aeb1-b569a19ab75f service nova] Acquiring lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:31.865858 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ef261f89-eaf5-429a-972f-0e5379042f75 req-5f662d8b-e696-4327-aeb1-b569a19ab75f service nova] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:31.866284 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ef261f89-eaf5-429a-972f-0e5379042f75 req-5f662d8b-e696-4327-aeb1-b569a19ab75f service nova] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:31.867469 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ef261f89-eaf5-429a-972f-0e5379042f75 req-5f662d8b-e696-4327-aeb1-b569a19ab75f service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Processing event network-vif-plugged-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:13:31.950362 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923611.9499354, 1bf977e2-b498-4a2d-b7c2-8fc923e51751 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:13:31.950996 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:13:31.951234 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] VM Started (Lifecycle Event)
May 27 23:13:31.953462 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:13:31.956602 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Instance spawned successfully.
May 27 23:13:31.957380 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:13:32.453710 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:32.455510 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:13:32.462610 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:32.462808 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:32.463064 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:32.463516 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:32.463669 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:32.463974 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:32.957724 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:13:32.958115 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923612.957806, 1bf977e2-b498-4a2d-b7c2-8fc923e51751 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:13:32.958115 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] VM Paused (Lifecycle Event)
May 27 23:13:32.969441 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Took 7.19 seconds to spawn the instance on the hypervisor.
May 27 23:13:32.969771 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:33.460399 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:33.463139 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923613.462843, 1bf977e2-b498-4a2d-b7c2-8fc923e51751 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:13:33.463306 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] VM Resumed (Lifecycle Event)
May 27 23:13:33.479001 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Took 12.44 seconds to build instance.
May 27 23:13:33.561730 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.000315467999826069 future=<Future at 0x726e5817c3b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:33.563748 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] Emitting event <LifecycleEvent: 1779923598.5612407, a3323d78-9845-4972-821e-daefe2bf4d67 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:13:33.563912 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:33.564147 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] VM Stopped (Lifecycle Event)
May 27 23:13:33.564636 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.102188930000011 future=<Future at 0x726e604e9760 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:33.564734 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=5.102062308999848 future=<Future at 0x726e604e9760 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:33.573920 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:33.595213 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:33.958320 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fa267d3c-212e-4678-86a4-f8efd53473ac req-648b1cef-a188-4f9c-bdd8-d70bd8977e96 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Received event network-vif-plugged-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:33.959681 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fa267d3c-212e-4678-86a4-f8efd53473ac req-648b1cef-a188-4f9c-bdd8-d70bd8977e96 service nova] Acquiring lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:33.959856 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fa267d3c-212e-4678-86a4-f8efd53473ac req-648b1cef-a188-4f9c-bdd8-d70bd8977e96 service nova] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:33.959974 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fa267d3c-212e-4678-86a4-f8efd53473ac req-648b1cef-a188-4f9c-bdd8-d70bd8977e96 service nova] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:33.960109 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fa267d3c-212e-4678-86a4-f8efd53473ac req-648b1cef-a188-4f9c-bdd8-d70bd8977e96 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] No waiting events found dispatching network-vif-plugged-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:33.960231 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-fa267d3c-212e-4678-86a4-f8efd53473ac req-648b1cef-a188-4f9c-bdd8-d70bd8977e96 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Received unexpected event network-vif-plugged-28065d6e-9306-4e37-bd90-45b884decd5e for instance with vm_state active and task_state None.
May 27 23:13:33.965578 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:33.967419 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:13:33.980931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.948s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:34.067408 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-332186a4-5b24-42d8-9096-6d21f539e30f tempest-AttachVolumeTestJSON-849627440 tempest-AttachVolumeTestJSON-849627440-project-member] [instance: a3323d78-9845-4972-821e-daefe2bf4d67] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:34.102774 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:34.304630 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-03c41bd4-fa06-41e5-b13b-b62e6fb4f797 req-83cd5e4e-7dcc-4d6b-af18-f7e49e7af963 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Received event network-changed-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:34.305142 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-03c41bd4-fa06-41e5-b13b-b62e6fb4f797 req-83cd5e4e-7dcc-4d6b-af18-f7e49e7af963 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Refreshing instance network info cache due to event network-changed-28065d6e-9306-4e37-bd90-45b884decd5e. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:13:34.305361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-03c41bd4-fa06-41e5-b13b-b62e6fb4f797 req-83cd5e4e-7dcc-4d6b-af18-f7e49e7af963 service nova] Acquiring lock "refresh_cache-1bf977e2-b498-4a2d-b7c2-8fc923e51751" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:13:34.305451 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-03c41bd4-fa06-41e5-b13b-b62e6fb4f797 req-83cd5e4e-7dcc-4d6b-af18-f7e49e7af963 service nova] Acquired lock "refresh_cache-1bf977e2-b498-4a2d-b7c2-8fc923e51751" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:13:34.305600 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-03c41bd4-fa06-41e5-b13b-b62e6fb4f797 req-83cd5e4e-7dcc-4d6b-af18-f7e49e7af963 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Refreshing network info cache for port 28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:13:34.808154 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-03c41bd4-fa06-41e5-b13b-b62e6fb4f797 req-83cd5e4e-7dcc-4d6b-af18-f7e49e7af963 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:35.014259 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:35.169714 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-03c41bd4-fa06-41e5-b13b-b62e6fb4f797 req-83cd5e4e-7dcc-4d6b-af18-f7e49e7af963 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:35.303506 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-03c41bd4-fa06-41e5-b13b-b62e6fb4f797 req-83cd5e4e-7dcc-4d6b-af18-f7e49e7af963 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Updated VIF entry in instance network info cache for port 28065d6e-9306-4e37-bd90-45b884decd5e. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:13:35.303819 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-03c41bd4-fa06-41e5-b13b-b62e6fb4f797 req-83cd5e4e-7dcc-4d6b-af18-f7e49e7af963 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Updating instance_info_cache with network_info: [{"id": "28065d6e-9306-4e37-bd90-45b884decd5e", "address": "fa:16:3e:af:b8:86", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28065d6e-93", "ovs_interfaceid": "28065d6e-9306-4e37-bd90-45b884decd5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:35.806449 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-03c41bd4-fa06-41e5-b13b-b62e6fb4f797 req-83cd5e4e-7dcc-4d6b-af18-f7e49e7af963 service nova] Releasing lock "refresh_cache-1bf977e2-b498-4a2d-b7c2-8fc923e51751" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:13:35.809213 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:36.750359 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:37.409438 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "4d848608-aa41-4631-82ab-11a5c16953bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:37.409663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "4d848608-aa41-4631-82ab-11a5c16953bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:37.911807 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:13:38.458424 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:38.458563 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:38.461678 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:13:38.462012 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Claim successful on node np0000001565
May 27 23:13:38.587525 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:38.667167 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.000314656000227842 future=<Future at 0x726e604e9760 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:38.667599 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] Emitting event <LifecycleEvent: 1779923603.6667433, 589f570f-00bc-4fd6-8002-7d583f2d3949 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:13:38.667768 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:13:38.667903 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] VM Stopped (Lifecycle Event)
May 27 23:13:39.103817 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:39.170061 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-75a64eaa-7f2c-4556-b9fb-526a046d8a43 tempest-TestInstancesWithCinderVolumes-1573798239 tempest-TestInstancesWithCinderVolumes-1573798239-project-member] [instance: 589f570f-00bc-4fd6-8002-7d583f2d3949] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:39.579743 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:13:39.579942 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:13:39.869700 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:40.082678 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:13:40.591566 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.133s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:40.592123 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:13:41.097695 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:13:41.097924 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:13:41.098201 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:41.098458 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:41.218715 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2cab84a3b4a4d29b3b73c43b289bc84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ce6e9f639646e38a211e3e71ac9bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:13:41.600750 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:13:41.758726 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Successfully created port: 51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:13:41.929478 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:42.103929 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:13:42.357470 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Successfully updated port: 51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:13:42.412645 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-68c9eee9-5891-46d9-9887-2bf22dd78142 req-0cb92416-51cc-4520-9031-071c58611ef6 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Received event network-changed-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:42.412809 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-68c9eee9-5891-46d9-9887-2bf22dd78142 req-0cb92416-51cc-4520-9031-071c58611ef6 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Refreshing instance network info cache due to event network-changed-51b40f06-e533-4676-b332-7f93408a575d. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:13:42.412963 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-68c9eee9-5891-46d9-9887-2bf22dd78142 req-0cb92416-51cc-4520-9031-071c58611ef6 service nova] Acquiring lock "refresh_cache-4d848608-aa41-4631-82ab-11a5c16953bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:13:42.413368 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-68c9eee9-5891-46d9-9887-2bf22dd78142 req-0cb92416-51cc-4520-9031-071c58611ef6 service nova] Acquired lock "refresh_cache-4d848608-aa41-4631-82ab-11a5c16953bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:13:42.413495 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-68c9eee9-5891-46d9-9887-2bf22dd78142 req-0cb92416-51cc-4520-9031-071c58611ef6 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Refreshing network info cache for port 51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:13:42.607765 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Booting with volume 839474d9-cac5-46e0-9072-9d72b469bf74 at /dev/vda
May 27 23:13:42.662037 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:13:42.677241 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:13:42.704993 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:42.756844 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:13:42.757185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:13:42.766257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:13:42.767558 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:feaf:b886', 'fe80::3ca1:7dff:fece:9122'] 
May 27 23:13:42.767757 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:13:42.768043 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:13:42.768325 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:42.768897 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Updating existing volume attachment record: e44fbdce-6221-4726-9cb2-7c7ef1e33bac {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:13:42.860590 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "refresh_cache-4d848608-aa41-4631-82ab-11a5c16953bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:13:42.915539 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-68c9eee9-5891-46d9-9887-2bf22dd78142 req-0cb92416-51cc-4520-9031-071c58611ef6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:42.975510 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-68c9eee9-5891-46d9-9887-2bf22dd78142 req-0cb92416-51cc-4520-9031-071c58611ef6 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:13:43.063990 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dd72d3c5-e32c-45e3-b2b0-8c96b96dacc1 req-f229b933-f128-4cb4-8c84-8384369f6e1a service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Received event network-vif-unplugged-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:43.064212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd72d3c5-e32c-45e3-b2b0-8c96b96dacc1 req-f229b933-f128-4cb4-8c84-8384369f6e1a service nova] Acquiring lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:43.064381 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd72d3c5-e32c-45e3-b2b0-8c96b96dacc1 req-f229b933-f128-4cb4-8c84-8384369f6e1a service nova] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:43.064506 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd72d3c5-e32c-45e3-b2b0-8c96b96dacc1 req-f229b933-f128-4cb4-8c84-8384369f6e1a service nova] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:43.064629 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dd72d3c5-e32c-45e3-b2b0-8c96b96dacc1 req-f229b933-f128-4cb4-8c84-8384369f6e1a service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] No waiting events found dispatching network-vif-unplugged-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:43.064759 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-dd72d3c5-e32c-45e3-b2b0-8c96b96dacc1 req-f229b933-f128-4cb4-8c84-8384369f6e1a service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Received unexpected event network-vif-unplugged-51b40f06-e533-4676-b332-7f93408a575d for instance with vm_state building and task_state block_device_mapping.
May 27 23:13:43.104754 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-68c9eee9-5891-46d9-9887-2bf22dd78142 req-0cb92416-51cc-4520-9031-071c58611ef6 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:43.588793 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:43.620611 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-68c9eee9-5891-46d9-9887-2bf22dd78142 req-0cb92416-51cc-4520-9031-071c58611ef6 service nova] Releasing lock "refresh_cache-4d848608-aa41-4631-82ab-11a5c16953bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:13:43.621559 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquired lock "refresh_cache-4d848608-aa41-4631-82ab-11a5c16953bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:13:43.621828 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:13:44.105192 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:44.187434 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:13:44.371887 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:44.508612 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Updating instance_info_cache with network_info: [{"id": "51b40f06-e533-4676-b332-7f93408a575d", "address": "fa:16:3e:a9:65:aa", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b40f06-e5", "ovs_interfaceid": "51b40f06-e533-4676-b332-7f93408a575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:13:44.867153 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:13:44.868272 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:13:44.868545 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Creating image(s)
May 27 23:13:44.868821 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:13:44.869051 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Ensure instance console log exists: /opt/stack/data/nova/instances/4d848608-aa41-4631-82ab-11a5c16953bb/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:13:44.869281 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:44.869571 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:44.869718 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:45.010383 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Releasing lock "refresh_cache-4d848608-aa41-4631-82ab-11a5c16953bb" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:13:45.010661 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Instance network_info: |[{"id": "51b40f06-e533-4676-b332-7f93408a575d", "address": "fa:16:3e:a9:65:aa", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b40f06-e5", "ovs_interfaceid": "51b40f06-e533-4676-b332-7f93408a575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:13:45.011397 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Start _get_guest_xml network_info=[{"id": "51b40f06-e533-4676-b332-7f93408a575d", "address": "fa:16:3e:a9:65:aa", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b40f06-e5", "ovs_interfaceid": "51b40f06-e533-4676-b332-7f93408a575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e44fbdce-6221-4726-9cb2-7c7ef1e33bac', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '839474d9-cac5-46e0-9072-9d72b469bf74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4d848608-aa41-4631-82ab-11a5c16953bb', 'attached_at': '', 'detached_at': '', 'volume_id': '839474d9-cac5-46e0-9072-9d72b469bf74', 'serial': '839474d9-cac5-46e0-9072-9d72b469bf74'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:13:45.014876 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:13:45.015887 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='4d848608-aa41-4631-82ab-11a5c16953bb'), owner=OwnerMeta(userid='c2cab84a3b4a4d29b3b73c43b289bc84', username='tempest-ImageDependencyTests-932348261-project-member', projectid='72ce6e9f639646e38a211e3e71ac9bbb', projectname='tempest-ImageDependencyTests-932348261'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "51b40f06-e533-4676-b332-7f93408a575d", "address": "fa:16:3e:a9:65:aa", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b40f06-e5", "ovs_interfaceid": "51b40f06-e533-4676-b332-7f93408a575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923625.015562) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:13:45.017022 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:13:45.017289 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:13:45.018161 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:13:45.018372 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:13:45.019184 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:13:45.019457 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:13:45.019580 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:13:45.019686 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:13:45.019806 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:13:45.019892 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:13:45.020050 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:13:45.020201 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:13:45.020360 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:13:45.020606 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:13:45.020721 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:13:45.020834 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:13:45.030050 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:13:45.030324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '839474d9-cac5-46e0-9072-9d72b469bf74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:13:45.030467 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:46.683771 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.653s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:46.684326 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '839474d9-cac5-46e0-9072-9d72b469bf74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:13:46.695002 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:46.695449 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:13:46.695811 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:46.696013 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:13:46.696280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:13:46.696999 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:13:46.708875 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:13:46.708875 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:46.714269 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:13:46.714269 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:46.725616 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74] added
May 27 23:13:46.725616 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:13:46.725616 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:46.725616 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:46.725616 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:46.725616 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:46.725616 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:46.725616 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:13:46.725616 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:13:46.725616 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:13:46.728144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74] added
May 27 23:13:46.728144 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:13:46.728144 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:46.728144 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:46.728144 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:13:46.728144 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:13:46.728144 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:46.728406 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:13:46.728406 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:13:46.728574 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:13:47.724701 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:13:47.728870 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:13:47.737685 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:13:47.737685 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:13:47.741478 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:13:47.741478 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:47.751393 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:47.755712 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:47.761908 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-505a6bdb-4f67-4d22-82ea-f16dc1920c7c (non-flash)
May 27 23:13:47.761908 np0000001565 nova-compute[98289]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a5f95f-b183-46ad-b996-cd6d360c4e0a (non-flash)
May 27 23:13:47.761908 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:47.762122 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-505a6bdb-4f67-4d22-82ea-f16dc1920c7c (non-flash)
May 27 23:13:47.762122 np0000001565 nova-compute[98289]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a5f95f-b183-46ad-b996-cd6d360c4e0a (non-flash)
May 27 23:13:47.762122 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:47.768955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-505a6bdb-4f67-4d22-82ea-f16dc1920c7c (non-flash)
May 27 23:13:47.768955 np0000001565 nova-compute[98289]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a5f95f-b183-46ad-b996-cd6d360c4e0a (non-flash)
May 27 23:13:47.768955 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:47.769096 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-505a6bdb-4f67-4d22-82ea-f16dc1920c7c (non-flash)
May 27 23:13:47.769096 np0000001565 nova-compute[98289]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a5f95f-b183-46ad-b996-cd6d360c4e0a (non-flash)
May 27 23:13:47.769096 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:47.800603 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74, portal: 192.168.40.100,3260]
May 27 23:13:47.800603 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74, portal: 192.168.40.100,3260] successful.
May 27 23:13:47.800603 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:47.814527 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:47.826586 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-505a6bdb-4f67-4d22-82ea-f16dc1920c7c (non-flash)
May 27 23:13:47.826586 np0000001565 nova-compute[98289]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a5f95f-b183-46ad-b996-cd6d360c4e0a (non-flash)
May 27 23:13:47.826586 np0000001565 nova-compute[98289]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74 (non-flash)
May 27 23:13:47.826586 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:47.826763 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-505a6bdb-4f67-4d22-82ea-f16dc1920c7c (non-flash)
May 27 23:13:47.826763 np0000001565 nova-compute[98289]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a5f95f-b183-46ad-b996-cd6d360c4e0a (non-flash)
May 27 23:13:47.826763 np0000001565 nova-compute[98289]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74 (non-flash)
May 27 23:13:47.826763 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:47.826970 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:47.827074 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:13:47.827614 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] HCTL ('8', '-', '-', 0) found on session 141 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:13:47.827728 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:13:47.841131 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Searching for a device in session 141 and hctl ['8', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:13:48.589982 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:48.626072 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:13:48.807042 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74, portal: 192.168.50.100,3260]
May 27 23:13:48.807042 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74, portal: 192.168.50.100,3260] successful.
May 27 23:13:48.807042 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:48.819917 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:13:48.833277 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-505a6bdb-4f67-4d22-82ea-f16dc1920c7c (non-flash)
May 27 23:13:48.833277 np0000001565 nova-compute[98289]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a5f95f-b183-46ad-b996-cd6d360c4e0a (non-flash)
May 27 23:13:48.833277 np0000001565 nova-compute[98289]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74 (non-flash)
May 27 23:13:48.833277 np0000001565 nova-compute[98289]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74 (non-flash)
May 27 23:13:48.833277 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:13:48.833458 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-505a6bdb-4f67-4d22-82ea-f16dc1920c7c (non-flash)
May 27 23:13:48.833458 np0000001565 nova-compute[98289]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53a5f95f-b183-46ad-b996-cd6d360c4e0a (non-flash)
May 27 23:13:48.833458 np0000001565 nova-compute[98289]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74 (non-flash)
May 27 23:13:48.833458 np0000001565 nova-compute[98289]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74 (non-flash)
May 27 23:13:48.833458 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:13:48.833777 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.137s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:48.833925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:13:48.834721 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] HCTL ('10', '-', '-', 0) found on session 142 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:13:48.834853 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:13:48.841835 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Searching for a device in session 141 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:13:48.842010 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '839474d9-cac5-46e0-9072-9d72b469bf74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:13:48.857718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Searching for a device in session 142 and hctl ['10', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:13:49.119584 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:49.129812 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:49.129996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:49.130133 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:49.130343 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:13:49.858405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Searching for a device in session 142 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:13:49.858840 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '839474d9-cac5-46e0-9072-9d72b469bf74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:13:50.146017 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:50.231285 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:13:50.231861 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:50.322643 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:13:50.326390 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:13:50.327544 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:50.372649 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:13:50.373130 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13493MB free_disk=72.86756896972656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:13:50.373310 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:50.373625 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:50.711489 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Found WWN 330000000be38248c for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:13:50.711873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:13:50.712051 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] <== connect_volume: return (5681ms) {'type': 'block', 'scsi_wwn': '330000000be38248c', 'path': '/dev/dm-0', 'multipath_id': '330000000be38248c'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:13:50.712200 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000be38248c', 'path': '/dev/dm-0', 'multipath_id': '330000000be38248c'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:13:51.217166 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='instance-depend-image',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ce6e9f639646e38a211e3e71ac9bbb',ramdisk_id='',reservation_id='r-hc0j7ipz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-932348261',owner_user_name='tempest-ImageDependencyTests-932348261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:13:42Z,user_data=None,user_id='c2cab84a3b4a4d29b3b73c43b289bc84',uuid=4d848608-aa41-4631-82ab-11a5c16953bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b40f06-e533-4676-b332-7f93408a575d", "address": "fa:16:3e:a9:65:aa", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b40f06-e5", "ovs_interfaceid": "51b40f06-e533-4676-b332-7f93408a575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:13:51.217686 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Converting VIF {"id": "51b40f06-e533-4676-b332-7f93408a575d", "address": "fa:16:3e:a9:65:aa", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b40f06-e5", "ovs_interfaceid": "51b40f06-e533-4676-b332-7f93408a575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:13:51.217917 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:65:aa,bridge_name='br-int',has_traffic_filtering=True,id=51b40f06-e533-4676-b332-7f93408a575d,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b40f06-e5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:13:51.218560 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d848608-aa41-4631-82ab-11a5c16953bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:13:51.449181 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 1bf977e2-b498-4a2d-b7c2-8fc923e51751 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:13:51.449932 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 4d848608-aa41-4631-82ab-11a5c16953bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:13:51.449932 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:13:51.449932 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:13:50 up 42 min,  2 users,  load average: 4.16, 5.54, 4.39\n', 'num_instances': '2', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_8ed98b56db004061b06363a72405f6ae': '1', 'io_workload': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_72ce6e9f639646e38a211e3e71ac9bbb': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:13:51.572088 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:13:51.572282 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:13:51.721644 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] End _get_guest_xml xml=<domain type="qemu">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <uuid>4d848608-aa41-4631-82ab-11a5c16953bb</uuid>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <name>instance-0000003a</name>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <nova:name>instance-depend-image</nova:name>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:13:45</nova:creationTime>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:properties/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:user uuid="c2cab84a3b4a4d29b3b73c43b289bc84">tempest-ImageDependencyTests-932348261-project-member</nova:user>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:project uuid="72ce6e9f639646e38a211e3e71ac9bbb">tempest-ImageDependencyTests-932348261</nova:project>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         <nova:port uuid="51b40f06-e533-4676-b332-7f93408a575d">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="192.168.233.165" ipVersion="4"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <system>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <entry name="serial">4d848608-aa41-4631-82ab-11a5c16953bb</entry>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <entry name="uuid">4d848608-aa41-4631-82ab-11a5c16953bb</entry>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     </system>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <os>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   </os>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <features>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   </features>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   <devices>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4d848608-aa41-4631-82ab-11a5c16953bb/disk.config"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     </disk>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <alias name="ua-839474d9-cac5-46e0-9072-9d72b469bf74"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <serial>839474d9-cac5-46e0-9072-9d72b469bf74</serial>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     </disk>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:a9:65:aa"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <target dev="tap51b40f06-e5"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     </interface>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/4d848608-aa41-4631-82ab-11a5c16953bb/console.log" append="off"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     </serial>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <video>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     </video>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     </rng>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:   </devices>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]: </domain>
May 27 23:13:51.721644 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:13:51.724573 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Preparing to wait for external event network-vif-plugged-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:13:51.724573 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:51.724573 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:51.724573 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:51.724573 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='instance-depend-image',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ce6e9f639646e38a211e3e71ac9bbb',ramdisk_id='',reservation_id='r-hc0j7ipz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-932348261',owner_user_name='tempest-ImageDependencyTests-932348261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:13:42Z,user_data=None,user_id='c2cab84a3b4a4d29b3b73c43b289bc84',uuid=4d848608-aa41-4631-82ab-11a5c16953bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b40f06-e533-4676-b332-7f93408a575d", "address": "fa:16:3e:a9:65:aa", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b40f06-e5", "ovs_interfaceid": "51b40f06-e533-4676-b332-7f93408a575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:13:51.724573 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Converting VIF {"id": "51b40f06-e533-4676-b332-7f93408a575d", "address": "fa:16:3e:a9:65:aa", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b40f06-e5", "ovs_interfaceid": "51b40f06-e533-4676-b332-7f93408a575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:13:51.724573 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:65:aa,bridge_name='br-int',has_traffic_filtering=True,id=51b40f06-e533-4676-b332-7f93408a575d,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b40f06-e5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:13:51.724573 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:65:aa,bridge_name='br-int',has_traffic_filtering=True,id=51b40f06-e533-4676-b332-7f93408a575d,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b40f06-e5') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:13:51.724883 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:51.725767 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:51.725767 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:13:51.726203 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:51.726361 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e733a2f1-6bf6-59ef-978e-cffa93c5784a', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:51.727222 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:51.728128 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:51.728235 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:51.730231 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:51.730386 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51b40f06-e5, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:51.730734 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51b40f06-e5, col_values=(('qos', UUID('d48b92f0-d78e-468b-9896-1e9b689591dc')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:51.730907 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51b40f06-e5, col_values=(('external_ids', {'iface-id': '51b40f06-e533-4676-b332-7f93408a575d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:65:aa', 'vm-uuid': '4d848608-aa41-4631-82ab-11a5c16953bb'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:13:51.731642 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:51.732587 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:13:51.737500 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:51.739223 np0000001565 nova-compute[98289]: INFO os_vif [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:65:aa,bridge_name='br-int',has_traffic_filtering=True,id=51b40f06-e533-4676-b332-7f93408a575d,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b40f06-e5')
May 27 23:13:52.074601 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:13:52.580578 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:13:52.580913 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.207s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:52.581094 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 8.49 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:13:53.253981 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:53.254183 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:13:53.254322 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] No VIF found with MAC fa:16:3e:a9:65:aa, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:13:53.254750 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Using config drive
May 27 23:13:53.759468 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:13:53.863591 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Creating config drive at /opt/stack/data/nova/instances/4d848608-aa41-4631-82ab-11a5c16953bb/disk.config
May 27 23:13:53.867129 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4d848608-aa41-4631-82ab-11a5c16953bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfc82dql9 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:13:53.926923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4d848608-aa41-4631-82ab-11a5c16953bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfc82dql9" returned: 0 in 0.059s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:13:54.132270 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:54.317294 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:54.370305 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:54.371390 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:54.371946 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:54.430237 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:54.529567 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f660061e-6b08-4505-a7a6-a7d4876bc8b4 req-a2c7d23a-c3ed-4e7d-82e8-d5d1643e7389 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Received event network-vif-plugged-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:54.529803 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f660061e-6b08-4505-a7a6-a7d4876bc8b4 req-a2c7d23a-c3ed-4e7d-82e8-d5d1643e7389 service nova] Acquiring lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:54.529950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f660061e-6b08-4505-a7a6-a7d4876bc8b4 req-a2c7d23a-c3ed-4e7d-82e8-d5d1643e7389 service nova] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:54.530069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f660061e-6b08-4505-a7a6-a7d4876bc8b4 req-a2c7d23a-c3ed-4e7d-82e8-d5d1643e7389 service nova] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:54.530178 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f660061e-6b08-4505-a7a6-a7d4876bc8b4 req-a2c7d23a-c3ed-4e7d-82e8-d5d1643e7389 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Processing event network-vif-plugged-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:13:54.664674 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:54.666065 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:54.675923 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:54.676934 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:54.694581 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:55.063820 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923635.063143, 4d848608-aa41-4631-82ab-11a5c16953bb => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:13:55.064574 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:13:55.064844 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] VM Started (Lifecycle Event)
May 27 23:13:55.069679 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:13:55.071397 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Instance spawned successfully.
May 27 23:13:55.071793 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:13:55.577851 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:55.577851 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:13:55.584072 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:55.584072 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:55.586483 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:55.586994 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:55.589590 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:55.590015 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:13:56.078854 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:13:56.079413 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923636.0789425, 4d848608-aa41-4631-82ab-11a5c16953bb => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:13:56.079413 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] VM Paused (Lifecycle Event)
May 27 23:13:56.095219 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Took 11.23 seconds to spawn the instance on the hypervisor.
May 27 23:13:56.095746 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:56.574889 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-03790807-0bbd-4bc7-be23-1ae43a62d7c2 req-d6990f0b-198d-4ab2-995a-1eac9ecd96df service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Received event network-vif-plugged-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:13:56.575089 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-03790807-0bbd-4bc7-be23-1ae43a62d7c2 req-d6990f0b-198d-4ab2-995a-1eac9ecd96df service nova] Acquiring lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:13:56.575187 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-03790807-0bbd-4bc7-be23-1ae43a62d7c2 req-d6990f0b-198d-4ab2-995a-1eac9ecd96df service nova] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:13:56.575767 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-03790807-0bbd-4bc7-be23-1ae43a62d7c2 req-d6990f0b-198d-4ab2-995a-1eac9ecd96df service nova] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:56.575910 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-03790807-0bbd-4bc7-be23-1ae43a62d7c2 req-d6990f0b-198d-4ab2-995a-1eac9ecd96df service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] No waiting events found dispatching network-vif-plugged-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:13:56.576031 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-03790807-0bbd-4bc7-be23-1ae43a62d7c2 req-d6990f0b-198d-4ab2-995a-1eac9ecd96df service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Received unexpected event network-vif-plugged-51b40f06-e533-4676-b332-7f93408a575d for instance with vm_state active and task_state None.
May 27 23:13:56.581167 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:56.583304 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923636.5831382, 4d848608-aa41-4631-82ab-11a5c16953bb => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:13:56.583435 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] VM Resumed (Lifecycle Event)
May 27 23:13:56.604035 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Took 18.19 seconds to build instance.
May 27 23:13:56.745589 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:13:57.086025 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:13:57.087823 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:13:57.105206 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "4d848608-aa41-4631-82ab-11a5c16953bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.695s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:13:59.140119 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:01.072429 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:14:01.072790 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:14:01.072884 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:14:01.073104 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:14:01.073355 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:14:01.073661 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.05 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:14:01.124182 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:14:01.124581 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:14:01.563813 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "4d848608-aa41-4631-82ab-11a5c16953bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:01.564064 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "4d848608-aa41-4631-82ab-11a5c16953bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:01.564270 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:01.564427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:01.564541 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:01.567439 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Terminating instance
May 27 23:14:01.755974 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:02.072551 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:14:02.087498 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:02.088782 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:02.104692 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:02.106863 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:02.123805 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:14:02.124292 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:14:02.124292 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:14:02.124472 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:14:02.127452 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:02.224420 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0e32558b-1cfb-4a24-a55b-7e5a01332bda req-01968709-82f3-499a-9d76-d2960c89d3bf service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Received event network-vif-unplugged-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:02.225134 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0e32558b-1cfb-4a24-a55b-7e5a01332bda req-01968709-82f3-499a-9d76-d2960c89d3bf service nova] Acquiring lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:02.225134 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0e32558b-1cfb-4a24-a55b-7e5a01332bda req-01968709-82f3-499a-9d76-d2960c89d3bf service nova] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:02.225134 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0e32558b-1cfb-4a24-a55b-7e5a01332bda req-01968709-82f3-499a-9d76-d2960c89d3bf service nova] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:02.225134 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0e32558b-1cfb-4a24-a55b-7e5a01332bda req-01968709-82f3-499a-9d76-d2960c89d3bf service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] No waiting events found dispatching network-vif-unplugged-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:14:02.225271 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0e32558b-1cfb-4a24-a55b-7e5a01332bda req-01968709-82f3-499a-9d76-d2960c89d3bf service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Received event network-vif-unplugged-51b40f06-e533-4676-b332-7f93408a575d for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:14:02.388495 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999448361999839 future=<Future at 0x726e386c58b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:14:02.388833 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99900747699985 future=<Future at 0x726e386c58b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:14:02.388955 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998857903000044 future=<Future at 0x726e386c58b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:14:02.389565 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Instance destroyed successfully.
May 27 23:14:02.389995 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lazy-loading 'resources' on Instance uuid 4d848608-aa41-4631-82ab-11a5c16953bb {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:14:02.892319 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='instance-depend-image',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:13:56Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72ce6e9f639646e38a211e3e71ac9bbb',ramdisk_id='',reservation_id='r-hc0j7ipz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-932348261',owner_user_name='tempest-ImageDependencyTests-932348261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:13:56Z,user_data=None,user_id='c2cab84a3b4a4d29b3b73c43b289bc84',uuid=4d848608-aa41-4631-82ab-11a5c16953bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51b40f06-e533-4676-b332-7f93408a575d", "address": "fa:16:3e:a9:65:aa", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b40f06-e5", "ovs_interfaceid": "51b40f06-e533-4676-b332-7f93408a575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:14:02.892517 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Converting VIF {"id": "51b40f06-e533-4676-b332-7f93408a575d", "address": "fa:16:3e:a9:65:aa", "network": {"id": "166e81d7-a297-4896-8a7b-9c3719ebe876", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88ec7bd845e849dc889a362ec929a548", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b40f06-e5", "ovs_interfaceid": "51b40f06-e533-4676-b332-7f93408a575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:14:02.893024 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:65:aa,bridge_name='br-int',has_traffic_filtering=True,id=51b40f06-e533-4676-b332-7f93408a575d,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b40f06-e5') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:14:02.893234 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:65:aa,bridge_name='br-int',has_traffic_filtering=True,id=51b40f06-e533-4676-b332-7f93408a575d,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b40f06-e5') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:14:02.899173 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:02.899486 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51b40f06-e5, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:02.912180 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:02.913578 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:14:02.914138 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:02.914307 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d48b92f0-d78e-468b-9896-1e9b689591dc) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:02.915732 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:14:02.918349 np0000001565 nova-compute[98289]: INFO os_vif [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:65:aa,bridge_name='br-int',has_traffic_filtering=True,id=51b40f06-e533-4676-b332-7f93408a575d,network=Network(166e81d7-a297-4896-8a7b-9c3719ebe876),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b40f06-e5')
May 27 23:14:02.922190 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:14:02.922475 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '839474d9-cac5-46e0-9072-9d72b469bf74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:14:02.922600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:02.922925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:02.923196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '839474d9-cac5-46e0-9072-9d72b469bf74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:14:02.923319 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:14:02.946587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74 (non-flash)
May 27 23:14:02.946587 np0000001565 nova-compute[98289]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74 (non-flash)
May 27 23:14:02.946587 np0000001565 nova-compute[98289]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb229ff3-ab44-4534-9a22-032b08ac2839 (non-flash)
May 27 23:14:02.946587 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:02.946862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsi session list stdout=tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74 (non-flash)
May 27 23:14:02.946862 np0000001565 nova-compute[98289]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74 (non-flash)
May 27 23:14:02.946862 np0000001565 nova-compute[98289]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb229ff3-ab44-4534-9a22-032b08ac2839 (non-flash)
May 27 23:14:02.946862 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:02.946862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', '141'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb229ff3-ab44-4534-9a22-032b08ac2839', '143')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:14:02.947203 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', '141')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:14:02.947769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74', '142')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:14:02.948369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e60129a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:14:02.948610 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Removing multipathed devices sdc, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:14:02.948890 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Flush multipath device 330000000be38248c {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:14:02.978488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:14:03.021568 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:14:03.062752 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Checking to see if SCSI volumes sdc, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:14:03.062927 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] SCSI volumes sdc, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:14:03.063661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Checking to see if device paths {'sdc', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:14:03.074993 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Device paths {'sdc', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:14:03.075425 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:14:03.087580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:03.116191 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74, portal: 192.168.40.100,3260]
May 27 23:14:03.116191 np0000001565 nova-compute[98289]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74, portal: 192.168.40.100,3260] successful.
May 27 23:14:03.116191 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:03.128265 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:03.137922 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:03.172623 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74, portal: 192.168.50.100,3260]
May 27 23:14:03.172623 np0000001565 nova-compute[98289]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-839474d9-cac5-46e0-9072-9d72b469bf74, portal: 192.168.50.100,3260] successful.
May 27 23:14:03.172623 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:03.183417 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:03.183603 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:03.183713 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] <== disconnect_volume: return (261ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:14:03.183811 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:14:03.184057 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Deleting instance files /opt/stack/data/nova/instances/4d848608-aa41-4631-82ab-11a5c16953bb_del
May 27 23:14:03.184475 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Deletion of /opt/stack/data/nova/instances/4d848608-aa41-4631-82ab-11a5c16953bb_del complete
May 27 23:14:03.690579 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Took 1.62 seconds to destroy the instance on the hypervisor.
May 27 23:14:03.691272 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:14:03.691624 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:14:03.691979 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:14:03.692058 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:03.759425 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:04.016090 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-03a01b8e-ad8b-4cca-815b-ebca40946df4 req-75c98b9b-1371-4283-844b-14dcf3d716b5 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Received event network-vif-deleted-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:04.016501 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-03a01b8e-ad8b-4cca-815b-ebca40946df4 req-75c98b9b-1371-4283-844b-14dcf3d716b5 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Neutron deleted interface 51b40f06-e533-4676-b332-7f93408a575d; detaching it from the instance and deleting it from the info cache
May 27 23:14:04.018075 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-03a01b8e-ad8b-4cca-815b-ebca40946df4 req-75c98b9b-1371-4283-844b-14dcf3d716b5 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Detach interface failed, port_id=51b40f06-e533-4676-b332-7f93408a575d, reason: Instance 4d848608-aa41-4631-82ab-11a5c16953bb could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:14:04.151802 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:04.279053 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c1956c5c-a1b9-47a8-91e3-34c5649843c3 req-e89c6688-6015-471d-baa3-62cf127a6256 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Received event network-vif-unplugged-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:04.279194 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c1956c5c-a1b9-47a8-91e3-34c5649843c3 req-e89c6688-6015-471d-baa3-62cf127a6256 service nova] Acquiring lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:04.279662 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c1956c5c-a1b9-47a8-91e3-34c5649843c3 req-e89c6688-6015-471d-baa3-62cf127a6256 service nova] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:04.279662 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c1956c5c-a1b9-47a8-91e3-34c5649843c3 req-e89c6688-6015-471d-baa3-62cf127a6256 service nova] Lock "4d848608-aa41-4631-82ab-11a5c16953bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:04.279786 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c1956c5c-a1b9-47a8-91e3-34c5649843c3 req-e89c6688-6015-471d-baa3-62cf127a6256 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] No waiting events found dispatching network-vif-unplugged-51b40f06-e533-4676-b332-7f93408a575d {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:14:04.279923 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c1956c5c-a1b9-47a8-91e3-34c5649843c3 req-e89c6688-6015-471d-baa3-62cf127a6256 service nova] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Received event network-vif-unplugged-51b40f06-e533-4676-b332-7f93408a575d for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:14:04.475307 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:14:04.977284 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Took 1.29 seconds to deallocate network for instance.
May 27 23:14:05.517453 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Took 0.54 seconds to detach 1 volumes for instance.
May 27 23:14:05.519011 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Deleting volume: 839474d9-cac5-46e0-9072-9d72b469bf74 {{(pid=98289) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 23:14:06.053869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:06.054066 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:06.186808 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:14:06.186808 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:14:06.688291 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:14:07.195203 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.141s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:07.248068 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Deleted allocations for instance 4d848608-aa41-4631-82ab-11a5c16953bb
May 27 23:14:07.915978 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:08.257174 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5d862e85-7a95-415a-8f9e-c8c4c6e717ce tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Lock "4d848608-aa41-4631-82ab-11a5c16953bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.693s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:08.499371 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:08.749047 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:14:09.160548 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:10.657714 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:10.658081 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:11.160922 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lazy-loading 'flavor' on Instance uuid 1bf977e2-b498-4a2d-b7c2-8fc923e51751 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:14:11.663544 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Ignoring supplied device name: /dev/vdb
May 27 23:14:12.165829 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:12.917318 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:13.231005 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:13.231005 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:13.231005 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Attaching volume 2fb09c64-464b-4897-913c-9cc6d9180285 to /dev/vdb
May 27 23:14:13.265617 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:14:13.276125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:14:13.295952 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:14:13.342476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:14:13.342801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:14:13.351054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:14:13.351966 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:feaf:b886', 'fe80::3ca1:7dff:fece:9122'] 
May 27 23:14:13.352120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:14:13.352273 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:14:13.352556 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:14:13.352856 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Updating existing volume attachment record: 7f257266-5425-4d30-a2d4-913a3f93b557 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:14:13.903276 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:14:13.903670 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fb09c64-464b-4897-913c-9cc6d9180285', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:14:13.903876 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:13.904357 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:13.904614 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fb09c64-464b-4897-913c-9cc6d9180285', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:14:13.916081 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:13.916934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:13.917501 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:13.917857 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:14:13.919359 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:13.919359 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:14:13.930826 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:14:13.930826 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:13.932358 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:14:13.932358 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:13.942744 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285] added
May 27 23:14:13.942744 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:14:13.942744 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:13.942744 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:13.942744 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:13.942744 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:13.942744 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:13.943028 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:14:13.943181 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:14:13.943259 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:14:13.945597 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285] added
May 27 23:14:13.945597 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:14:13.945597 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:13.945597 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:13.945597 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:13.945597 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:13.945597 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:13.945961 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:14:13.945961 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:14:13.945961 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:14:14.173119 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:14.943860 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:14:14.946418 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:14:14.956360 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:14:14.956360 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:14:14.961733 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:14:14.961733 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:14.966871 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:14.972140 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:14.977230 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:14.977230 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:14.977437 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:14.977437 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:14.982773 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:14.982773 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:14.982904 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:14.982904 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:15.006666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, portal: 192.168.40.100,3260]
May 27 23:14:15.006666 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, portal: 192.168.40.100,3260] successful.
May 27 23:14:15.006666 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:15.017064 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:15.027227 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:15.027227 np0000001565 nova-compute[98289]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:15.027227 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:15.027358 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:15.027358 np0000001565 nova-compute[98289]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:15.027358 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:15.027616 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.110s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:15.027755 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:14:15.028352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] HCTL ('8', '-', '-', 0) found on session 145 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:14:15.028465 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:14:15.041402 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Searching for a device in session 145 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:14:15.041402 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fb09c64-464b-4897-913c-9cc6d9180285', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:14:16.029894 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, portal: 192.168.50.100,3260]
May 27 23:14:16.029894 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, portal: 192.168.50.100,3260] successful.
May 27 23:14:16.029894 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:16.040358 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:16.052455 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:16.052455 np0000001565 nova-compute[98289]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:16.052455 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:16.052455 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:16.052595 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:16.052595 np0000001565 nova-compute[98289]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:16.052595 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:16.052595 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:16.052873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.135s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:16.053018 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:14:16.053634 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] HCTL ('9', '-', '-', 0) found on session 146 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:14:16.053769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:14:16.067661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Searching for a device in session 146 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:14:16.067661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2fb09c64-464b-4897-913c-9cc6d9180285', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:14:16.939147 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:14:17.388289 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004281760002413648 future=<Future at 0x726e386c58b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:14:17.389108 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Emitting event <LifecycleEvent: 1779923642.387727, 4d848608-aa41-4631-82ab-11a5c16953bb => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:14:17.389418 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:14:17.389584 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] VM Stopped (Lifecycle Event)
May 27 23:14:17.892703 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b884a629-02c6-47a3-8aa9-b1d5321799d2 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: 4d848608-aa41-4631-82ab-11a5c16953bb] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:14:17.933103 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:17.955973 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445799119 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:14:17.956312 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.052s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:17.956559 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] <== connect_volume: return (4052ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799119', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799119'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:14:17.956753 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799119', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799119'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:14:17.959774 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lazy-loading 'flavor' on Instance uuid 1bf977e2-b498-4a2d-b7c2-8fc923e51751 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:14:18.462767 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Attempting to attach volume 2fb09c64-464b-4897-913c-9cc6d9180285 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:14:18.464054 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:14:18.464054 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:14:18.464054 np0000001565 nova-compute[98289]:   <alias name="ua-2fb09c64-464b-4897-913c-9cc6d9180285"/>
May 27 23:14:18.464054 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:14:18.464054 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:14:18.464054 np0000001565 nova-compute[98289]:   <serial>2fb09c64-464b-4897-913c-9cc6d9180285</serial>
May 27 23:14:18.464054 np0000001565 nova-compute[98289]: </disk>
May 27 23:14:18.464054 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:14:20.105450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:14:20.105450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:14:20.105450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:14:20.105450 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No VIF found with MAC fa:16:3e:af:b8:86, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:14:21.654998 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9d49a43d-61c8-4a43-b37b-a9827da1f21f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.424s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:22.314239 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:22.314500 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:22.818908 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:14:22.935662 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:23.384131 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:23.384360 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:23.387111 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:14:23.387260 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Claim successful on node np0000001565
May 27 23:14:24.555369 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:14:24.555717 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:14:25.061205 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:14:25.569964 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.185s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:25.570465 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:14:25.766251 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:26.076887 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:14:26.077591 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:14:26.077591 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:26.077751 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:26.178530 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '578b34c690f94b1d97fff5e034cb8516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e604a1a983b14e5aa26d1b8254daf8ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:14:26.588506 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:14:26.710942 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Successfully created port: be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:14:27.101962 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:14:27.303084 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Successfully updated port: be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:14:27.353139 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ba143784-2baf-47f0-a585-b07ff701314c req-e4196926-e6ef-44be-9125-b1e912e68eec service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-changed-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:27.354398 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ba143784-2baf-47f0-a585-b07ff701314c req-e4196926-e6ef-44be-9125-b1e912e68eec service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Refreshing instance network info cache due to event network-changed-be104f4e-591b-4263-8213-45d1816bfb89. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:14:27.354614 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ba143784-2baf-47f0-a585-b07ff701314c req-e4196926-e6ef-44be-9125-b1e912e68eec service nova] Acquiring lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:14:27.354743 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ba143784-2baf-47f0-a585-b07ff701314c req-e4196926-e6ef-44be-9125-b1e912e68eec service nova] Acquired lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:14:27.354894 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ba143784-2baf-47f0-a585-b07ff701314c req-e4196926-e6ef-44be-9125-b1e912e68eec service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Refreshing network info cache for port be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:14:27.426083 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:27.606564 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Booting with volume 3ce600b6-7d98-4f84-b112-f8cddb65274a at /dev/vda
May 27 23:14:27.650445 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:14:27.659654 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:14:27.684084 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:14:27.734424 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:14:27.734869 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:14:27.743902 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:14:27.745161 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:feaf:b886', 'fe80::3ca1:7dff:fece:9122'] 
May 27 23:14:27.745367 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:14:27.745529 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:14:27.745846 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:14:27.746140 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updating existing volume attachment record: e7c301ad-133a-4293-9532-44ee0501abff {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:14:27.807232 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:14:27.862887 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-ba143784-2baf-47f0-a585-b07ff701314c req-e4196926-e6ef-44be-9125-b1e912e68eec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:27.938769 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:27.954256 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ba143784-2baf-47f0-a585-b07ff701314c req-e4196926-e6ef-44be-9125-b1e912e68eec service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:14:28.113663 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ba143784-2baf-47f0-a585-b07ff701314c req-e4196926-e6ef-44be-9125-b1e912e68eec service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:14:28.618669 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ba143784-2baf-47f0-a585-b07ff701314c req-e4196926-e6ef-44be-9125-b1e912e68eec service nova] Releasing lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:14:28.619549 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquired lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:14:28.619758 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:14:29.182160 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:14:29.183915 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:29.328164 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:29.453909 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updating instance_info_cache with network_info: [{"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:14:29.839285 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:14:29.840669 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:14:29.840669 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Creating image(s)
May 27 23:14:29.840669 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:14:29.840669 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Ensure instance console log exists: /opt/stack/data/nova/instances/d15d35fb-589c-4ea2-8c94-9588bc66bec3/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:14:29.842070 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:29.842070 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:29.842070 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:29.947344 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:29.955475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Releasing lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:14:29.955811 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Instance network_info: |[{"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:14:29.956612 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Start _get_guest_xml network_info=[{"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e7c301ad-133a-4293-9532-44ee0501abff', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ce600b6-7d98-4f84-b112-f8cddb65274a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd15d35fb-589c-4ea2-8c94-9588bc66bec3', 'attached_at': '', 'detached_at': '', 'volume_id': '3ce600b6-7d98-4f84-b112-f8cddb65274a', 'serial': '3ce600b6-7d98-4f84-b112-f8cddb65274a'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:14:29.960733 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:14:29.961815 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-1236715997', uuid='d15d35fb-589c-4ea2-8c94-9588bc66bec3'), owner=OwnerMeta(userid='578b34c690f94b1d97fff5e034cb8516', username='tempest-TestVolumeBackupRestore-1486634334-project-member', projectid='e604a1a983b14e5aa26d1b8254daf8ce', projectname='tempest-TestVolumeBackupRestore-1486634334'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923669.9614773) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:14:29.962810 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:14:29.963144 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:14:29.964011 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:14:29.964196 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:14:29.965032 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:14:29.965308 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:14:29.965473 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:14:29.965569 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:14:29.965688 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:14:29.965771 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:14:29.965861 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:14:29.966011 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:14:29.966118 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:14:29.966223 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:14:29.966318 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:14:29.966442 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:14:29.977487 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:14:29.977779 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ce600b6-7d98-4f84-b112-f8cddb65274a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:14:29.977907 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:29.978223 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:29.978408 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ce600b6-7d98-4f84-b112-f8cddb65274a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:14:29.991039 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:29.991783 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:29.992247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:29.992470 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:14:29.992825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:29.993021 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:14:30.005689 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:14:30.005689 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:30.011055 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:14:30.011055 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:30.017928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a] added
May 27 23:14:30.017928 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:14:30.017928 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:30.017928 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:30.017928 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:30.017928 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:30.017928 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:30.018086 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:14:30.018310 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:14:30.018489 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:14:30.023802 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a] added
May 27 23:14:30.023802 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:14:30.023802 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:30.023802 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:30.023802 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:30.023802 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:30.023802 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:30.023993 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:14:30.024118 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:14:30.024266 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:14:31.018890 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:14:31.025239 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:14:31.033857 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:14:31.033857 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:14:31.042454 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:14:31.042454 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:31.047869 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:31.056033 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:31.067585 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.067585 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.067585 np0000001565 nova-compute[98289]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:31.067585 np0000001565 nova-compute[98289]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df7183c4-5956-4170-a9fc-9ed58976cba2 (non-flash)
May 27 23:14:31.067585 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:31.067747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.067747 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.067747 np0000001565 nova-compute[98289]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:31.067747 np0000001565 nova-compute[98289]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df7183c4-5956-4170-a9fc-9ed58976cba2 (non-flash)
May 27 23:14:31.067747 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:31.085405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.085405 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.085405 np0000001565 nova-compute[98289]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:31.085405 np0000001565 nova-compute[98289]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df7183c4-5956-4170-a9fc-9ed58976cba2 (non-flash)
May 27 23:14:31.085405 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:31.085607 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.085607 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.085607 np0000001565 nova-compute[98289]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:31.085607 np0000001565 nova-compute[98289]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df7183c4-5956-4170-a9fc-9ed58976cba2 (non-flash)
May 27 23:14:31.085607 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:31.119967 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a, portal: 192.168.50.100,3260]
May 27 23:14:31.119967 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a, portal: 192.168.50.100,3260] successful.
May 27 23:14:31.119967 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:31.132297 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:31.141888 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a, portal: 192.168.40.100,3260]
May 27 23:14:31.141888 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a, portal: 192.168.40.100,3260] successful.
May 27 23:14:31.141888 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:31.152077 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.152077 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.152077 np0000001565 nova-compute[98289]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:31.152077 np0000001565 nova-compute[98289]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df7183c4-5956-4170-a9fc-9ed58976cba2 (non-flash)
May 27 23:14:31.152077 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:31.152077 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:31.152077 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:31.152268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.152268 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.152268 np0000001565 nova-compute[98289]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:31.152268 np0000001565 nova-compute[98289]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df7183c4-5956-4170-a9fc-9ed58976cba2 (non-flash)
May 27 23:14:31.152268 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:31.152268 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:31.152268 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:31.152658 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:31.153025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:14:31.153773 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] HCTL ('11', '-', '-', 0) found on session 149 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:14:31.154026 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:14:31.154632 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:31.173622 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.173622 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.173622 np0000001565 nova-compute[98289]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:31.173622 np0000001565 nova-compute[98289]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df7183c4-5956-4170-a9fc-9ed58976cba2 (non-flash)
May 27 23:14:31.173622 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:31.173622 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:31.173622 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:31.173865 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.173865 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:31.173865 np0000001565 nova-compute[98289]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:31.173865 np0000001565 nova-compute[98289]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df7183c4-5956-4170-a9fc-9ed58976cba2 (non-flash)
May 27 23:14:31.173865 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:31.173865 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:31.173865 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:31.173989 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:31.174508 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:14:31.175021 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] HCTL ('12', '-', '-', 0) found on session 150 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:14:31.175518 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:14:31.181922 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Searching for a device in session 149 and hctl ['11', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:14:31.197521 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Searching for a device in session 150 and hctl ['12', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:14:31.928802 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:32.185349 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Searching for a device in session 149 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:14:32.185349 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3ce600b6-7d98-4f84-b112-f8cddb65274a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:14:32.197064 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Searching for a device in session 150 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:14:32.197231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ce600b6-7d98-4f84-b112-f8cddb65274a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:14:32.954539 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:32.993305 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:14:34.008617 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Found WWN 330000000d5f30136 for multipath device dm-1 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:14:34.009049 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.031s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:34.009200 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] <== connect_volume: return (4031ms) {'type': 'block', 'scsi_wwn': '330000000d5f30136', 'path': '/dev/dm-1', 'multipath_id': '330000000d5f30136'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:14:34.009384 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d5f30136', 'path': '/dev/dm-1', 'multipath_id': '330000000d5f30136'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:14:34.198370 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:34.515723 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1236715997',display_name='tempest-TestVolumeBackupRestore-server-1236715997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebackuprestore-server-1236715997',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETRdVOOToPsp606JUnN4+xuv1pmatOz/RydjPWOqpr/uH6588lVpzWKEZYw/FgzdkeKJDsYEItTvtaLpgrovM+Y6t40uEd9QXKl5hA0JVS0adkX0VZ9tWBj1R0LjtiDAQ==',key_name='tempest-TestVolumeBackupRestore-1717454730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e604a1a983b14e5aa26d1b8254daf8ce',ramdisk_id='',reservation_id='r-dfbfysii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1486634334',owner_user_name='tempest-TestVolumeBackupRestore-1486634334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:14:27Z,user_data=None,user_id='578b34c690f94b1d97fff5e034cb8516',uuid=d15d35fb-589c-4ea2-8c94-9588bc66bec3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:14:34.516020 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Converting VIF {"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:14:34.516814 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d6:13,bridge_name='br-int',has_traffic_filtering=True,id=be104f4e-591b-4263-8213-45d1816bfb89,network=Network(866a0c99-2e27-43cb-b675-2084b7ab3f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe104f4e-59') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:14:34.517731 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lazy-loading 'pci_devices' on Instance uuid d15d35fb-589c-4ea2-8c94-9588bc66bec3 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:14:34.718417 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:34.718586 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:35.021261 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] End _get_guest_xml xml=<domain type="qemu">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <uuid>d15d35fb-589c-4ea2-8c94-9588bc66bec3</uuid>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <name>instance-0000003b</name>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBackupRestore-server-1236715997</nova:name>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:14:29</nova:creationTime>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:user uuid="578b34c690f94b1d97fff5e034cb8516">tempest-TestVolumeBackupRestore-1486634334-project-member</nova:user>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:project uuid="e604a1a983b14e5aa26d1b8254daf8ce">tempest-TestVolumeBackupRestore-1486634334</nova:project>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         <nova:port uuid="be104f4e-591b-4263-8213-45d1816bfb89">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <system>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <entry name="serial">d15d35fb-589c-4ea2-8c94-9588bc66bec3</entry>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <entry name="uuid">d15d35fb-589c-4ea2-8c94-9588bc66bec3</entry>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     </system>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <os>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   </os>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <features>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   </features>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   <devices>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/d15d35fb-589c-4ea2-8c94-9588bc66bec3/disk.config"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     </disk>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <alias name="ua-3ce600b6-7d98-4f84-b112-f8cddb65274a"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-1"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <serial>3ce600b6-7d98-4f84-b112-f8cddb65274a</serial>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     </disk>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:69:d6:13"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <target dev="tapbe104f4e-59"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     </interface>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/d15d35fb-589c-4ea2-8c94-9588bc66bec3/console.log" append="off"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     </serial>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <video>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     </video>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     </rng>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:   </devices>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]: </domain>
May 27 23:14:35.021261 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:14:35.023460 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Preparing to wait for external event network-vif-plugged-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:14:35.023460 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:35.023460 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:35.023460 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:35.023460 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1236715997',display_name='tempest-TestVolumeBackupRestore-server-1236715997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebackuprestore-server-1236715997',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETRdVOOToPsp606JUnN4+xuv1pmatOz/RydjPWOqpr/uH6588lVpzWKEZYw/FgzdkeKJDsYEItTvtaLpgrovM+Y6t40uEd9QXKl5hA0JVS0adkX0VZ9tWBj1R0LjtiDAQ==',key_name='tempest-TestVolumeBackupRestore-1717454730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e604a1a983b14e5aa26d1b8254daf8ce',ramdisk_id='',reservation_id='r-dfbfysii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1486634334',owner_user_name='tempest-TestVolumeBackupRestore-1486634334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:14:27Z,user_data=None,user_id='578b34c690f94b1d97fff5e034cb8516',uuid=d15d35fb-589c-4ea2-8c94-9588bc66bec3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:14:35.023460 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Converting VIF {"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:14:35.023460 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d6:13,bridge_name='br-int',has_traffic_filtering=True,id=be104f4e-591b-4263-8213-45d1816bfb89,network=Network(866a0c99-2e27-43cb-b675-2084b7ab3f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe104f4e-59') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:14:35.023460 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d6:13,bridge_name='br-int',has_traffic_filtering=True,id=be104f4e-591b-4263-8213-45d1816bfb89,network=Network(866a0c99-2e27-43cb-b675-2084b7ab3f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe104f4e-59') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:14:35.023785 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:35.024227 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:35.024598 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:14:35.025238 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:35.025467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23065456-6730-56eb-9989-3bff1cfed2e1', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:35.026289 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:35.027309 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:14:35.029106 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:35.029297 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe104f4e-59, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:35.029690 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe104f4e-59, col_values=(('qos', UUID('5709594a-3a73-466e-afde-0a23d6d0cd81')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:35.029949 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe104f4e-59, col_values=(('external_ids', {'iface-id': 'be104f4e-591b-4263-8213-45d1816bfb89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:d6:13', 'vm-uuid': 'd15d35fb-589c-4ea2-8c94-9588bc66bec3'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:35.030728 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:35.032273 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:14:35.035870 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:35.036802 np0000001565 nova-compute[98289]: INFO os_vif [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d6:13,bridge_name='br-int',has_traffic_filtering=True,id=be104f4e-591b-4263-8213-45d1816bfb89,network=Network(866a0c99-2e27-43cb-b675-2084b7ab3f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe104f4e-59')
May 27 23:14:35.220167 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:14:35.766978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:35.767177 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:35.770018 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:14:35.770201 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Claim successful on node np0000001565
May 27 23:14:36.551257 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:14:36.551763 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:14:36.551763 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] No VIF found with MAC fa:16:3e:69:d6:13, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:14:36.552089 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Using config drive
May 27 23:14:36.960908 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:14:36.961043 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:14:37.058026 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:37.163485 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Creating config drive at /opt/stack/data/nova/instances/d15d35fb-589c-4ea2-8c94-9588bc66bec3/disk.config
May 27 23:14:37.166685 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d15d35fb-589c-4ea2-8c94-9588bc66bec3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzljhn5ui {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:14:37.220806 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d15d35fb-589c-4ea2-8c94-9588bc66bec3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzljhn5ui" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:14:37.464226 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:14:37.590770 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:37.610368 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:37.699105 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:37.730012 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2afb9f63-117b-4f8c-ac47-1640492b80b5 req-c997011d-0220-40fb-a417-4928324d71e7 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-vif-plugged-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:37.730253 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2afb9f63-117b-4f8c-ac47-1640492b80b5 req-c997011d-0220-40fb-a417-4928324d71e7 service nova] Acquiring lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:37.730457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2afb9f63-117b-4f8c-ac47-1640492b80b5 req-c997011d-0220-40fb-a417-4928324d71e7 service nova] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:37.730589 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2afb9f63-117b-4f8c-ac47-1640492b80b5 req-c997011d-0220-40fb-a417-4928324d71e7 service nova] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:37.730905 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2afb9f63-117b-4f8c-ac47-1640492b80b5 req-c997011d-0220-40fb-a417-4928324d71e7 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Processing event network-vif-plugged-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:14:37.909850 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:37.911783 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:37.917257 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:37.917898 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:37.938006 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:37.972014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.205s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:37.972450 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:14:38.307400 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923678.306962, d15d35fb-589c-4ea2-8c94-9588bc66bec3 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:14:38.307930 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:14:38.308127 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] VM Started (Lifecycle Event)
May 27 23:14:38.310233 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:14:38.312929 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Instance spawned successfully.
May 27 23:14:38.313196 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:14:38.478647 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:14:38.478854 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:14:38.479207 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:38.479456 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:38.545974 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31823a44e786429f80ba607958f8b63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda425dab8946dc926808806eeedced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:14:38.811401 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:14:38.813897 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:14:38.821189 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:38.821189 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:38.821618 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:38.821797 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:38.822088 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:38.822320 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:38.912197 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Successfully created port: 224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:14:38.982081 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:14:39.199952 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:39.319513 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:14:39.319513 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923679.3181057, d15d35fb-589c-4ea2-8c94-9588bc66bec3 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:14:39.319513 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] VM Paused (Lifecycle Event)
May 27 23:14:39.327865 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Took 9.49 seconds to spawn the instance on the hypervisor.
May 27 23:14:39.328008 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:14:39.374485 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Successfully updated port: 224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:14:39.418380 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e5f39a3c-b31d-47fc-aa36-a2a60e417d86 req-fd54dd07-7875-470d-81f7-4e3fac5b2af9 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Received event network-changed-224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:39.418542 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e5f39a3c-b31d-47fc-aa36-a2a60e417d86 req-fd54dd07-7875-470d-81f7-4e3fac5b2af9 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Refreshing instance network info cache due to event network-changed-224b1210-d83c-490f-8ad2-46b304372cab. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:14:39.418702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e5f39a3c-b31d-47fc-aa36-a2a60e417d86 req-fd54dd07-7875-470d-81f7-4e3fac5b2af9 service nova] Acquiring lock "refresh_cache-f6dba5cc-9c32-4fd8-8035-789d3e310cbf" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:14:39.418798 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e5f39a3c-b31d-47fc-aa36-a2a60e417d86 req-fd54dd07-7875-470d-81f7-4e3fac5b2af9 service nova] Acquired lock "refresh_cache-f6dba5cc-9c32-4fd8-8035-789d3e310cbf" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:14:39.418907 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e5f39a3c-b31d-47fc-aa36-a2a60e417d86 req-fd54dd07-7875-470d-81f7-4e3fac5b2af9 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Refreshing network info cache for port 224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:14:39.485319 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:14:39.786170 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fb82b67e-8507-4a7f-9de5-d82aa9002a60 req-9fb3cd0e-0819-421a-96e2-b147764e5f04 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-vif-plugged-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:39.786170 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fb82b67e-8507-4a7f-9de5-d82aa9002a60 req-9fb3cd0e-0819-421a-96e2-b147764e5f04 service nova] Acquiring lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:39.786372 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fb82b67e-8507-4a7f-9de5-d82aa9002a60 req-9fb3cd0e-0819-421a-96e2-b147764e5f04 service nova] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:39.786594 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fb82b67e-8507-4a7f-9de5-d82aa9002a60 req-9fb3cd0e-0819-421a-96e2-b147764e5f04 service nova] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:39.786762 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fb82b67e-8507-4a7f-9de5-d82aa9002a60 req-9fb3cd0e-0819-421a-96e2-b147764e5f04 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] No waiting events found dispatching network-vif-plugged-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:14:39.786932 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-fb82b67e-8507-4a7f-9de5-d82aa9002a60 req-9fb3cd0e-0819-421a-96e2-b147764e5f04 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received unexpected event network-vif-plugged-be104f4e-591b-4263-8213-45d1816bfb89 for instance with vm_state active and task_state None.
May 27 23:14:39.822269 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:14:39.825983 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923679.8256974, d15d35fb-589c-4ea2-8c94-9588bc66bec3 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:14:39.826270 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] VM Resumed (Lifecycle Event)
May 27 23:14:39.838056 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Took 16.51 seconds to build instance.
May 27 23:14:39.876611 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "refresh_cache-f6dba5cc-9c32-4fd8-8035-789d3e310cbf" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:14:39.921582 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-e5f39a3c-b31d-47fc-aa36-a2a60e417d86 req-fd54dd07-7875-470d-81f7-4e3fac5b2af9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:39.990159 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Booting with volume 37fda03b-5050-4703-a86b-96a8bd62aca0 at /dev/vda
May 27 23:14:40.026824 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:14:40.031766 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:40.040497 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:14:40.064574 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e5f39a3c-b31d-47fc-aa36-a2a60e417d86 req-fd54dd07-7875-470d-81f7-4e3fac5b2af9 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:14:40.066496 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:14:40.121180 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:14:40.123013 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:14:40.130983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:14:40.132226 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:feaf:b886', 'fe80::3ca1:7dff:fece:9122', 'fe80::fc16:3eff:fe69:d613', 'fe80::4082:1cff:fe27:e0'] 
May 27 23:14:40.132414 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:14:40.132518 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:14:40.132754 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:14:40.132947 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Updating existing volume attachment record: 0e45ae6d-5821-42bb-a595-af44a9ebd449 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:14:40.225701 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e5f39a3c-b31d-47fc-aa36-a2a60e417d86 req-fd54dd07-7875-470d-81f7-4e3fac5b2af9 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:14:40.328492 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:14:40.331560 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:14:40.339712 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-22630b08-9a08-49e1-be92-ee179659238e tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.025s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:40.727789 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e5f39a3c-b31d-47fc-aa36-a2a60e417d86 req-fd54dd07-7875-470d-81f7-4e3fac5b2af9 service nova] Releasing lock "refresh_cache-f6dba5cc-9c32-4fd8-8035-789d3e310cbf" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:14:40.728228 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquired lock "refresh_cache-f6dba5cc-9c32-4fd8-8035-789d3e310cbf" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:14:40.728390 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:14:41.288960 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:14:41.453981 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:41.584939 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Updating instance_info_cache with network_info: [{"id": "224b1210-d83c-490f-8ad2-46b304372cab", "address": "fa:16:3e:67:01:b3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap224b1210-d8", "ovs_interfaceid": "224b1210-d83c-490f-8ad2-46b304372cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:14:42.087319 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Releasing lock "refresh_cache-f6dba5cc-9c32-4fd8-8035-789d3e310cbf" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:14:42.087797 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Instance network_info: |[{"id": "224b1210-d83c-490f-8ad2-46b304372cab", "address": "fa:16:3e:67:01:b3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap224b1210-d8", "ovs_interfaceid": "224b1210-d83c-490f-8ad2-46b304372cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:14:42.204111 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b398a24b-c26c-4a54-abe7-e6e9154b8b7a req-256bd7d9-bf81-4b41-96a1-5a818776a621 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-changed-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:42.204286 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b398a24b-c26c-4a54-abe7-e6e9154b8b7a req-256bd7d9-bf81-4b41-96a1-5a818776a621 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Refreshing instance network info cache due to event network-changed-be104f4e-591b-4263-8213-45d1816bfb89. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:14:42.204519 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b398a24b-c26c-4a54-abe7-e6e9154b8b7a req-256bd7d9-bf81-4b41-96a1-5a818776a621 service nova] Acquiring lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:14:42.204639 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b398a24b-c26c-4a54-abe7-e6e9154b8b7a req-256bd7d9-bf81-4b41-96a1-5a818776a621 service nova] Acquired lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:14:42.204754 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b398a24b-c26c-4a54-abe7-e6e9154b8b7a req-256bd7d9-bf81-4b41-96a1-5a818776a621 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Refreshing network info cache for port be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:14:42.248070 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:14:42.249223 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:14:42.249590 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Creating image(s)
May 27 23:14:42.249910 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:14:42.250058 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Ensure instance console log exists: /opt/stack/data/nova/instances/f6dba5cc-9c32-4fd8-8035-789d3e310cbf/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:14:42.250529 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:42.250747 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:42.250924 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:42.251432 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Start _get_guest_xml network_info=[{"id": "224b1210-d83c-490f-8ad2-46b304372cab", "address": "fa:16:3e:67:01:b3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap224b1210-d8", "ovs_interfaceid": "224b1210-d83c-490f-8ad2-46b304372cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0e45ae6d-5821-42bb-a595-af44a9ebd449', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f6dba5cc-9c32-4fd8-8035-789d3e310cbf', 'attached_at': '', 'detached_at': '', 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'serial': '37fda03b-5050-4703-a86b-96a8bd62aca0'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:14:42.257225 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:14:42.258527 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1829715288', uuid='f6dba5cc-9c32-4fd8-8035-789d3e310cbf'), owner=OwnerMeta(userid='31823a44e786429f80ba607958f8b63e', username='tempest-TestVolumeBootPattern-314561297-project-member', projectid='5dda425dab8946dc926808806eeedced', projectname='tempest-TestVolumeBootPattern-314561297'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "224b1210-d83c-490f-8ad2-46b304372cab", "address": "fa:16:3e:67:01:b3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap224b1210-d8", "ovs_interfaceid": "224b1210-d83c-490f-8ad2-46b304372cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923682.2581403) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:14:42.259820 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:14:42.261109 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:14:42.262062 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:14:42.262285 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:14:42.263889 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:14:42.264200 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:14:42.264421 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:14:42.264567 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:14:42.264765 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:14:42.264900 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:14:42.265055 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:14:42.265278 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:14:42.265683 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:14:42.265855 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:14:42.266024 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:14:42.266196 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:14:42.277701 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:14:42.278034 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:14:42.278231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:42.278674 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:42.278934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:14:42.292204 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:42.294187 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:42.294480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:42.294725 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:14:42.296002 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:42.296176 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:14:42.309322 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:14:42.309322 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:42.310995 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:14:42.310995 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:42.321367 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0] added
May 27 23:14:42.321367 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:14:42.321367 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:42.321367 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:42.321367 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:42.321367 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:42.321367 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:42.321628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:14:42.321777 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:14:42.321962 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:14:42.333441 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0] added
May 27 23:14:42.333441 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:14:42.333441 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:42.333441 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:42.333441 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:14:42.333441 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:14:42.333441 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:42.333792 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:14:42.333837 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:14:42.334005 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:14:42.706917 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-b398a24b-c26c-4a54-abe7-e6e9154b8b7a req-256bd7d9-bf81-4b41-96a1-5a818776a621 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:42.749917 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:42.750150 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:43.006826 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-b398a24b-c26c-4a54-abe7-e6e9154b8b7a req-256bd7d9-bf81-4b41-96a1-5a818776a621 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:43.167256 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b398a24b-c26c-4a54-abe7-e6e9154b8b7a req-256bd7d9-bf81-4b41-96a1-5a818776a621 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updated VIF entry in instance network info cache for port be104f4e-591b-4263-8213-45d1816bfb89. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:14:43.167705 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b398a24b-c26c-4a54-abe7-e6e9154b8b7a req-256bd7d9-bf81-4b41-96a1-5a818776a621 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updating instance_info_cache with network_info: [{"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:14:43.252999 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Detaching volume 2fb09c64-464b-4897-913c-9cc6d9180285
May 27 23:14:43.297080 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Attempting to driver detach volume 2fb09c64-464b-4897-913c-9cc6d9180285 from mountpoint /dev/vdb
May 27 23:14:43.306430 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Found disk vdb by alias ua-2fb09c64-464b-4897-913c-9cc6d9180285 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:14:43.307707 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Found disk vdb by alias ua-2fb09c64-464b-4897-913c-9cc6d9180285 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:14:43.307855 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Attempting to detach device vdb from instance 1bf977e2-b498-4a2d-b7c2-8fc923e51751 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:14:43.308121 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:14:43.308121 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:14:43.308121 np0000001565 nova-compute[98289]:   <alias name="ua-2fb09c64-464b-4897-913c-9cc6d9180285"/>
May 27 23:14:43.308121 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:14:43.308121 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:14:43.308121 np0000001565 nova-compute[98289]:   <serial>2fb09c64-464b-4897-913c-9cc6d9180285</serial>
May 27 23:14:43.308121 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:14:43.308121 np0000001565 nova-compute[98289]: </disk>
May 27 23:14:43.308121 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:14:43.314817 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Successfully detached device vdb from instance 1bf977e2-b498-4a2d-b7c2-8fc923e51751 from the persistent domain config.
May 27 23:14:43.314932 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] (1/8): Attempting to detach device vdb with device alias ua-2fb09c64-464b-4897-913c-9cc6d9180285 from instance 1bf977e2-b498-4a2d-b7c2-8fc923e51751 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:14:43.315180 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:14:43.315180 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:14:43.315180 np0000001565 nova-compute[98289]:   <alias name="ua-2fb09c64-464b-4897-913c-9cc6d9180285"/>
May 27 23:14:43.315180 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:14:43.315180 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:14:43.315180 np0000001565 nova-compute[98289]:   <serial>2fb09c64-464b-4897-913c-9cc6d9180285</serial>
May 27 23:14:43.315180 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:14:43.315180 np0000001565 nova-compute[98289]: </disk>
May 27 23:14:43.315180 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:14:43.322456 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:14:43.334357 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:14:43.342009 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:14:43.342009 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:14:43.360577 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:14:43.360577 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:43.375618 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:43.390355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.390355 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.390355 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.390355 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.390355 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:43.390355 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:43.390355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.390355 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.390355 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.390355 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.390355 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:43.390355 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:43.397522 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:43.417802 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.417802 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.417802 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.417802 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.417802 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:43.417802 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:43.418040 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.418040 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.418040 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.418040 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.418040 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:43.418040 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:43.433756 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0, portal: 192.168.50.100,3260]
May 27 23:14:43.433756 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0, portal: 192.168.50.100,3260] successful.
May 27 23:14:43.433756 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:43.446821 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:43.460768 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0, portal: 192.168.40.100,3260]
May 27 23:14:43.460768 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0, portal: 192.168.40.100,3260] successful.
May 27 23:14:43.460768 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:43.461485 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.461485 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.461485 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.461485 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.461485 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:43.461485 np0000001565 nova-compute[98289]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:43.461485 np0000001565 nova-compute[98289]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:43.461485 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:43.461693 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.461693 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.461693 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.461693 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.461693 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:43.461693 np0000001565 nova-compute[98289]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:43.461693 np0000001565 nova-compute[98289]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:43.461693 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:43.461983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:43.462114 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:14:43.463320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('10', '-', '-', 0) found on session 152 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:14:43.463516 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:14:43.475193 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:43.483915 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 152 and hctl ['10', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:14:43.494062 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.494062 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.494062 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.494062 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.494062 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:43.494062 np0000001565 nova-compute[98289]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:43.494062 np0000001565 nova-compute[98289]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:43.494062 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:43.494282 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.494282 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:43.494282 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.494282 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:43.494282 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:43.494282 np0000001565 nova-compute[98289]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:43.494282 np0000001565 nova-compute[98289]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:43.494282 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:43.494584 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:43.494736 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:14:43.495623 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('13', '-', '-', 0) found on session 153 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:14:43.495758 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:14:43.507742 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 153 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:14:43.507838 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:14:43.669887 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b398a24b-c26c-4a54-abe7-e6e9154b8b7a req-256bd7d9-bf81-4b41-96a1-5a818776a621 service nova] Releasing lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:14:43.823242 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923683.822871, 1bf977e2-b498-4a2d-b7c2-8fc923e51751 => ua-2fb09c64-464b-4897-913c-9cc6d9180285> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:14:43.826245 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2fb09c64-464b-4897-913c-9cc6d9180285 for instance 1bf977e2-b498-4a2d-b7c2-8fc923e51751 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:14:43.828503 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Successfully detached device vdb from instance 1bf977e2-b498-4a2d-b7c2-8fc923e51751 from the live domain config.
May 27 23:14:43.829526 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:14:43.829825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fb09c64-464b-4897-913c-9cc6d9180285', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:14:43.829984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:44.201771 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:44.274399 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-changed-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:44.274575 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Refreshing instance network info cache due to event network-changed-be104f4e-591b-4263-8213-45d1816bfb89. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:14:44.275082 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] Acquiring lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:14:44.275212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] Acquired lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:14:44.275379 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Refreshing network info cache for port be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:14:44.484633 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 152 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:14:44.485159 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:14:44.778665 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:45.032773 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:45.070058 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:45.190007 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updated VIF entry in instance network info cache for port be104f4e-591b-4263-8213-45d1816bfb89. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:14:45.190258 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updating instance_info_cache with network_info: [{"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:14:45.309119 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Found WWN 33000000026011b85 for multipath device dm-4 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:14:45.309359 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:45.309754 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.480s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:45.310075 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fb09c64-464b-4897-913c-9cc6d9180285', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:14:45.310206 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:14:45.310596 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '33000000026011b85', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '33000000026011b85'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:14:45.310710 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000026011b85', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '33000000026011b85'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:14:45.341217 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:45.341217 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:45.341217 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:45.341217 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:45.341217 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:45.341217 np0000001565 nova-compute[98289]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:45.341217 np0000001565 nova-compute[98289]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:45.341217 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:45.341495 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:45.341495 np0000001565 nova-compute[98289]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285 (non-flash)
May 27 23:14:45.341495 np0000001565 nova-compute[98289]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:45.341495 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:45.341495 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:45.341495 np0000001565 nova-compute[98289]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:45.341495 np0000001565 nova-compute[98289]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:45.341495 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:45.341725 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', '153')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:14:45.341806 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', '145')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:14:45.342681 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', '146')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:14:45.343500 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e387ede40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285'): ({'sdd'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:14:45.343724 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Removing multipathed devices sdd, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:14:45.343956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Flush multipath device 330000000889cd37f {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:14:45.345469 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': 'f6dba5cc-9c32-4fd8-8035-789d3e310cbf', 'attached_at': '', 'detached_at': '', 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'serial': '37fda03b-5050-4703-a86b-96a8bd62aca0'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:14:45.346029 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:14:45.346205 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:14:45.346387 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:14:45.364076 np0000001565 nova-compute[98289]: WARNING os_brick.encryptors.luks [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 23:14:45.364578 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:14:45.364737 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:14:45.364996 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:14:45.365435 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x726e601fc680>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': 'f6dba5cc-9c32-4fd8-8035-789d3e310cbf', 'attached_at': '', 'detached_at': '', 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'serial': '37fda03b-5050-4703-a86b-96a8bd62aca0'} {{(pid=98289) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 23:14:45.365553 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] formatting encrypted volume /dev/dm-4 {{(pid=98289) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 27 23:14:45.373742 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:14:45.419139 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:14:45.487398 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:14:45.487819 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:14:45.488493 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:14:45.500972 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:14:45.501151 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:14:45.513235 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:45.557575 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, portal: 192.168.40.100,3260]
May 27 23:14:45.557575 np0000001565 nova-compute[98289]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, portal: 192.168.40.100,3260] successful.
May 27 23:14:45.557575 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:45.575293 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:45.592954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:45.630890 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, portal: 192.168.50.100,3260]
May 27 23:14:45.630890 np0000001565 nova-compute[98289]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, portal: 192.168.50.100,3260] successful.
May 27 23:14:45.630890 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:45.646009 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:14:45.646241 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:45.646390 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] <== disconnect_volume: return (1816ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:14:45.646637 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:14:45.692296 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] Releasing lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:14:45.692496 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-changed-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:45.692646 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Refreshing instance network info cache due to event network-changed-be104f4e-591b-4263-8213-45d1816bfb89. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:14:45.692791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] Acquiring lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:14:45.692877 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] Acquired lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:14:45.692986 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Refreshing network info cache for port be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:14:46.193151 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lazy-loading 'flavor' on Instance uuid 1bf977e2-b498-4a2d-b7c2-8fc923e51751 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:14:46.195246 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:46.468103 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:46.681307 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updated VIF entry in instance network info cache for port be104f4e-591b-4263-8213-45d1816bfb89. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:14:46.681661 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updating instance_info_cache with network_info: [{"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:14:47.031998 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:47.183534 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2347bac8-a5a6-4e75-95b1-04425adf88ca req-5df66049-a896-4b2b-a99c-78ef5ced7847 service nova] Releasing lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:14:47.198859 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ab45284-6764-400a-9ee0-0de1677898d6 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.449s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:47.199837 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.167s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:47.200132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:47.200313 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:47.200450 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:47.202267 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Terminating instance
May 27 23:14:47.705204 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:14:47.719066 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:47.721370 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:47.741493 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:47.742850 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:47.768319 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:47.872411 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4e2de4a5-2589-4c5e-a0a7-0f2ff3c8809f req-66971cf1-774d-49e5-a46c-348eb83eeb16 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Received event network-vif-unplugged-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:47.872620 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4e2de4a5-2589-4c5e-a0a7-0f2ff3c8809f req-66971cf1-774d-49e5-a46c-348eb83eeb16 service nova] Acquiring lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:47.872799 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4e2de4a5-2589-4c5e-a0a7-0f2ff3c8809f req-66971cf1-774d-49e5-a46c-348eb83eeb16 service nova] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:47.872978 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4e2de4a5-2589-4c5e-a0a7-0f2ff3c8809f req-66971cf1-774d-49e5-a46c-348eb83eeb16 service nova] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:47.873094 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4e2de4a5-2589-4c5e-a0a7-0f2ff3c8809f req-66971cf1-774d-49e5-a46c-348eb83eeb16 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] No waiting events found dispatching network-vif-unplugged-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:14:47.873244 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4e2de4a5-2589-4c5e-a0a7-0f2ff3c8809f req-66971cf1-774d-49e5-a46c-348eb83eeb16 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Received event network-vif-unplugged-28065d6e-9306-4e37-bd90-45b884decd5e for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:14:48.011539 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:48.035281 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999698279999848 future=<Future at 0x726e60148770 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:14:48.035838 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999118522999652 future=<Future at 0x726e60148770 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:14:48.036072 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998861713999759 future=<Future at 0x726e60148770 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:14:48.038134 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Instance destroyed successfully.
May 27 23:14:48.038223 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lazy-loading 'resources' on Instance uuid 1bf977e2-b498-4a2d-b7c2-8fc923e51751 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:14:48.123832 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:14:48.540506 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-551080605',display_name='tempest-VolumesBackupsTest-instance-551080605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesbackupstest-instance-551080605',id=57,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjLGZ43jd6XWJnMhli5n2943zbwbdTm8dGE9cApERSxkGbHdE2smfcoTa1bEkkrnPjJVu8IIa6ScoYyMkw9z59oJbZTMZ93PZwO3QQpu8VE/oZgyPnhr+qPlBTQbefRfA==',key_name='tempest-keypair-1168622748',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:13:32Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ed98b56db004061b06363a72405f6ae',ramdisk_id='',reservation_id='r-x0zguo7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-188258886',owner_user_name='tempest-VolumesBackupsTest-188258886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:13:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f45f6afa2b7e42148a7685164b694ff3',uuid=1bf977e2-b498-4a2d-b7c2-8fc923e51751,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28065d6e-9306-4e37-bd90-45b884decd5e", "address": "fa:16:3e:af:b8:86", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28065d6e-93", "ovs_interfaceid": "28065d6e-9306-4e37-bd90-45b884decd5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:14:48.540685 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converting VIF {"id": "28065d6e-9306-4e37-bd90-45b884decd5e", "address": "fa:16:3e:af:b8:86", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28065d6e-93", "ovs_interfaceid": "28065d6e-9306-4e37-bd90-45b884decd5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:14:48.541273 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:b8:86,bridge_name='br-int',has_traffic_filtering=True,id=28065d6e-9306-4e37-bd90-45b884decd5e,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28065d6e-93') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:14:48.541577 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:b8:86,bridge_name='br-int',has_traffic_filtering=True,id=28065d6e-9306-4e37-bd90-45b884decd5e,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28065d6e-93') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:14:48.542746 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:48.543004 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28065d6e-93, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:48.545474 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:14:48.545995 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:48.546697 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:48.546902 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2ee8bba-1c16-4b30-b038-e6fd0362c461) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:48.548801 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:14:48.550277 np0000001565 nova-compute[98289]: INFO os_vif [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:b8:86,bridge_name='br-int',has_traffic_filtering=True,id=28065d6e-9306-4e37-bd90-45b884decd5e,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28065d6e-93')
May 27 23:14:48.555939 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:14:48.556232 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fb09c64-464b-4897-913c-9cc6d9180285', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:14:48.556480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:48.556816 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:48.557067 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2fb09c64-464b-4897-913c-9cc6d9180285', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:14:48.557181 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:14:48.578892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:48.578892 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:48.578892 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:48.578892 np0000001565 nova-compute[98289]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:48.578892 np0000001565 nova-compute[98289]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:48.578892 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:48.579164 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:48.579164 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:48.579164 np0000001565 nova-compute[98289]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:48.579164 np0000001565 nova-compute[98289]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:48.579164 np0000001565 nova-compute[98289]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:48.579164 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:48.579164 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', '153')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:14:48.579357 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, 0): [] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:14:48.579357 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285') {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 23:14:48.579401 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285, 0): [] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:14:48.579507 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2fb09c64-464b-4897-913c-9cc6d9180285') {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 23:14:48.579597 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e386ae020>, {}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:14:48.579686 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Disconnecting from: [] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:14:48.579836 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.023s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:14:48.579923 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] <== disconnect_volume: return (23ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:14:48.580020 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:14:48.580343 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Deleting instance files /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751_del
May 27 23:14:48.581006 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Deletion of /opt/stack/data/nova/instances/1bf977e2-b498-4a2d-b7c2-8fc923e51751_del complete
May 27 23:14:48.629696 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:48.630999 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:48.630999 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:48.630999 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:14:49.088410 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 23:14:49.088948 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:14:49.088948 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:14:49.089053 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:14:49.089197 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:49.140963 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 23:14:49.140963 np0000001565 nova-compute[98289]:   <usage type="volume">
May 27 23:14:49.140963 np0000001565 nova-compute[98289]:     <volume>37fda03b-5050-4703-a86b-96a8bd62aca0</volume>
May 27 23:14:49.140963 np0000001565 nova-compute[98289]:   </usage>
May 27 23:14:49.140963 np0000001565 nova-compute[98289]: </secret>
May 27 23:14:49.140963 np0000001565 nova-compute[98289]:  {{(pid=98289) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 23:14:49.156968 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:49.209467 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:49.580660 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2fc155b8-6290-4f2d-aca9-fee77a62dca2 req-661332e1-06d9-4ad0-80c7-82a3a1c1b379 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Received event network-vif-deleted-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:49.581124 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-2fc155b8-6290-4f2d-aca9-fee77a62dca2 req-661332e1-06d9-4ad0-80c7-82a3a1c1b379 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Neutron deleted interface 28065d6e-9306-4e37-bd90-45b884decd5e; detaching it from the instance and deleting it from the info cache
May 27 23:14:49.583046 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2fc155b8-6290-4f2d-aca9-fee77a62dca2 req-661332e1-06d9-4ad0-80c7-82a3a1c1b379 service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Detach interface failed, port_id=28065d6e-9306-4e37-bd90-45b884decd5e, reason: Instance 1bf977e2-b498-4a2d-b7c2-8fc923e51751 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:14:49.650901 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Error from libvirt while getting description of instance-00000039: [Error Code 42] Domain not found: no domain with matching uuid '1bf977e2-b498-4a2d-b7c2-8fc923e51751' (instance-00000039): libvirt.libvirtError: Domain not found: no domain with matching uuid '1bf977e2-b498-4a2d-b7c2-8fc923e51751' (instance-00000039)
May 27 23:14:49.652437 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:14:49.660347 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:14:49.660347 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:14:49.684317 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1829715288',display_name='tempest-TestVolumeBootPattern-server-1829715288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1829715288',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-g6hxtbrh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:14:40Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=f6dba5cc-9c32-4fd8-8035-789d3e310cbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "224b1210-d83c-490f-8ad2-46b304372cab", "address": "fa:16:3e:67:01:b3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap224b1210-d8", "ovs_interfaceid": "224b1210-d83c-490f-8ad2-46b304372cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:14:49.684634 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "224b1210-d83c-490f-8ad2-46b304372cab", "address": "fa:16:3e:67:01:b3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap224b1210-d8", "ovs_interfaceid": "224b1210-d83c-490f-8ad2-46b304372cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:14:49.685725 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=224b1210-d83c-490f-8ad2-46b304372cab,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224b1210-d8') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:14:49.688704 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'pci_devices' on Instance uuid f6dba5cc-9c32-4fd8-8035-789d3e310cbf {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:14:49.713294 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:14:49.713805 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13230MB free_disk=72.85918807983398GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:14:49.714017 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:49.714308 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:49.931391 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0436338-7b54-4d35-b6a3-bcd0865437eb req-781f47d7-837d-4b03-acb0-72e261e8513f service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Received event network-vif-unplugged-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:49.931598 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0436338-7b54-4d35-b6a3-bcd0865437eb req-781f47d7-837d-4b03-acb0-72e261e8513f service nova] Acquiring lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:49.931758 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0436338-7b54-4d35-b6a3-bcd0865437eb req-781f47d7-837d-4b03-acb0-72e261e8513f service nova] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:49.931886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e0436338-7b54-4d35-b6a3-bcd0865437eb req-781f47d7-837d-4b03-acb0-72e261e8513f service nova] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:49.931998 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0436338-7b54-4d35-b6a3-bcd0865437eb req-781f47d7-837d-4b03-acb0-72e261e8513f service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] No waiting events found dispatching network-vif-unplugged-28065d6e-9306-4e37-bd90-45b884decd5e {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:14:49.932114 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e0436338-7b54-4d35-b6a3-bcd0865437eb req-781f47d7-837d-4b03-acb0-72e261e8513f service nova] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Received event network-vif-unplugged-28065d6e-9306-4e37-bd90-45b884decd5e for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:14:50.039766 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:14:50.193041 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] End _get_guest_xml xml=<domain type="qemu">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <uuid>f6dba5cc-9c32-4fd8-8035-789d3e310cbf</uuid>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <name>instance-0000003c</name>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPattern-server-1829715288</nova:name>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:14:42</nova:creationTime>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:properties/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:user uuid="31823a44e786429f80ba607958f8b63e">tempest-TestVolumeBootPattern-314561297-project-member</nova:user>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:project uuid="5dda425dab8946dc926808806eeedced">tempest-TestVolumeBootPattern-314561297</nova:project>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <nova:port uuid="224b1210-d83c-490f-8ad2-46b304372cab">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <system>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <entry name="serial">f6dba5cc-9c32-4fd8-8035-789d3e310cbf</entry>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <entry name="uuid">f6dba5cc-9c32-4fd8-8035-789d3e310cbf</entry>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     </system>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <os>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   </os>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <features>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   </features>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   <devices>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/f6dba5cc-9c32-4fd8-8035-789d3e310cbf/disk.config"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     </disk>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <alias name="ua-37fda03b-5050-4703-a86b-96a8bd62aca0"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <serial>37fda03b-5050-4703-a86b-96a8bd62aca0</serial>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <encryption format="luks">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:         <secret type="passphrase" uuid="bc8f9e3d-6a99-444c-b62b-24df961e73f2"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       </encryption>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     </disk>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:67:01:b3"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <target dev="tap224b1210-d8"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     </interface>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/f6dba5cc-9c32-4fd8-8035-789d3e310cbf/console.log" append="off"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     </serial>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <video>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     </video>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     </rng>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:   </devices>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]: </domain>
May 27 23:14:50.193041 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:14:50.196916 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Preparing to wait for external event network-vif-plugged-224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:14:50.196916 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:50.196916 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:50.196916 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:50.196916 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1829715288',display_name='tempest-TestVolumeBootPattern-server-1829715288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1829715288',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-g6hxtbrh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:14:40Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=f6dba5cc-9c32-4fd8-8035-789d3e310cbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "224b1210-d83c-490f-8ad2-46b304372cab", "address": "fa:16:3e:67:01:b3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap224b1210-d8", "ovs_interfaceid": "224b1210-d83c-490f-8ad2-46b304372cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:14:50.196916 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "224b1210-d83c-490f-8ad2-46b304372cab", "address": "fa:16:3e:67:01:b3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap224b1210-d8", "ovs_interfaceid": "224b1210-d83c-490f-8ad2-46b304372cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:14:50.196916 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=224b1210-d83c-490f-8ad2-46b304372cab,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224b1210-d8') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:14:50.196916 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=224b1210-d83c-490f-8ad2-46b304372cab,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224b1210-d8') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:14:50.196916 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:50.196916 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:50.198085 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:14:50.198085 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:50.198085 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf2594b8-230f-549f-bcc9-c76b3e0198ff', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:50.200044 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:14:50.201940 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:50.202081 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap224b1210-d8, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:50.202417 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap224b1210-d8, col_values=(('qos', UUID('50d2faee-6695-4e06-9bd5-bd2955c010ed')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:50.202581 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap224b1210-d8, col_values=(('external_ids', {'iface-id': '224b1210-d83c-490f-8ad2-46b304372cab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:01:b3', 'vm-uuid': 'f6dba5cc-9c32-4fd8-8035-789d3e310cbf'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:50.204445 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:14:50.208530 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:50.209261 np0000001565 nova-compute[98289]: INFO os_vif [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=224b1210-d83c-490f-8ad2-46b304372cab,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224b1210-d8')
May 27 23:14:50.541873 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Took 1.45 seconds to deallocate network for instance.
May 27 23:14:50.561900 np0000001565 nova-compute[98289]: WARNING nova.volume.cinder [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Attachment 7f257266-5425-4d30-a2d4-913a3f93b557 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7f257266-5425-4d30-a2d4-913a3f93b557. (HTTP 404) (Request-ID: req-5cb44040-2e95-45ab-b66a-c87f8db6e0b0)
May 27 23:14:50.562247 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Took 0.02 seconds to detach 1 volumes for instance.
May 27 23:14:50.765874 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 1bf977e2-b498-4a2d-b7c2-8fc923e51751 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:14:50.766125 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance d15d35fb-589c-4ea2-8c94-9588bc66bec3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:14:50.766220 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance f6dba5cc-9c32-4fd8-8035-789d3e310cbf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:14:50.766420 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:14:50.766605 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:14:49 up 43 min,  2 users,  load average: 3.35, 5.03, 4.28\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_deleting': '1', 'num_os_type_None': '3', 'num_proj_8ed98b56db004061b06363a72405f6ae': '1', 'io_workload': '1', 'num_task_None': '1', 'num_proj_e604a1a983b14e5aa26d1b8254daf8ce': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_5dda425dab8946dc926808806eeedced': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:14:50.927501 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:14:50.927733 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:14:51.069121 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:51.430154 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:14:51.726703 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:14:51.726813 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:14:51.726907 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No VIF found with MAC fa:16:3e:67:01:b3, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:14:51.727276 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Using config drive
May 27 23:14:51.935703 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:14:51.936068 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.222s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:51.936557 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.867s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:51.936759 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 9.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:14:52.115629 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:14:52.115817 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:14:52.231838 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:14:52.331428 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Creating config drive at /opt/stack/data/nova/instances/f6dba5cc-9c32-4fd8-8035-789d3e310cbf/disk.config
May 27 23:14:52.334417 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f6dba5cc-9c32-4fd8-8035-789d3e310cbf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu3_22guy {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:14:52.385018 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f6dba5cc-9c32-4fd8-8035-789d3e310cbf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu3_22guy" returned: 0 in 0.050s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:14:52.618823 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:14:52.777964 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:52.803119 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:52.804709 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:52.912773 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:52.950054 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-274f798c-7b50-4bc4-93ee-34141aeede89 req-a4465de7-8845-4c5c-a326-0d77f562075d service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Received event network-vif-plugged-224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:52.950292 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274f798c-7b50-4bc4-93ee-34141aeede89 req-a4465de7-8845-4c5c-a326-0d77f562075d service nova] Acquiring lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:52.950486 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274f798c-7b50-4bc4-93ee-34141aeede89 req-a4465de7-8845-4c5c-a326-0d77f562075d service nova] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:52.950619 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-274f798c-7b50-4bc4-93ee-34141aeede89 req-a4465de7-8845-4c5c-a326-0d77f562075d service nova] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:52.950735 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-274f798c-7b50-4bc4-93ee-34141aeede89 req-a4465de7-8845-4c5c-a326-0d77f562075d service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Processing event network-vif-plugged-224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:14:53.110603 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:53.114834 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:53.115730 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:53.126078 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.190s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:53.132699 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:53.176024 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Deleted allocations for instance 1bf977e2-b498-4a2d-b7c2-8fc923e51751
May 27 23:14:54.184031 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ac287cb2-12f7-4fa9-b858-f1cfef48244d tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "1bf977e2-b498-4a2d-b7c2-8fc923e51751" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.985s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:54.212040 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:54.403283 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923694.4028876, f6dba5cc-9c32-4fd8-8035-789d3e310cbf => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:14:54.403563 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] VM Started (Lifecycle Event)
May 27 23:14:54.404584 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:14:54.408192 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:14:54.412178 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Instance spawned successfully.
May 27 23:14:54.412867 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:14:54.906502 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:14:54.908750 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:14:54.917652 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:54.917764 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:54.917978 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:54.918198 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:54.918433 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:54.918638 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:14:55.005919 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-55ae7f74-f67f-4d88-ad02-ed429102f5ed req-fdbcc881-5e39-4c60-b697-901c5f4a8d4e service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Received event network-vif-plugged-224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:55.006466 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-55ae7f74-f67f-4d88-ad02-ed429102f5ed req-fdbcc881-5e39-4c60-b697-901c5f4a8d4e service nova] Acquiring lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:55.006687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-55ae7f74-f67f-4d88-ad02-ed429102f5ed req-fdbcc881-5e39-4c60-b697-901c5f4a8d4e service nova] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:55.006848 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-55ae7f74-f67f-4d88-ad02-ed429102f5ed req-fdbcc881-5e39-4c60-b697-901c5f4a8d4e service nova] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:55.007017 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-55ae7f74-f67f-4d88-ad02-ed429102f5ed req-fdbcc881-5e39-4c60-b697-901c5f4a8d4e service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] No waiting events found dispatching network-vif-plugged-224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:14:55.007198 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-55ae7f74-f67f-4d88-ad02-ed429102f5ed req-fdbcc881-5e39-4c60-b697-901c5f4a8d4e service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Received unexpected event network-vif-plugged-224b1210-d83c-490f-8ad2-46b304372cab for instance with vm_state building and task_state spawning.
May 27 23:14:55.203895 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:55.410936 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:14:55.411106 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923695.4109373, f6dba5cc-9c32-4fd8-8035-789d3e310cbf => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:14:55.411226 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] VM Paused (Lifecycle Event)
May 27 23:14:55.423684 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Took 13.18 seconds to spawn the instance on the hypervisor.
May 27 23:14:55.423958 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:14:55.913407 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:14:55.916198 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923695.9159606, f6dba5cc-9c32-4fd8-8035-789d3e310cbf => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:14:55.916314 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] VM Resumed (Lifecycle Event)
May 27 23:14:55.937252 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Took 20.21 seconds to build instance.
May 27 23:14:56.420124 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:14:56.422267 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:14:56.440362 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-97c33884-2d58-48e2-99ea-49324a08150c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.722s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:56.677153 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:56.677278 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:56.677791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:56.677791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:56.677916 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:56.679720 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Terminating instance
May 27 23:14:56.926300 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] During sync_power_state the instance has a pending task (deleting). Skip.
May 27 23:14:57.182574 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:14:57.198506 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:57.200487 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:57.214714 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:57.218941 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:57.235077 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:57.240172 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:57.328895 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aa4bd49e-84e5-4079-b1f0-fe85a934a154 req-1ada7bc4-99a8-498f-9f3e-2bff7490e140 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Received event network-vif-unplugged-224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:57.329839 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aa4bd49e-84e5-4079-b1f0-fe85a934a154 req-1ada7bc4-99a8-498f-9f3e-2bff7490e140 service nova] Acquiring lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:57.329993 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aa4bd49e-84e5-4079-b1f0-fe85a934a154 req-1ada7bc4-99a8-498f-9f3e-2bff7490e140 service nova] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:57.330113 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-aa4bd49e-84e5-4079-b1f0-fe85a934a154 req-1ada7bc4-99a8-498f-9f3e-2bff7490e140 service nova] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:57.330224 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aa4bd49e-84e5-4079-b1f0-fe85a934a154 req-1ada7bc4-99a8-498f-9f3e-2bff7490e140 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] No waiting events found dispatching network-vif-unplugged-224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:14:57.330325 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-aa4bd49e-84e5-4079-b1f0-fe85a934a154 req-1ada7bc4-99a8-498f-9f3e-2bff7490e140 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Received event network-vif-unplugged-224b1210-d83c-490f-8ad2-46b304372cab for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:14:57.490682 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.9996649779996 future=<Future at 0x726e6019cb00 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:14:57.492692 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Instance destroyed successfully.
May 27 23:14:57.493244 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'resources' on Instance uuid f6dba5cc-9c32-4fd8-8035-789d3e310cbf {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:14:57.996159 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1829715288',display_name='tempest-TestVolumeBootPattern-server-1829715288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1829715288',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:14:55Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-g6hxtbrh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:14:55Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=f6dba5cc-9c32-4fd8-8035-789d3e310cbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "224b1210-d83c-490f-8ad2-46b304372cab", "address": "fa:16:3e:67:01:b3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap224b1210-d8", "ovs_interfaceid": "224b1210-d83c-490f-8ad2-46b304372cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:14:57.996385 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "224b1210-d83c-490f-8ad2-46b304372cab", "address": "fa:16:3e:67:01:b3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap224b1210-d8", "ovs_interfaceid": "224b1210-d83c-490f-8ad2-46b304372cab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:14:57.996954 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=224b1210-d83c-490f-8ad2-46b304372cab,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224b1210-d8') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:14:57.997189 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=224b1210-d83c-490f-8ad2-46b304372cab,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224b1210-d8') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:14:57.998414 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:57.998613 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap224b1210-d8, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:57.999602 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:58.000394 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:14:58.000807 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:58.001316 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:58.001440 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50d2faee-6695-4e06-9bd5-bd2955c010ed) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:14:58.002033 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:58.002447 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:14:58.002504 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:58.004049 np0000001565 nova-compute[98289]: INFO os_vif [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:01:b3,bridge_name='br-int',has_traffic_filtering=True,id=224b1210-d83c-490f-8ad2-46b304372cab,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224b1210-d8')
May 27 23:14:58.006496 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:14:58.006782 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:14:58.006908 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:14:59.219946 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:14:59.424281 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a208be46-71f7-4ee1-9791-5da1e2541c03 req-76dccb99-8f54-4d50-8cfe-d6d43d294295 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Received event network-vif-unplugged-224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:14:59.424657 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a208be46-71f7-4ee1-9791-5da1e2541c03 req-76dccb99-8f54-4d50-8cfe-d6d43d294295 service nova] Acquiring lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:14:59.424817 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a208be46-71f7-4ee1-9791-5da1e2541c03 req-76dccb99-8f54-4d50-8cfe-d6d43d294295 service nova] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:14:59.424935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a208be46-71f7-4ee1-9791-5da1e2541c03 req-76dccb99-8f54-4d50-8cfe-d6d43d294295 service nova] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:14:59.425076 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a208be46-71f7-4ee1-9791-5da1e2541c03 req-76dccb99-8f54-4d50-8cfe-d6d43d294295 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] No waiting events found dispatching network-vif-unplugged-224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:14:59.425203 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a208be46-71f7-4ee1-9791-5da1e2541c03 req-76dccb99-8f54-4d50-8cfe-d6d43d294295 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Received event network-vif-unplugged-224b1210-d83c-490f-8ad2-46b304372cab for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:14:59.860874 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.854s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:14:59.861154 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37fda03b-5050-4703-a86b-96a8bd62aca0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:14:59.861301 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:14:59.892092 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:59.892092 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:59.892092 np0000001565 nova-compute[98289]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:59.892092 np0000001565 nova-compute[98289]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:59.892092 np0000001565 nova-compute[98289]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:59.892092 np0000001565 nova-compute[98289]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5da8b0da-e53e-4ec0-9554-37ac2888a67e (non-flash)
May 27 23:14:59.892092 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:14:59.892356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:59.892356 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:14:59.892356 np0000001565 nova-compute[98289]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:59.892356 np0000001565 nova-compute[98289]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0 (non-flash)
May 27 23:14:59.892356 np0000001565 nova-compute[98289]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:14:59.892356 np0000001565 nova-compute[98289]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5da8b0da-e53e-4ec0-9554-37ac2888a67e (non-flash)
May 27 23:14:59.892356 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:14:59.892711 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5da8b0da-e53e-4ec0-9554-37ac2888a67e', '155')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:14:59.892777 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', '153')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:14:59.894159 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0', '152')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:14:59.895171 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58137420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:14:59.895544 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Removing multipathed devices sdh, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:14:59.895895 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flush multipath device 33000000026011b85 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:14:59.932847 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:14:59.972003 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:15:00.018950 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if SCSI volumes sdh, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:15:00.019151 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] SCSI volumes sdh, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:15:00.020352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if device paths {'sdh', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:15:00.030966 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Device paths {'sdh', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:15:00.031204 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:15:00.044000 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:00.074324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0, portal: 192.168.40.100,3260]
May 27 23:15:00.074324 np0000001565 nova-compute[98289]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0, portal: 192.168.40.100,3260] successful.
May 27 23:15:00.074324 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:00.088186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:00.099309 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:00.123269 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0, portal: 192.168.50.100,3260]
May 27 23:15:00.123269 np0000001565 nova-compute[98289]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-37fda03b-5050-4703-a86b-96a8bd62aca0, portal: 192.168.50.100,3260] successful.
May 27 23:15:00.123269 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:00.141360 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:00.142604 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:15:00.142787 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== disconnect_volume: return (2136ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:15:00.142938 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:15:00.143256 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Deleting instance files /opt/stack/data/nova/instances/f6dba5cc-9c32-4fd8-8035-789d3e310cbf_del
May 27 23:15:00.143947 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Deletion of /opt/stack/data/nova/instances/f6dba5cc-9c32-4fd8-8035-789d3e310cbf_del complete
May 27 23:15:00.649777 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Took 3.47 seconds to destroy the instance on the hypervisor.
May 27 23:15:00.650530 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:15:00.650896 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:15:00.651068 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:15:00.651379 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:00.746584 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:01.485552 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4da562fa-d7ce-457d-8e0a-09b9ce8b888d req-b4767f27-d6ae-44a4-b8ed-2bde914782e1 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Received event network-vif-deleted-224b1210-d83c-490f-8ad2-46b304372cab {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:01.485918 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-4da562fa-d7ce-457d-8e0a-09b9ce8b888d req-b4767f27-d6ae-44a4-b8ed-2bde914782e1 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Neutron deleted interface 224b1210-d83c-490f-8ad2-46b304372cab; detaching it from the instance and deleting it from the info cache
May 27 23:15:01.487381 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4da562fa-d7ce-457d-8e0a-09b9ce8b888d req-b4767f27-d6ae-44a4-b8ed-2bde914782e1 service nova] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Detach interface failed, port_id=224b1210-d83c-490f-8ad2-46b304372cab, reason: Instance f6dba5cc-9c32-4fd8-8035-789d3e310cbf could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:15:01.494749 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:15:01.930396 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:15:01.930725 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:15:01.930907 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:15:01.931136 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:15:01.931428 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.19 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:15:02.000221 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Took 1.35 seconds to deallocate network for instance.
May 27 23:15:02.123708 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:15:02.123842 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:15:02.125162 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:15:02.544515 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Took 0.54 seconds to detach 1 volumes for instance.
May 27 23:15:03.003127 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:03.035419 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00035524900022210204 future=<Future at 0x726e60148770 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:03.035419 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:03.035419 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.454741372999706 future=<Future at 0x726e6019cb00 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:03.035689 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.454665504999866 future=<Future at 0x726e6019cb00 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:03.036309 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Emitting event <LifecycleEvent: 1779923688.0348666, 1bf977e2-b498-4a2d-b7c2-8fc923e51751 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:15:03.036309 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] VM Stopped (Lifecycle Event)
May 27 23:15:03.050937 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:03.051046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:03.125288 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:15:03.126392 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:15:03.126744 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:15:03.192114 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:15:03.192435 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:15:03.540804 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 1bf977e2-b498-4a2d-b7c2-8fc923e51751] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:03.695165 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:15:03.884950 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-86e89add-05e8-48b6-8db7-deb275dd0514 req-ccf85466-67d5-483c-9eca-2dfced4bae9a service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-changed-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:03.885129 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-86e89add-05e8-48b6-8db7-deb275dd0514 req-ccf85466-67d5-483c-9eca-2dfced4bae9a service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Refreshing instance network info cache due to event network-changed-be104f4e-591b-4263-8213-45d1816bfb89. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:15:03.885360 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-86e89add-05e8-48b6-8db7-deb275dd0514 req-ccf85466-67d5-483c-9eca-2dfced4bae9a service nova] Acquiring lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:15:03.885484 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-86e89add-05e8-48b6-8db7-deb275dd0514 req-ccf85466-67d5-483c-9eca-2dfced4bae9a service nova] Acquired lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:15:03.885643 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-86e89add-05e8-48b6-8db7-deb275dd0514 req-ccf85466-67d5-483c-9eca-2dfced4bae9a service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Refreshing network info cache for port be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:15:04.203727 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.152s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:04.222086 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:04.258464 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deleted allocations for instance f6dba5cc-9c32-4fd8-8035-789d3e310cbf
May 27 23:15:04.388651 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-86e89add-05e8-48b6-8db7-deb275dd0514 req-ccf85466-67d5-483c-9eca-2dfced4bae9a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:04.395739 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:04.395929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:04.396147 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:04.396291 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:04.396427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:04.400165 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Terminating instance
May 27 23:15:04.644836 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-86e89add-05e8-48b6-8db7-deb275dd0514 req-ccf85466-67d5-483c-9eca-2dfced4bae9a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:04.783901 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-86e89add-05e8-48b6-8db7-deb275dd0514 req-ccf85466-67d5-483c-9eca-2dfced4bae9a service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updated VIF entry in instance network info cache for port be104f4e-591b-4263-8213-45d1816bfb89. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:15:04.784254 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-86e89add-05e8-48b6-8db7-deb275dd0514 req-ccf85466-67d5-483c-9eca-2dfced4bae9a service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updating instance_info_cache with network_info: [{"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:15:04.904903 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:15:04.920647 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:04.924188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:04.960751 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:04.978242 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:04.984305 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:05.063703 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-38f11c3f-e9d8-4d64-9e99-7bfe2983e347 req-153e7c75-cd46-449f-8473-850d39353416 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-vif-unplugged-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:05.063900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-38f11c3f-e9d8-4d64-9e99-7bfe2983e347 req-153e7c75-cd46-449f-8473-850d39353416 service nova] Acquiring lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:05.064101 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-38f11c3f-e9d8-4d64-9e99-7bfe2983e347 req-153e7c75-cd46-449f-8473-850d39353416 service nova] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:05.064476 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-38f11c3f-e9d8-4d64-9e99-7bfe2983e347 req-153e7c75-cd46-449f-8473-850d39353416 service nova] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:05.064476 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-38f11c3f-e9d8-4d64-9e99-7bfe2983e347 req-153e7c75-cd46-449f-8473-850d39353416 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] No waiting events found dispatching network-vif-unplugged-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:15:05.064857 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-38f11c3f-e9d8-4d64-9e99-7bfe2983e347 req-153e7c75-cd46-449f-8473-850d39353416 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-vif-unplugged-be104f4e-591b-4263-8213-45d1816bfb89 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:15:05.211926 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:05.231468 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999726701999862 future=<Future at 0x726e387954f0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:05.233511 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Instance destroyed successfully.
May 27 23:15:05.233961 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lazy-loading 'resources' on Instance uuid d15d35fb-589c-4ea2-8c94-9588bc66bec3 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:15:05.272383 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-bae8a806-cf31-4fe9-96d1-cd1350e616aa tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "f6dba5cc-9c32-4fd8-8035-789d3e310cbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.595s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:05.286802 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-86e89add-05e8-48b6-8db7-deb275dd0514 req-ccf85466-67d5-483c-9eca-2dfced4bae9a service nova] Releasing lock "refresh_cache-d15d35fb-589c-4ea2-8c94-9588bc66bec3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:15:05.738976 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1236715997',display_name='tempest-TestVolumeBackupRestore-server-1236715997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebackuprestore-server-1236715997',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETRdVOOToPsp606JUnN4+xuv1pmatOz/RydjPWOqpr/uH6588lVpzWKEZYw/FgzdkeKJDsYEItTvtaLpgrovM+Y6t40uEd9QXKl5hA0JVS0adkX0VZ9tWBj1R0LjtiDAQ==',key_name='tempest-TestVolumeBackupRestore-1717454730',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:14:39Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e604a1a983b14e5aa26d1b8254daf8ce',ramdisk_id='',reservation_id='r-dfbfysii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-1486634334',owner_user_name='tempest-TestVolumeBackupRestore-1486634334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:14:39Z,user_data=None,user_id='578b34c690f94b1d97fff5e034cb8516',uuid=d15d35fb-589c-4ea2-8c94-9588bc66bec3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:15:05.739287 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Converting VIF {"id": "be104f4e-591b-4263-8213-45d1816bfb89", "address": "fa:16:3e:69:d6:13", "network": {"id": "866a0c99-2e27-43cb-b675-2084b7ab3f38", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-329233155-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e604a1a983b14e5aa26d1b8254daf8ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe104f4e-59", "ovs_interfaceid": "be104f4e-591b-4263-8213-45d1816bfb89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:15:05.739663 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:d6:13,bridge_name='br-int',has_traffic_filtering=True,id=be104f4e-591b-4263-8213-45d1816bfb89,network=Network(866a0c99-2e27-43cb-b675-2084b7ab3f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe104f4e-59') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:15:05.739873 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d6:13,bridge_name='br-int',has_traffic_filtering=True,id=be104f4e-591b-4263-8213-45d1816bfb89,network=Network(866a0c99-2e27-43cb-b675-2084b7ab3f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe104f4e-59') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:15:05.742258 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:05.742494 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe104f4e-59, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:05.743350 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:05.744016 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:15:05.744557 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:05.745085 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:05.745215 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5709594a-3a73-466e-afde-0a23d6d0cd81) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:05.745705 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:05.746170 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:15:05.746216 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:05.748818 np0000001565 nova-compute[98289]: INFO os_vif [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d6:13,bridge_name='br-int',has_traffic_filtering=True,id=be104f4e-591b-4263-8213-45d1816bfb89,network=Network(866a0c99-2e27-43cb-b675-2084b7ab3f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe104f4e-59')
May 27 23:15:05.750035 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:15:05.750302 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ce600b6-7d98-4f84-b112-f8cddb65274a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:15:05.750422 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:15:05.750727 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:15:05.750985 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ce600b6-7d98-4f84-b112-f8cddb65274a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:15:05.751099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:15:05.778963 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:15:05.778963 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:15:05.778963 np0000001565 nova-compute[98289]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5da8b0da-e53e-4ec0-9554-37ac2888a67e (non-flash)
May 27 23:15:05.778963 np0000001565 nova-compute[98289]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:15:05.778963 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:15:05.779280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:15:05.779280 np0000001565 nova-compute[98289]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a (non-flash)
May 27 23:15:05.779280 np0000001565 nova-compute[98289]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5da8b0da-e53e-4ec0-9554-37ac2888a67e (non-flash)
May 27 23:15:05.779280 np0000001565 nova-compute[98289]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38 (non-flash)
May 27 23:15:05.779280 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:15:05.779280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5da8b0da-e53e-4ec0-9554-37ac2888a67e', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5fa92eb1-3db4-4302-80e1-65939a267d38', '156')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:15:05.779608 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', '150')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:15:05.780180 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a', '149')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:15:05.780896 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e602aba60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a'): ({'sdf'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:15:05.781076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:15:05.781306 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Flush multipath device 330000000d5f30136 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:15:05.848825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:15:05.907112 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:15:05.966859 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:15:05.967065 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:15:05.968524 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:15:05.979657 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:15:05.979911 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:15:05.992224 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:06.019647 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a, portal: 192.168.40.100,3260]
May 27 23:15:06.019647 np0000001565 nova-compute[98289]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a, portal: 192.168.40.100,3260] successful.
May 27 23:15:06.019647 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:06.035724 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:06.049697 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:06.078464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a, portal: 192.168.50.100,3260]
May 27 23:15:06.078464 np0000001565 nova-compute[98289]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-3ce600b6-7d98-4f84-b112-f8cddb65274a, portal: 192.168.50.100,3260] successful.
May 27 23:15:06.078464 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:06.095115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:06.095391 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:15:06.095557 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] <== disconnect_volume: return (344ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:15:06.095704 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:15:06.096015 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Deleting instance files /opt/stack/data/nova/instances/d15d35fb-589c-4ea2-8c94-9588bc66bec3_del
May 27 23:15:06.096659 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Deletion of /opt/stack/data/nova/instances/d15d35fb-589c-4ea2-8c94-9588bc66bec3_del complete
May 27 23:15:06.604366 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Took 1.70 seconds to destroy the instance on the hypervisor.
May 27 23:15:06.605050 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:15:06.605429 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:15:06.605573 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:15:06.605847 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:06.784237 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:07.137081 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fb2c2406-dd75-4dae-8f70-7e928e19fe00 req-a7643515-b0e2-407a-a918-beeb5e8771c7 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-vif-unplugged-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:07.137251 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fb2c2406-dd75-4dae-8f70-7e928e19fe00 req-a7643515-b0e2-407a-a918-beeb5e8771c7 service nova] Acquiring lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:07.137614 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fb2c2406-dd75-4dae-8f70-7e928e19fe00 req-a7643515-b0e2-407a-a918-beeb5e8771c7 service nova] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:07.137791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fb2c2406-dd75-4dae-8f70-7e928e19fe00 req-a7643515-b0e2-407a-a918-beeb5e8771c7 service nova] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:07.137927 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fb2c2406-dd75-4dae-8f70-7e928e19fe00 req-a7643515-b0e2-407a-a918-beeb5e8771c7 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] No waiting events found dispatching network-vif-unplugged-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:15:07.138066 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fb2c2406-dd75-4dae-8f70-7e928e19fe00 req-a7643515-b0e2-407a-a918-beeb5e8771c7 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-vif-unplugged-be104f4e-591b-4263-8213-45d1816bfb89 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:15:07.138187 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fb2c2406-dd75-4dae-8f70-7e928e19fe00 req-a7643515-b0e2-407a-a918-beeb5e8771c7 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Received event network-vif-deleted-be104f4e-591b-4263-8213-45d1816bfb89 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:07.138313 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-fb2c2406-dd75-4dae-8f70-7e928e19fe00 req-a7643515-b0e2-407a-a918-beeb5e8771c7 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Neutron deleted interface be104f4e-591b-4263-8213-45d1816bfb89; detaching it from the instance and deleting it from the info cache
May 27 23:15:07.139573 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fb2c2406-dd75-4dae-8f70-7e928e19fe00 req-a7643515-b0e2-407a-a918-beeb5e8771c7 service nova] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Detach interface failed, port_id=be104f4e-591b-4263-8213-45d1816bfb89, reason: Instance d15d35fb-589c-4ea2-8c94-9588bc66bec3 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:15:07.479811 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:15:07.986716 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Took 1.38 seconds to deallocate network for instance.
May 27 23:15:08.534936 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Took 0.55 seconds to detach 1 volumes for instance.
May 27 23:15:09.042196 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:09.042699 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:09.234766 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:15:09.235063 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:15:09.347234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "18597568-997d-4741-93f0-3fedfd98bb48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:09.347234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "18597568-997d-4741-93f0-3fedfd98bb48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:09.737659 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:15:09.848946 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:15:10.243845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.201s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:10.297412 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Deleted allocations for instance d15d35fb-589c-4ea2-8c94-9588bc66bec3
May 27 23:15:10.397980 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:10.398122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:10.400828 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:15:10.400966 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Claim successful on node np0000001565
May 27 23:15:10.746319 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:11.311477 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a0a0b8f6-48e5-429d-976e-1e16b3035182 tempest-TestVolumeBackupRestore-1486634334 tempest-TestVolumeBackupRestore-1486634334-project-member] Lock "d15d35fb-589c-4ea2-8c94-9588bc66bec3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.915s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:11.486447 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:15:11.486673 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:15:11.989053 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:15:12.490738 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00036043600039192825 future=<Future at 0x726e6019cb00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:12.491133 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Emitting event <LifecycleEvent: 1779923697.4901834, f6dba5cc-9c32-4fd8-8035-789d3e310cbf => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:15:12.491133 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:12.491213 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=7.73997910099979 future=<Future at 0x726e387954f0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:12.491351 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] VM Stopped (Lifecycle Event)
May 27 23:15:12.492239 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=7.738927773999876 future=<Future at 0x726e387954f0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:12.495554 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.097s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:12.495971 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:15:12.994150 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-36beb808-4b28-4b71-9c65-5a0ae4ece774 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: f6dba5cc-9c32-4fd8-8035-789d3e310cbf] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:13.001846 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:15:13.002211 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:15:13.002458 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:13.002673 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:13.071553 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31823a44e786429f80ba607958f8b63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda425dab8946dc926808806eeedced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:15:13.505139 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:15:13.539186 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Successfully created port: bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:15:13.675229 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:14.009396 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Successfully updated port: bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:15:14.010656 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:15:14.058099 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4cb04465-dd35-49e1-8bde-6a5919a83b33 req-213f3a0a-347e-4024-80c5-47395bfaab38 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Received event network-changed-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:14.058506 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4cb04465-dd35-49e1-8bde-6a5919a83b33 req-213f3a0a-347e-4024-80c5-47395bfaab38 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Refreshing instance network info cache due to event network-changed-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:15:14.058754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4cb04465-dd35-49e1-8bde-6a5919a83b33 req-213f3a0a-347e-4024-80c5-47395bfaab38 service nova] Acquiring lock "refresh_cache-18597568-997d-4741-93f0-3fedfd98bb48" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:15:14.058900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4cb04465-dd35-49e1-8bde-6a5919a83b33 req-213f3a0a-347e-4024-80c5-47395bfaab38 service nova] Acquired lock "refresh_cache-18597568-997d-4741-93f0-3fedfd98bb48" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:15:14.059064 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4cb04465-dd35-49e1-8bde-6a5919a83b33 req-213f3a0a-347e-4024-80c5-47395bfaab38 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Refreshing network info cache for port bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:15:14.513512 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "refresh_cache-18597568-997d-4741-93f0-3fedfd98bb48" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:15:14.514818 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Booting with volume c26b60e7-4e67-438a-8114-15a648e57240 at /dev/vda
May 27 23:15:14.555795 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:15:14.561221 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4cb04465-dd35-49e1-8bde-6a5919a83b33 req-213f3a0a-347e-4024-80c5-47395bfaab38 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:14.569897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:15:14.593420 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:15:14.642111 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4cb04465-dd35-49e1-8bde-6a5919a83b33 req-213f3a0a-347e-4024-80c5-47395bfaab38 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:15:14.644274 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:15:14.644660 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:15:14.654862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:15:14.655306 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43'] 
May 27 23:15:14.655488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:15:14.655599 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:15:14.655829 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:15:14.656073 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Updating existing volume attachment record: c62270da-6394-4d41-9e54-418bd1cc363e {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:15:14.790485 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4cb04465-dd35-49e1-8bde-6a5919a83b33 req-213f3a0a-347e-4024-80c5-47395bfaab38 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:15:15.293277 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4cb04465-dd35-49e1-8bde-6a5919a83b33 req-213f3a0a-347e-4024-80c5-47395bfaab38 service nova] Releasing lock "refresh_cache-18597568-997d-4741-93f0-3fedfd98bb48" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:15:15.293715 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquired lock "refresh_cache-18597568-997d-4741-93f0-3fedfd98bb48" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:15:15.293892 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:15:15.697261 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:15.747118 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:15.861379 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:15:16.021959 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:16.165275 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Updating instance_info_cache with network_info: [{"id": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "address": "fa:16:3e:60:11:26", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd90c3db-dd", "ovs_interfaceid": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:15:16.667225 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Releasing lock "refresh_cache-18597568-997d-4741-93f0-3fedfd98bb48" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:15:16.667576 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Instance network_info: |[{"id": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "address": "fa:16:3e:60:11:26", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd90c3db-dd", "ovs_interfaceid": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:15:16.758983 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:15:16.760135 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:15:16.760351 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Creating image(s)
May 27 23:15:16.760692 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:15:16.760863 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Ensure instance console log exists: /opt/stack/data/nova/instances/18597568-997d-4741-93f0-3fedfd98bb48/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:15:16.761066 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:16.761267 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:16.761415 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:16.761827 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Start _get_guest_xml network_info=[{"id": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "address": "fa:16:3e:60:11:26", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd90c3db-dd", "ovs_interfaceid": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c62270da-6394-4d41-9e54-418bd1cc363e', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '18597568-997d-4741-93f0-3fedfd98bb48', 'attached_at': '', 'detached_at': '', 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'serial': 'c26b60e7-4e67-438a-8114-15a648e57240'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:15:16.765409 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:15:16.766435 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1420900408', uuid='18597568-997d-4741-93f0-3fedfd98bb48'), owner=OwnerMeta(userid='31823a44e786429f80ba607958f8b63e', username='tempest-TestVolumeBootPattern-314561297-project-member', projectid='5dda425dab8946dc926808806eeedced', projectname='tempest-TestVolumeBootPattern-314561297'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "address": "fa:16:3e:60:11:26", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd90c3db-dd", "ovs_interfaceid": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923716.76611) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:15:16.767553 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:15:16.767856 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:15:16.768720 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:15:16.768886 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:15:16.770064 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:15:16.770347 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:15:16.770516 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:15:16.770603 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:15:16.770717 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:15:16.770794 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:15:16.770877 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:15:16.771021 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:15:16.771112 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:15:16.771223 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:15:16.771373 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:15:16.771488 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:15:16.780809 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:15:16.781093 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:15:16.781214 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:15:18.835067 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.054s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:15:18.835469 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:15:18.848096 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:15:18.848815 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:15:18.849398 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:15:18.849595 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:15:18.849994 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:15:18.852026 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:15:18.863431 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:15:18.863431 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:18.869371 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:15:18.869371 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:18.878198 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240] added
May 27 23:15:18.878198 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:15:18.878198 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:18.878198 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:18.878198 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:18.878198 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:18.878198 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:18.878198 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:15:18.878198 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:15:18.878198 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:15:18.880300 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240] added
May 27 23:15:18.880300 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:15:18.880300 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:18.880300 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:18.880300 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:18.880300 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:18.880300 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:18.880528 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:15:18.880665 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:15:18.880778 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:15:19.185109 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:19.877002 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:15:19.881194 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:15:19.893144 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:15:19.893144 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:15:19.895194 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:15:19.895194 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:19.907071 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:19.913045 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:19.925354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65460bc1-e806-4467-85f5-7a559a39e36e (non-flash)
May 27 23:15:19.925354 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:15:19.925354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65460bc1-e806-4467-85f5-7a559a39e36e (non-flash)
May 27 23:15:19.925354 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:15:19.935520 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65460bc1-e806-4467-85f5-7a559a39e36e (non-flash)
May 27 23:15:19.935520 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:15:19.935677 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65460bc1-e806-4467-85f5-7a559a39e36e (non-flash)
May 27 23:15:19.935677 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:15:19.958125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240, portal: 192.168.40.100,3260]
May 27 23:15:19.958125 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240, portal: 192.168.40.100,3260] successful.
May 27 23:15:19.958125 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:19.970949 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:19.975823 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240, portal: 192.168.50.100,3260]
May 27 23:15:19.975823 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240, portal: 192.168.50.100,3260] successful.
May 27 23:15:19.975823 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:19.984365 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65460bc1-e806-4467-85f5-7a559a39e36e (non-flash)
May 27 23:15:19.984365 np0000001565 nova-compute[98289]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:19.984365 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:19.984365 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:15:19.984541 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65460bc1-e806-4467-85f5-7a559a39e36e (non-flash)
May 27 23:15:19.984541 np0000001565 nova-compute[98289]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:19.984541 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:19.984541 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:15:19.984749 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:15:19.984858 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:15:19.985352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('8', '-', '-', 0) found on session 158 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:15:19.985471 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:15:19.989879 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:20.002123 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 158 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:15:20.002344 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:15:20.007242 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65460bc1-e806-4467-85f5-7a559a39e36e (non-flash)
May 27 23:15:20.007242 np0000001565 nova-compute[98289]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:20.007242 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:20.007242 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:15:20.007383 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65460bc1-e806-4467-85f5-7a559a39e36e (non-flash)
May 27 23:15:20.007383 np0000001565 nova-compute[98289]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:20.007383 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:20.007383 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:15:20.007625 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:15:20.007731 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:15:20.008251 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('9', '-', '-', 0) found on session 159 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:15:20.008359 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:15:20.025498 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 159 and hctl ['9', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:15:20.231768 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.000496992000080354 future=<Future at 0x726e387954f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:20.231932 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:20.232173 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Emitting event <LifecycleEvent: 1779923705.231107, d15d35fb-589c-4ea2-8c94-9588bc66bec3 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:15:20.232366 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] VM Stopped (Lifecycle Event)
May 27 23:15:20.734985 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: d15d35fb-589c-4ea2-8c94-9588bc66bec3] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:20.748592 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:21.024009 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 159 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:15:21.024630 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:15:21.621538 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:21.866962 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Found WWN 3300000009829a6af for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:15:21.867323 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:15:21.868414 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== connect_volume: return (5086ms) {'type': 'block', 'scsi_wwn': '3300000009829a6af', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000009829a6af'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:15:21.868570 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009829a6af', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000009829a6af'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:15:22.033627 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '18597568-997d-4741-93f0-3fedfd98bb48', 'attached_at': '', 'detached_at': '', 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'serial': 'c26b60e7-4e67-438a-8114-15a648e57240'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:15:22.037124 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:15:22.037124 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:15:22.037124 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:15:22.037124 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x726e58603bc0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '18597568-997d-4741-93f0-3fedfd98bb48', 'attached_at': '', 'detached_at': '', 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'serial': 'c26b60e7-4e67-438a-8114-15a648e57240'} {{(pid=98289) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 23:15:22.037124 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98289) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 27 23:15:22.037124 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] opening encrypted volume /dev/dm-0 {{(pid=98289) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 27 23:15:22.070667 np0000001565 nova-compute[98289]: WARNING os_brick.encryptors.luks [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 23:15:22.070667 np0000001565 nova-compute[98289]: INFO os_brick.encryptors.luks [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] /dev/dm-0 is not a valid LUKS device; formatting device for first use
May 27 23:15:22.070667 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98289) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 27 23:15:24.176707 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:24.225170 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:25.750087 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:26.076582 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:29.234322 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:29.989257 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] opening encrypted volume /dev/dm-0 {{(pid=98289) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 27 23:15:30.154480 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "fa66e95f-2701-4fde-92d4-668f096aa9cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:30.154527 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:30.656521 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:15:30.751936 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:31.220489 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:31.220787 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:31.224814 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:15:31.225077 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Claim successful on node np0000001565
May 27 23:15:32.351961 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:15:32.352292 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:15:32.473592 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1420900408',display_name='tempest-TestVolumeBootPattern-server-1420900408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1420900408',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-hcpjqdb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:15:14Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=18597568-997d-4741-93f0-3fedfd98bb48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "address": "fa:16:3e:60:11:26", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd90c3db-dd", "ovs_interfaceid": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:15:32.473800 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "address": "fa:16:3e:60:11:26", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd90c3db-dd", "ovs_interfaceid": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:15:32.474410 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:11:26,bridge_name='br-int',has_traffic_filtering=True,id=bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd90c3db-dd') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:15:32.475212 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'pci_devices' on Instance uuid 18597568-997d-4741-93f0-3fedfd98bb48 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:15:32.855150 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:15:32.977535 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] End _get_guest_xml xml=<domain type="qemu">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <uuid>18597568-997d-4741-93f0-3fedfd98bb48</uuid>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <name>instance-0000003d</name>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPattern-server-1420900408</nova:name>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:15:16</nova:creationTime>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:properties/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:user uuid="31823a44e786429f80ba607958f8b63e">tempest-TestVolumeBootPattern-314561297-project-member</nova:user>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:project uuid="5dda425dab8946dc926808806eeedced">tempest-TestVolumeBootPattern-314561297</nova:project>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         <nova:port uuid="bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <system>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <entry name="serial">18597568-997d-4741-93f0-3fedfd98bb48</entry>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <entry name="uuid">18597568-997d-4741-93f0-3fedfd98bb48</entry>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     </system>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <os>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   </os>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <features>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   </features>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   <devices>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/18597568-997d-4741-93f0-3fedfd98bb48/disk.config"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     </disk>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <alias name="ua-c26b60e7-4e67-438a-8114-15a648e57240"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <serial>c26b60e7-4e67-438a-8114-15a648e57240</serial>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     </disk>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:60:11:26"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <target dev="tapbd90c3db-dd"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     </interface>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/18597568-997d-4741-93f0-3fedfd98bb48/console.log" append="off"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     </serial>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <video>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     </video>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     </rng>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:   </devices>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]: </domain>
May 27 23:15:32.977535 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Preparing to wait for external event network-vif-plugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "18597568-997d-4741-93f0-3fedfd98bb48-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1420900408',display_name='tempest-TestVolumeBootPattern-server-1420900408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1420900408',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-hcpjqdb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:15:14Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=18597568-997d-4741-93f0-3fedfd98bb48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "address": "fa:16:3e:60:11:26", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd90c3db-dd", "ovs_interfaceid": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "address": "fa:16:3e:60:11:26", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd90c3db-dd", "ovs_interfaceid": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:11:26,bridge_name='br-int',has_traffic_filtering=True,id=bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd90c3db-dd') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:11:26,bridge_name='br-int',has_traffic_filtering=True,id=bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd90c3db-dd') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:15:32.981219 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:32.981899 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ced9da21-2114-571b-bc9c-50a2e7f439cb', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:32.982461 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:32.983569 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:15:32.985194 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:32.985314 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd90c3db-dd, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:32.985610 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd90c3db-dd, col_values=(('qos', UUID('0ce37d4f-cb0e-4777-8c55-0b96baa18c11')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:32.985767 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd90c3db-dd, col_values=(('external_ids', {'iface-id': 'bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:11:26', 'vm-uuid': '18597568-997d-4741-93f0-3fedfd98bb48'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:32.987597 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:15:32.991538 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:32.992224 np0000001565 nova-compute[98289]: INFO os_vif [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:11:26,bridge_name='br-int',has_traffic_filtering=True,id=bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd90c3db-dd')
May 27 23:15:33.363467 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.143s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:33.364627 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:15:33.870009 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:15:33.870273 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:15:33.870886 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:33.871114 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:33.948375 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5afdb0f7fb014ac993fc36395de07be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d095aed76494dd7b4c64e9209c14483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:15:34.235307 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:34.373452 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:15:34.385858 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Successfully created port: eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:15:34.509726 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:15:34.509943 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:15:34.510094 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No VIF found with MAC fa:16:3e:60:11:26, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:15:34.510573 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Using config drive
May 27 23:15:34.878310 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:15:34.911253 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Successfully updated port: eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:15:34.953412 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d80f622c-bd10-4544-9352-c46437034e40 req-64f3d060-640b-4d97-82c3-7d9983b77361 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Received event network-changed-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:34.953853 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d80f622c-bd10-4544-9352-c46437034e40 req-64f3d060-640b-4d97-82c3-7d9983b77361 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Refreshing instance network info cache due to event network-changed-eaa7472e-c269-4bed-8789-3840483286fb. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:15:34.953983 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d80f622c-bd10-4544-9352-c46437034e40 req-64f3d060-640b-4d97-82c3-7d9983b77361 service nova] Acquiring lock "refresh_cache-fa66e95f-2701-4fde-92d4-668f096aa9cd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:15:34.954421 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d80f622c-bd10-4544-9352-c46437034e40 req-64f3d060-640b-4d97-82c3-7d9983b77361 service nova] Acquired lock "refresh_cache-fa66e95f-2701-4fde-92d4-668f096aa9cd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:15:34.954556 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d80f622c-bd10-4544-9352-c46437034e40 req-64f3d060-640b-4d97-82c3-7d9983b77361 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Refreshing network info cache for port eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:15:35.015680 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:35.135227 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Creating config drive at /opt/stack/data/nova/instances/18597568-997d-4741-93f0-3fedfd98bb48/disk.config
May 27 23:15:35.139440 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/18597568-997d-4741-93f0-3fedfd98bb48/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkgbu67g5 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:15:35.194230 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/18597568-997d-4741-93f0-3fedfd98bb48/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkgbu67g5" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:15:35.383221 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Booting with volume e5da58cd-548a-47f0-a634-b1a4c13695fa at /dev/vda
May 27 23:15:35.413500 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "refresh_cache-fa66e95f-2701-4fde-92d4-668f096aa9cd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:15:35.431786 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:15:35.444517 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:15:35.456612 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d80f622c-bd10-4544-9352-c46437034e40 req-64f3d060-640b-4d97-82c3-7d9983b77361 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:35.467200 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:15:35.516292 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:15:35.516562 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:15:35.524933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:15:35.525683 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43'] 
May 27 23:15:35.525810 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:15:35.525961 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:15:35.526190 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:15:35.526418 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Updating existing volume attachment record: e173c0ae-e086-4e2b-80fb-afd81dff7e60 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:15:35.541476 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d80f622c-bd10-4544-9352-c46437034e40 req-64f3d060-640b-4d97-82c3-7d9983b77361 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:15:35.619239 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:35.642559 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:35.645223 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:35.732747 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:35.735295 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:35.747733 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d80f622c-bd10-4544-9352-c46437034e40 req-64f3d060-640b-4d97-82c3-7d9983b77361 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:15:35.939745 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a56e53dc-f1a4-40fd-83a3-c2657a608ae1 req-5c9543a6-abc2-4007-a41e-01290d5806ea service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Received event network-vif-plugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:35.940012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a56e53dc-f1a4-40fd-83a3-c2657a608ae1 req-5c9543a6-abc2-4007-a41e-01290d5806ea service nova] Acquiring lock "18597568-997d-4741-93f0-3fedfd98bb48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:35.941229 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a56e53dc-f1a4-40fd-83a3-c2657a608ae1 req-5c9543a6-abc2-4007-a41e-01290d5806ea service nova] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:35.941419 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a56e53dc-f1a4-40fd-83a3-c2657a608ae1 req-5c9543a6-abc2-4007-a41e-01290d5806ea service nova] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:35.941534 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a56e53dc-f1a4-40fd-83a3-c2657a608ae1 req-5c9543a6-abc2-4007-a41e-01290d5806ea service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Processing event network-vif-plugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:15:35.943562 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:35.945906 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:35.947771 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:35.968074 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:36.252158 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d80f622c-bd10-4544-9352-c46437034e40 req-64f3d060-640b-4d97-82c3-7d9983b77361 service nova] Releasing lock "refresh_cache-fa66e95f-2701-4fde-92d4-668f096aa9cd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:15:36.252729 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquired lock "refresh_cache-fa66e95f-2701-4fde-92d4-668f096aa9cd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:15:36.252947 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:15:36.329278 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:15:36.331960 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923736.3315115, 18597568-997d-4741-93f0-3fedfd98bb48 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:15:36.332232 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] VM Started (Lifecycle Event)
May 27 23:15:36.336900 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:15:36.342324 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Instance spawned successfully.
May 27 23:15:36.342659 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:15:36.511174 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:36.839342 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:36.842242 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:15:36.849600 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:36.849760 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:36.850064 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:36.850302 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:36.850607 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:36.850869 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:36.870110 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:15:37.043715 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:37.226942 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Updating instance_info_cache with network_info: [{"id": "eaa7472e-c269-4bed-8789-3840483286fb", "address": "fa:16:3e:ce:a0:a4", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa7472e-c2", "ovs_interfaceid": "eaa7472e-c269-4bed-8789-3840483286fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:15:37.348068 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:15:37.348406 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923737.3481002, 18597568-997d-4741-93f0-3fedfd98bb48 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:15:37.348695 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] VM Paused (Lifecycle Event)
May 27 23:15:37.360528 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Took 20.60 seconds to spawn the instance on the hypervisor.
May 27 23:15:37.360895 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:37.629965 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:15:37.634858 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:15:37.635229 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Creating image(s)
May 27 23:15:37.635675 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:15:37.635863 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Ensure instance console log exists: /opt/stack/data/nova/instances/fa66e95f-2701-4fde-92d4-668f096aa9cd/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:15:37.636135 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:37.636860 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:37.637075 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:37.728627 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Releasing lock "refresh_cache-fa66e95f-2701-4fde-92d4-668f096aa9cd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:15:37.728931 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Instance network_info: |[{"id": "eaa7472e-c269-4bed-8789-3840483286fb", "address": "fa:16:3e:ce:a0:a4", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa7472e-c2", "ovs_interfaceid": "eaa7472e-c269-4bed-8789-3840483286fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:15:37.729920 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Start _get_guest_xml network_info=[{"id": "eaa7472e-c269-4bed-8789-3840483286fb", "address": "fa:16:3e:ce:a0:a4", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa7472e-c2", "ovs_interfaceid": "eaa7472e-c269-4bed-8789-3840483286fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e173c0ae-e086-4e2b-80fb-afd81dff7e60', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e5da58cd-548a-47f0-a634-b1a4c13695fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fa66e95f-2701-4fde-92d4-668f096aa9cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5da58cd-548a-47f0-a634-b1a4c13695fa', 'serial': 'e5da58cd-548a-47f0-a634-b1a4c13695fa'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:15:37.738826 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:15:37.738826 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-798326639', uuid='fa66e95f-2701-4fde-92d4-668f096aa9cd'), owner=OwnerMeta(userid='5afdb0f7fb014ac993fc36395de07be6', username='tempest-TestVolumeBootPatternV346-405934088-project-member', projectid='0d095aed76494dd7b4c64e9209c14483', projectname='tempest-TestVolumeBootPatternV346-405934088'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eaa7472e-c269-4bed-8789-3840483286fb", "address": "fa:16:3e:ce:a0:a4", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa7472e-c2", "ovs_interfaceid": "eaa7472e-c269-4bed-8789-3840483286fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923737.738146) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:15:37.739772 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:15:37.740151 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:15:37.741122 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:15:37.741392 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:15:37.742464 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:15:37.742875 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:15:37.743170 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:15:37.743380 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:15:37.743600 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:15:37.743806 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:15:37.744027 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:15:37.744540 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:15:37.744757 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:15:37.744995 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:15:37.745211 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:15:37.748350 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:15:37.760625 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:15:37.761046 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e5da58cd-548a-47f0-a634-b1a4c13695fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:15:37.761258 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:15:37.761717 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:15:37.761974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e5da58cd-548a-47f0-a634-b1a4c13695fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:15:37.774416 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:15:37.774924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:15:37.775096 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:15:37.775474 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:15:37.778458 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:15:37.778458 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:15:37.788944 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:15:37.788944 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:37.793864 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:15:37.793864 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:37.802099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa] added
May 27 23:15:37.802099 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:15:37.802099 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:37.802099 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:37.802099 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:37.802099 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:37.802099 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:37.802099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:15:37.802099 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:15:37.802452 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:15:37.806237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa] added
May 27 23:15:37.806237 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:15:37.806237 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:37.806237 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:37.806237 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:37.806237 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:37.806237 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:37.806438 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:15:37.806594 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:15:37.806750 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:15:37.852217 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:37.854804 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923737.8545065, 18597568-997d-4741-93f0-3fedfd98bb48 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:15:37.854955 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] VM Resumed (Lifecycle Event)
May 27 23:15:37.871007 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Took 27.51 seconds to build instance.
May 27 23:15:37.995221 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:38.018038 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-61622da5-39e0-49d6-9f85-2cf9a9417207 req-364167bf-792b-4873-8bc6-da549bb5c197 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Received event network-vif-plugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:38.018239 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-61622da5-39e0-49d6-9f85-2cf9a9417207 req-364167bf-792b-4873-8bc6-da549bb5c197 service nova] Acquiring lock "18597568-997d-4741-93f0-3fedfd98bb48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:38.019592 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-61622da5-39e0-49d6-9f85-2cf9a9417207 req-364167bf-792b-4873-8bc6-da549bb5c197 service nova] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:38.019592 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-61622da5-39e0-49d6-9f85-2cf9a9417207 req-364167bf-792b-4873-8bc6-da549bb5c197 service nova] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:38.019592 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-61622da5-39e0-49d6-9f85-2cf9a9417207 req-364167bf-792b-4873-8bc6-da549bb5c197 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] No waiting events found dispatching network-vif-plugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:15:38.019592 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-61622da5-39e0-49d6-9f85-2cf9a9417207 req-364167bf-792b-4873-8bc6-da549bb5c197 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Received unexpected event network-vif-plugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 for instance with vm_state active and task_state None.
May 27 23:15:38.119281 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:38.359541 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:38.361214 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:15:38.373668 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6ea90a58-49bd-4bae-8e8f-40f2a1b28a18 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "18597568-997d-4741-93f0-3fedfd98bb48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.027s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:38.785809 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "18597568-997d-4741-93f0-3fedfd98bb48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:38.786303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "18597568-997d-4741-93f0-3fedfd98bb48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:38.786303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "18597568-997d-4741-93f0-3fedfd98bb48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:38.786303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:38.786438 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:38.788165 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Terminating instance
May 27 23:15:38.802843 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:15:38.807038 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:15:38.815901 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:15:38.815901 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:15:38.817924 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:15:38.817924 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:38.828325 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:38.832630 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:38.840361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.840361 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.840361 np0000001565 nova-compute[98289]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2edbbce9-bfc0-476f-99d0-8a747bc66277 (non-flash)
May 27 23:15:38.840361 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:15:38.841036 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.841036 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.841036 np0000001565 nova-compute[98289]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2edbbce9-bfc0-476f-99d0-8a747bc66277 (non-flash)
May 27 23:15:38.841036 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:15:38.845530 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.845530 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.845530 np0000001565 nova-compute[98289]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2edbbce9-bfc0-476f-99d0-8a747bc66277 (non-flash)
May 27 23:15:38.845530 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:15:38.845642 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.845642 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.845642 np0000001565 nova-compute[98289]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2edbbce9-bfc0-476f-99d0-8a747bc66277 (non-flash)
May 27 23:15:38.845642 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:15:38.863407 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] During sync_power_state the instance has a pending task (deleting). Skip.
May 27 23:15:38.871481 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa, portal: 192.168.40.100,3260]
May 27 23:15:38.871481 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa, portal: 192.168.40.100,3260] successful.
May 27 23:15:38.871481 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:38.881890 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:38.891702 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa, portal: 192.168.50.100,3260]
May 27 23:15:38.891702 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa, portal: 192.168.50.100,3260] successful.
May 27 23:15:38.891702 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:38.895840 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.895840 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.895840 np0000001565 nova-compute[98289]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2edbbce9-bfc0-476f-99d0-8a747bc66277 (non-flash)
May 27 23:15:38.895840 np0000001565 nova-compute[98289]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:38.895840 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:38.895840 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:15:38.896061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.896061 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.896061 np0000001565 nova-compute[98289]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2edbbce9-bfc0-476f-99d0-8a747bc66277 (non-flash)
May 27 23:15:38.896061 np0000001565 nova-compute[98289]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:38.896061 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:38.896061 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:15:38.896176 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.121s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:15:38.896231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:15:38.896957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] HCTL ('10', '-', '-', 0) found on session 161 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:15:38.897060 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:15:38.902285 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:38.914321 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching for a device in session 161 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:15:38.914528 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e5da58cd-548a-47f0-a634-b1a4c13695fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:15:38.917761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.917761 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.917761 np0000001565 nova-compute[98289]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2edbbce9-bfc0-476f-99d0-8a747bc66277 (non-flash)
May 27 23:15:38.917761 np0000001565 nova-compute[98289]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:38.917761 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:38.917761 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:15:38.917922 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.917922 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:38.917922 np0000001565 nova-compute[98289]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2edbbce9-bfc0-476f-99d0-8a747bc66277 (non-flash)
May 27 23:15:38.917922 np0000001565 nova-compute[98289]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:38.917922 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:38.917922 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:15:38.918166 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:15:38.918280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:15:38.918923 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] HCTL ('11', '-', '-', 0) found on session 162 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:15:38.919023 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:15:38.932566 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching for a device in session 162 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:15:38.932720 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e5da58cd-548a-47f0-a634-b1a4c13695fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:15:39.238287 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:39.290839 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:15:39.304542 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:39.307502 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:39.329692 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:39.331882 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:39.353997 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:39.613445 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999617322000177 future=<Future at 0x726e387eb470 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:39.614192 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998980121000386 future=<Future at 0x726e387eb470 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:39.614192 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998864109000351 future=<Future at 0x726e387eb470 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:39.616399 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Instance destroyed successfully.
May 27 23:15:39.617324 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'resources' on Instance uuid 18597568-997d-4741-93f0-3fedfd98bb48 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:15:39.776443 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:15:40.096026 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Received event network-vif-unplugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:40.096506 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] Acquiring lock "18597568-997d-4741-93f0-3fedfd98bb48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:40.096506 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:40.096600 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:40.096735 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] No waiting events found dispatching network-vif-unplugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:15:40.096872 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Received event network-vif-unplugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:15:40.096975 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Received event network-vif-unplugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:40.097557 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] Acquiring lock "18597568-997d-4741-93f0-3fedfd98bb48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:40.097734 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:40.097853 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] Lock "18597568-997d-4741-93f0-3fedfd98bb48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:40.097962 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] No waiting events found dispatching network-vif-unplugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:15:40.098063 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-727673c0-4ba3-47a3-be77-a1b3ae2f7988 req-d2d01ecd-7fe7-4f50-aa5d-bf753bd4c301 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Received event network-vif-unplugged-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:15:40.121564 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1420900408',display_name='tempest-TestVolumeBootPattern-server-1420900408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1420900408',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:15:37Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-hcpjqdb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:15:37Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=18597568-997d-4741-93f0-3fedfd98bb48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "address": "fa:16:3e:60:11:26", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd90c3db-dd", "ovs_interfaceid": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:15:40.121745 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "address": "fa:16:3e:60:11:26", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd90c3db-dd", "ovs_interfaceid": "bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:15:40.122215 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:11:26,bridge_name='br-int',has_traffic_filtering=True,id=bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd90c3db-dd') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:15:40.122499 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:11:26,bridge_name='br-int',has_traffic_filtering=True,id=bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd90c3db-dd') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:15:40.123683 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:40.123873 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd90c3db-dd, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:40.124784 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:40.125484 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:15:40.126124 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:40.126682 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:40.126821 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ce37d4f-cb0e-4777-8c55-0b96baa18c11) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:40.127203 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:40.127734 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:15:40.128551 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:40.130105 np0000001565 nova-compute[98289]: INFO os_vif [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:11:26,bridge_name='br-int',has_traffic_filtering=True,id=bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd90c3db-dd')
May 27 23:15:40.158482 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '18597568-997d-4741-93f0-3fedfd98bb48', 'attached_at': '', 'detached_at': '', 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'serial': 'c26b60e7-4e67-438a-8114-15a648e57240'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:15:40.158939 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:15:40.159129 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:15:40.159270 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:15:40.159829 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x726e581acb30>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '18597568-997d-4741-93f0-3fedfd98bb48', 'attached_at': '', 'detached_at': '', 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'serial': 'c26b60e7-4e67-438a-8114-15a648e57240'} {{(pid=98289) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 23:15:40.159948 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] closing encrypted volume /dev/dm-1 {{(pid=98289) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 27 23:15:40.187930 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:15:40.188159 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:15:40.188372 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:15:40.791808 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Found WWN 33000000028294696 for multipath device dm-2 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:15:40.792154 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:15:40.792601 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '33000000028294696', 'path': '/dev/dm-2', 'multipath_id': '33000000028294696'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:15:40.792801 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000028294696', 'path': '/dev/dm-2', 'multipath_id': '33000000028294696'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:15:40.793237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.605s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:15:40.793760 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c26b60e7-4e67-438a-8114-15a648e57240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:15:40.793965 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:15:40.826099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:40.826099 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:40.826099 np0000001565 nova-compute[98289]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2edbbce9-bfc0-476f-99d0-8a747bc66277 (non-flash)
May 27 23:15:40.826099 np0000001565 nova-compute[98289]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:40.826099 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:40.826099 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:15:40.826099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:40.826099 np0000001565 nova-compute[98289]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240 (non-flash)
May 27 23:15:40.826099 np0000001565 nova-compute[98289]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2edbbce9-bfc0-476f-99d0-8a747bc66277 (non-flash)
May 27 23:15:40.826099 np0000001565 nova-compute[98289]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:40.826099 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:15:40.826099 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:15:40.826687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', '159'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2edbbce9-bfc0-476f-99d0-8a747bc66277', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '162')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:15:40.826687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', '158')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:15:40.827441 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240', '159')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:15:40.828486 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e38708400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'): ({'sdd'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:15:40.828717 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Removing multipathed devices sdd, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:15:40.828969 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flush multipath device 3300000009829a6af {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:15:40.856761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:15:40.909829 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:15:40.955677 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:15:40.955851 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:15:40.956940 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:15:40.966931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:15:40.967160 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:15:40.980358 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:41.016191 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240, portal: 192.168.40.100,3260]
May 27 23:15:41.016191 np0000001565 nova-compute[98289]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240, portal: 192.168.40.100,3260] successful.
May 27 23:15:41.016191 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:41.029049 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:41.040638 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:41.073225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 159, target: iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240, portal: 192.168.50.100,3260]
May 27 23:15:41.073225 np0000001565 nova-compute[98289]: Logout of [sid: 159, target: iqn.2023-03.storpool.com:os--volume-c26b60e7-4e67-438a-8114-15a648e57240, portal: 192.168.50.100,3260] successful.
May 27 23:15:41.073225 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:41.089912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:41.095284 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:15:41.095465 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== disconnect_volume: return (906ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:15:41.095836 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:15:41.095999 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Deleting instance files /opt/stack/data/nova/instances/18597568-997d-4741-93f0-3fedfd98bb48_del
May 27 23:15:41.096578 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Deletion of /opt/stack/data/nova/instances/18597568-997d-4741-93f0-3fedfd98bb48_del complete
May 27 23:15:41.112962 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:41.301391 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-798326639',display_name='tempest-TestVolumeBootPatternV346-server-798326639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpatternv346-server-798326639',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaBevHOiNzMnLmMQNtJg/gbb7w9qhm2+awRSKgLI7QrEhHZBTl9koFvLcl68fqfetWyuyKaN5Wffj9Rb9hYScC29BJOU8w1rq0RRO0dKrrjN/ik22t7zOhqpvbKpDei7Q==',key_name='tempest-keypair-729427564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d095aed76494dd7b4c64e9209c14483',ramdisk_id='',reservation_id='r-ugs9yon5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-405934088',owner_user_name='tempest-TestVolumeBootPatternV346-405934088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afdb0f7fb014ac993fc36395de07be6',uuid=fa66e95f-2701-4fde-92d4-668f096aa9cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaa7472e-c269-4bed-8789-3840483286fb", "address": "fa:16:3e:ce:a0:a4", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa7472e-c2", "ovs_interfaceid": "eaa7472e-c269-4bed-8789-3840483286fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:15:41.301662 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converting VIF {"id": "eaa7472e-c269-4bed-8789-3840483286fb", "address": "fa:16:3e:ce:a0:a4", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa7472e-c2", "ovs_interfaceid": "eaa7472e-c269-4bed-8789-3840483286fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:15:41.302327 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a0:a4,bridge_name='br-int',has_traffic_filtering=True,id=eaa7472e-c269-4bed-8789-3840483286fb,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa7472e-c2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:15:41.303510 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lazy-loading 'pci_devices' on Instance uuid fa66e95f-2701-4fde-92d4-668f096aa9cd {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:15:41.608137 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Took 2.32 seconds to destroy the instance on the hypervisor.
May 27 23:15:41.608762 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:15:41.609090 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:15:41.609202 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:15:41.609772 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:41.738618 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:41.806684 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] End _get_guest_xml xml=<domain type="qemu">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <uuid>fa66e95f-2701-4fde-92d4-668f096aa9cd</uuid>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <name>instance-0000003e</name>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPatternV346-server-798326639</nova:name>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:15:37</nova:creationTime>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:user uuid="5afdb0f7fb014ac993fc36395de07be6">tempest-TestVolumeBootPatternV346-405934088-project-member</nova:user>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:project uuid="0d095aed76494dd7b4c64e9209c14483">tempest-TestVolumeBootPatternV346-405934088</nova:project>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         <nova:port uuid="eaa7472e-c269-4bed-8789-3840483286fb">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <system>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <entry name="serial">fa66e95f-2701-4fde-92d4-668f096aa9cd</entry>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <entry name="uuid">fa66e95f-2701-4fde-92d4-668f096aa9cd</entry>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     </system>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <os>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   </os>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <features>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   </features>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   <devices>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/fa66e95f-2701-4fde-92d4-668f096aa9cd/disk.config"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     </disk>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <alias name="ua-e5da58cd-548a-47f0-a634-b1a4c13695fa"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-2"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <serial>e5da58cd-548a-47f0-a634-b1a4c13695fa</serial>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     </disk>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ce:a0:a4"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <target dev="tapeaa7472e-c2"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     </interface>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/fa66e95f-2701-4fde-92d4-668f096aa9cd/console.log" append="off"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     </serial>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <video>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     </video>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     </rng>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:   </devices>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]: </domain>
May 27 23:15:41.806684 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:15:41.808640 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Preparing to wait for external event network-vif-plugged-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:15:41.808640 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:41.808640 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:41.808640 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:41.808640 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-798326639',display_name='tempest-TestVolumeBootPatternV346-server-798326639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpatternv346-server-798326639',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaBevHOiNzMnLmMQNtJg/gbb7w9qhm2+awRSKgLI7QrEhHZBTl9koFvLcl68fqfetWyuyKaN5Wffj9Rb9hYScC29BJOU8w1rq0RRO0dKrrjN/ik22t7zOhqpvbKpDei7Q==',key_name='tempest-keypair-729427564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d095aed76494dd7b4c64e9209c14483',ramdisk_id='',reservation_id='r-ugs9yon5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-405934088',owner_user_name='tempest-TestVolumeBootPatternV346-405934088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afdb0f7fb014ac993fc36395de07be6',uuid=fa66e95f-2701-4fde-92d4-668f096aa9cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaa7472e-c269-4bed-8789-3840483286fb", "address": "fa:16:3e:ce:a0:a4", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa7472e-c2", "ovs_interfaceid": "eaa7472e-c269-4bed-8789-3840483286fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:15:41.808640 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converting VIF {"id": "eaa7472e-c269-4bed-8789-3840483286fb", "address": "fa:16:3e:ce:a0:a4", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa7472e-c2", "ovs_interfaceid": "eaa7472e-c269-4bed-8789-3840483286fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:15:41.808640 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a0:a4,bridge_name='br-int',has_traffic_filtering=True,id=eaa7472e-c269-4bed-8789-3840483286fb,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa7472e-c2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:15:41.808640 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a0:a4,bridge_name='br-int',has_traffic_filtering=True,id=eaa7472e-c269-4bed-8789-3840483286fb,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa7472e-c2') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:15:41.811591 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:41.811831 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:41.812088 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:15:41.812710 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:41.812946 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff177297-8918-5aff-8647-ac2b038a9a60', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:41.815988 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:15:41.819473 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:41.819653 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaa7472e-c2, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:41.819980 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeaa7472e-c2, col_values=(('qos', UUID('3785fef5-0406-4177-b783-084840ce6864')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:41.820195 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeaa7472e-c2, col_values=(('external_ids', {'iface-id': 'eaa7472e-c269-4bed-8789-3840483286fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:a0:a4', 'vm-uuid': 'fa66e95f-2701-4fde-92d4-668f096aa9cd'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:15:41.820982 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:41.823719 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:15:41.828440 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:41.829376 np0000001565 nova-compute[98289]: INFO os_vif [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a0:a4,bridge_name='br-int',has_traffic_filtering=True,id=eaa7472e-c269-4bed-8789-3840483286fb,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa7472e-c2')
May 27 23:15:42.205210 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e8dca2fd-2a88-4035-8a27-3d70f1803d5e req-bd50327e-9c02-45e1-897f-0e0f9a9ea528 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Received event network-vif-deleted-bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:42.205621 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-e8dca2fd-2a88-4035-8a27-3d70f1803d5e req-bd50327e-9c02-45e1-897f-0e0f9a9ea528 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Neutron deleted interface bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2; detaching it from the instance and deleting it from the info cache
May 27 23:15:42.206830 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e8dca2fd-2a88-4035-8a27-3d70f1803d5e req-bd50327e-9c02-45e1-897f-0e0f9a9ea528 service nova] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Detach interface failed, port_id=bd90c3db-dd2d-4137-8f80-3e5a7fbc5eb2, reason: Instance 18597568-997d-4741-93f0-3fedfd98bb48 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:15:42.637010 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:42.653638 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:15:43.155457 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Took 1.55 seconds to deallocate network for instance.
May 27 23:15:43.352201 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:15:43.352646 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:15:43.352646 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] No VIF found with MAC fa:16:3e:ce:a0:a4, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:15:43.353003 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Using config drive
May 27 23:15:43.703912 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Took 0.55 seconds to detach 1 volumes for instance.
May 27 23:15:43.860004 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:43.962290 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Creating config drive at /opt/stack/data/nova/instances/fa66e95f-2701-4fde-92d4-668f096aa9cd/disk.config
May 27 23:15:43.966073 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fa66e95f-2701-4fde-92d4-668f096aa9cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2hdyhp87 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:15:44.021685 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fa66e95f-2701-4fde-92d4-668f096aa9cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2hdyhp87" returned: 0 in 0.055s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:15:44.210710 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:44.210843 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:44.245310 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:44.347582 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:15:44.348456 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:15:44.429391 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:44.465650 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:44.555542 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:44.561535 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:44.638531 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-59203583-b6b1-4f2b-91d9-0a12a5f6096e req-e47fdefd-00c5-4436-868d-b9d4c17b9a34 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Received event network-vif-plugged-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:44.638876 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-59203583-b6b1-4f2b-91d9-0a12a5f6096e req-e47fdefd-00c5-4436-868d-b9d4c17b9a34 service nova] Acquiring lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:44.639009 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-59203583-b6b1-4f2b-91d9-0a12a5f6096e req-e47fdefd-00c5-4436-868d-b9d4c17b9a34 service nova] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:44.639146 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-59203583-b6b1-4f2b-91d9-0a12a5f6096e req-e47fdefd-00c5-4436-868d-b9d4c17b9a34 service nova] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:44.639339 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-59203583-b6b1-4f2b-91d9-0a12a5f6096e req-e47fdefd-00c5-4436-868d-b9d4c17b9a34 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Processing event network-vif-plugged-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:15:44.800013 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:44.804299 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:44.805106 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:44.823095 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:44.857684 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:15:45.210513 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923745.2100625, fa66e95f-2701-4fde-92d4-668f096aa9cd => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:15:45.210678 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] VM Started (Lifecycle Event)
May 27 23:15:45.212881 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:15:45.215047 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:15:45.218355 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Instance spawned successfully.
May 27 23:15:45.218721 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:15:45.364303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.153s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:45.419598 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deleted allocations for instance 18597568-997d-4741-93f0-3fedfd98bb48
May 27 23:15:45.714026 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:45.716149 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:15:45.725564 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:45.725714 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:45.725961 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:45.726155 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:45.726444 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:45.726704 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:15:46.218725 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:15:46.220002 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923746.2189004, fa66e95f-2701-4fde-92d4-668f096aa9cd => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:15:46.220002 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] VM Paused (Lifecycle Event)
May 27 23:15:46.231258 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Took 8.60 seconds to spawn the instance on the hypervisor.
May 27 23:15:46.231434 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:46.430804 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6299d3cf-f4a7-4287-ae9b-2b43d769948d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "18597568-997d-4741-93f0-3fedfd98bb48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.645s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:46.715240 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-19fcba8f-645c-4fde-a542-53c10ddb2115 req-20b3dbc0-0044-4670-863b-93f925362c16 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Received event network-vif-plugged-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:46.715627 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-19fcba8f-645c-4fde-a542-53c10ddb2115 req-20b3dbc0-0044-4670-863b-93f925362c16 service nova] Acquiring lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:46.715627 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-19fcba8f-645c-4fde-a542-53c10ddb2115 req-20b3dbc0-0044-4670-863b-93f925362c16 service nova] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:46.715702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-19fcba8f-645c-4fde-a542-53c10ddb2115 req-20b3dbc0-0044-4670-863b-93f925362c16 service nova] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:46.715754 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-19fcba8f-645c-4fde-a542-53c10ddb2115 req-20b3dbc0-0044-4670-863b-93f925362c16 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] No waiting events found dispatching network-vif-plugged-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:15:46.715862 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-19fcba8f-645c-4fde-a542-53c10ddb2115 req-20b3dbc0-0044-4670-863b-93f925362c16 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Received unexpected event network-vif-plugged-eaa7472e-c269-4bed-8789-3840483286fb for instance with vm_state active and task_state None.
May 27 23:15:46.727219 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:46.728933 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923746.7282426, fa66e95f-2701-4fde-92d4-668f096aa9cd => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:15:46.728933 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] VM Resumed (Lifecycle Event)
May 27 23:15:46.741443 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Took 15.58 seconds to build instance.
May 27 23:15:46.832941 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:47.231816 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:47.239692 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:15:47.242996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.088s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:48.124363 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:15:48.630496 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:48.630700 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:48.630854 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:48.631015 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:15:48.778244 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c3dae0ff-a490-4172-9616-720c3ed78c41 req-d18c0322-2d1c-4065-bc9d-dccc9cd6459f service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Received event network-changed-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:48.778372 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c3dae0ff-a490-4172-9616-720c3ed78c41 req-d18c0322-2d1c-4065-bc9d-dccc9cd6459f service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Refreshing instance network info cache due to event network-changed-eaa7472e-c269-4bed-8789-3840483286fb. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:15:48.778548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c3dae0ff-a490-4172-9616-720c3ed78c41 req-d18c0322-2d1c-4065-bc9d-dccc9cd6459f service nova] Acquiring lock "refresh_cache-fa66e95f-2701-4fde-92d4-668f096aa9cd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:15:48.778664 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c3dae0ff-a490-4172-9616-720c3ed78c41 req-d18c0322-2d1c-4065-bc9d-dccc9cd6459f service nova] Acquired lock "refresh_cache-fa66e95f-2701-4fde-92d4-668f096aa9cd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:15:48.779318 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c3dae0ff-a490-4172-9616-720c3ed78c41 req-d18c0322-2d1c-4065-bc9d-dccc9cd6459f service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Refreshing network info cache for port eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:15:49.246658 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:49.281306 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-c3dae0ff-a490-4172-9616-720c3ed78c41 req-d18c0322-2d1c-4065-bc9d-dccc9cd6459f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:49.597632 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-c3dae0ff-a490-4172-9616-720c3ed78c41 req-d18c0322-2d1c-4065-bc9d-dccc9cd6459f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:49.650303 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:15:49.652451 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:15:49.653367 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:15:49.698284 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:15:49.698994 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13485MB free_disk=72.82641220092773GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:15:49.699726 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:49.700019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:49.761745 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c3dae0ff-a490-4172-9616-720c3ed78c41 req-d18c0322-2d1c-4065-bc9d-dccc9cd6459f service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Updated VIF entry in instance network info cache for port eaa7472e-c269-4bed-8789-3840483286fb. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:15:49.762083 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c3dae0ff-a490-4172-9616-720c3ed78c41 req-d18c0322-2d1c-4065-bc9d-dccc9cd6459f service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Updating instance_info_cache with network_info: [{"id": "eaa7472e-c269-4bed-8789-3840483286fb", "address": "fa:16:3e:ce:a0:a4", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa7472e-c2", "ovs_interfaceid": "eaa7472e-c269-4bed-8789-3840483286fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:15:50.264165 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c3dae0ff-a490-4172-9616-720c3ed78c41 req-d18c0322-2d1c-4065-bc9d-dccc9cd6459f service nova] Releasing lock "refresh_cache-fa66e95f-2701-4fde-92d4-668f096aa9cd" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:15:50.779039 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance fa66e95f-2701-4fde-92d4-668f096aa9cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:15:50.779213 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:15:50.779347 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:15:49 up 44 min,  2 users,  load average: 3.34, 4.71, 4.22\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_0d095aed76494dd7b4c64e9209c14483': '1', 'io_workload': '0'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:15:50.884232 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:15:50.884232 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:15:51.307712 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "6db5e829-7198-437f-885e-7afcda6ded06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:51.308068 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "6db5e829-7198-437f-885e-7afcda6ded06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:51.388349 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:15:51.810147 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:15:51.842879 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:51.892754 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:15:51.892939 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.193s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:51.893412 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 11.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:15:52.370562 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:52.370948 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:52.374135 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:15:52.374353 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Claim successful on node np0000001565
May 27 23:15:53.546761 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:15:53.547158 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:15:54.049301 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:15:54.248465 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:54.555719 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.185s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:54.556158 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:15:54.613375 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00033236099989153445 future=<Future at 0x726e387eb470 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:54.613474 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:15:54.613739 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Emitting event <LifecycleEvent: 1779923739.6129293, 18597568-997d-4741-93f0-3fedfd98bb48 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:15:54.613867 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] VM Stopped (Lifecycle Event)
May 27 23:15:55.067149 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:15:55.067149 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:15:55.067149 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:55.067149 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:55.116286 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-57cd7630-a806-4c7f-8147-038f1a7860a7 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: 18597568-997d-4741-93f0-3fedfd98bb48] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:15:55.149244 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31823a44e786429f80ba607958f8b63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda425dab8946dc926808806eeedced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:15:55.569552 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:15:55.709678 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Successfully created port: 31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:15:56.076487 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:15:56.232126 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Successfully updated port: 31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:15:56.377057 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a5ebe9ef-0928-4e5f-b2c8-927f4fe9d946 req-d8e994df-da7a-4e32-8243-89e1a3d27250 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Received event network-changed-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:15:56.377057 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a5ebe9ef-0928-4e5f-b2c8-927f4fe9d946 req-d8e994df-da7a-4e32-8243-89e1a3d27250 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Refreshing instance network info cache due to event network-changed-31d06057-37c3-493d-988a-26e88ad43978. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:15:56.377057 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a5ebe9ef-0928-4e5f-b2c8-927f4fe9d946 req-d8e994df-da7a-4e32-8243-89e1a3d27250 service nova] Acquiring lock "refresh_cache-6db5e829-7198-437f-885e-7afcda6ded06" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:15:56.377182 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a5ebe9ef-0928-4e5f-b2c8-927f4fe9d946 req-d8e994df-da7a-4e32-8243-89e1a3d27250 service nova] Acquired lock "refresh_cache-6db5e829-7198-437f-885e-7afcda6ded06" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:15:56.377310 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a5ebe9ef-0928-4e5f-b2c8-927f4fe9d946 req-d8e994df-da7a-4e32-8243-89e1a3d27250 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Refreshing network info cache for port 31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:15:56.581246 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Booting with volume 3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 at /dev/vda
May 27 23:15:56.615787 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:15:56.630982 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:15:56.651212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:15:56.695777 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:15:56.696044 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:15:56.704405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:15:56.705300 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fece:a0a4', 'fe80::dcaa:c7ff:fef8:d23c'] 
May 27 23:15:56.705444 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:15:56.705572 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:15:56.705821 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:15:56.706037 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Updating existing volume attachment record: 86652f0b-fbfa-4555-ae90-b5539e80db99 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:15:56.735074 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "refresh_cache-6db5e829-7198-437f-885e-7afcda6ded06" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:15:56.852479 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:56.882173 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-a5ebe9ef-0928-4e5f-b2c8-927f4fe9d946 req-d8e994df-da7a-4e32-8243-89e1a3d27250 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:56.952438 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a5ebe9ef-0928-4e5f-b2c8-927f4fe9d946 req-d8e994df-da7a-4e32-8243-89e1a3d27250 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:15:57.089176 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-a5ebe9ef-0928-4e5f-b2c8-927f4fe9d946 req-d8e994df-da7a-4e32-8243-89e1a3d27250 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:15:57.334632 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:57.334804 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:57.591306 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a5ebe9ef-0928-4e5f-b2c8-927f4fe9d946 req-d8e994df-da7a-4e32-8243-89e1a3d27250 service nova] Releasing lock "refresh_cache-6db5e829-7198-437f-885e-7afcda6ded06" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:15:57.591715 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquired lock "refresh_cache-6db5e829-7198-437f-885e-7afcda6ded06" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:15:57.591811 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:15:57.836546 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:15:58.148213 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:15:58.292732 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:15:58.393565 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:58.393930 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:58.397912 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:15:58.398054 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Claim successful on node np0000001565
May 27 23:15:58.429700 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Updating instance_info_cache with network_info: [{"id": "31d06057-37c3-493d-988a-26e88ad43978", "address": "fa:16:3e:30:f1:2b", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d06057-37", "ovs_interfaceid": "31d06057-37c3-493d-988a-26e88ad43978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:15:58.814381 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:15:58.814381 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:15:58.815174 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Creating image(s)
May 27 23:15:58.815174 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:15:58.815174 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Ensure instance console log exists: /opt/stack/data/nova/instances/6db5e829-7198-437f-885e-7afcda6ded06/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:15:58.815357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:15:58.815657 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:15:58.815839 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:15:58.931753 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Releasing lock "refresh_cache-6db5e829-7198-437f-885e-7afcda6ded06" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:15:58.931983 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Instance network_info: |[{"id": "31d06057-37c3-493d-988a-26e88ad43978", "address": "fa:16:3e:30:f1:2b", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d06057-37", "ovs_interfaceid": "31d06057-37c3-493d-988a-26e88ad43978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:15:58.932563 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Start _get_guest_xml network_info=[{"id": "31d06057-37c3-493d-988a-26e88ad43978", "address": "fa:16:3e:30:f1:2b", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d06057-37", "ovs_interfaceid": "31d06057-37c3-493d-988a-26e88ad43978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '86652f0b-fbfa-4555-ae90-b5539e80db99', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6db5e829-7198-437f-885e-7afcda6ded06', 'attached_at': '', 'detached_at': '', 'volume_id': '3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'serial': '3ca0f3e3-2af9-47b6-b667-28dc7ce730c2'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:15:58.935022 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:15:58.935993 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-463731406', uuid='6db5e829-7198-437f-885e-7afcda6ded06'), owner=OwnerMeta(userid='31823a44e786429f80ba607958f8b63e', username='tempest-TestVolumeBootPattern-314561297-project-member', projectid='5dda425dab8946dc926808806eeedced', projectname='tempest-TestVolumeBootPattern-314561297'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "31d06057-37c3-493d-988a-26e88ad43978", "address": "fa:16:3e:30:f1:2b", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d06057-37", "ovs_interfaceid": "31d06057-37c3-493d-988a-26e88ad43978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923758.9357061) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:15:58.937130 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:15:58.937528 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:15:58.938609 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:15:58.939036 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:15:58.939988 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:15:58.940326 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:15:58.940539 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:15:58.940671 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:15:58.940858 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:15:58.940996 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:15:58.941133 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:15:58.941319 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:15:58.941609 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:15:58.941778 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:15:58.941915 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:15:58.942071 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:15:58.952604 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:15:58.952966 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:15:58.953164 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:15:58.953654 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:15:58.953893 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:15:58.967587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:15:58.968247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:15:58.968872 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:15:58.969143 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:15:58.971606 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:15:58.971606 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:15:58.980368 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:15:58.980368 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:58.988162 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:15:58.988162 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:58.995893 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2] added
May 27 23:15:58.995893 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:15:58.995893 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:58.995893 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:58.995893 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:58.995893 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:58.995893 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:58.996157 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:15:58.996213 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:15:58.996346 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:15:59.000734 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2] added
May 27 23:15:59.000734 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:15:59.000734 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:59.000734 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:59.000734 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:15:59.000734 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:15:59.000734 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:15:59.001005 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:15:59.001005 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:15:59.001115 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:15:59.263571 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:15:59.567719 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:15:59.567918 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:15:59.996750 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:16:00.001372 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:16:00.006860 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:16:00.006860 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:16:00.014257 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:16:00.014257 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:00.020910 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:00.029061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:00.033281 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.033281 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.033281 np0000001565 nova-compute[98289]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af7b8a4a-25fa-4960-81f6-ada1d7eac621 (non-flash)
May 27 23:16:00.033281 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:00.033435 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.033435 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.033435 np0000001565 nova-compute[98289]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af7b8a4a-25fa-4960-81f6-ada1d7eac621 (non-flash)
May 27 23:16:00.033435 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:00.041656 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.041656 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.041656 np0000001565 nova-compute[98289]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af7b8a4a-25fa-4960-81f6-ada1d7eac621 (non-flash)
May 27 23:16:00.041656 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:00.041767 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.041767 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.041767 np0000001565 nova-compute[98289]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af7b8a4a-25fa-4960-81f6-ada1d7eac621 (non-flash)
May 27 23:16:00.041767 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:00.068996 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2, portal: 192.168.40.100,3260]
May 27 23:16:00.068996 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2, portal: 192.168.40.100,3260] successful.
May 27 23:16:00.068996 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:00.071176 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:16:00.079875 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:00.080346 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2, portal: 192.168.50.100,3260]
May 27 23:16:00.080346 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2, portal: 192.168.50.100,3260] successful.
May 27 23:16:00.080346 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:00.095352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.095352 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.095352 np0000001565 nova-compute[98289]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af7b8a4a-25fa-4960-81f6-ada1d7eac621 (non-flash)
May 27 23:16:00.095352 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:00.095352 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:00.095352 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:00.095596 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.095596 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.095596 np0000001565 nova-compute[98289]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af7b8a4a-25fa-4960-81f6-ada1d7eac621 (non-flash)
May 27 23:16:00.095596 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:00.095596 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:00.095596 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:00.095841 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:00.096110 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:16:00.096845 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('8', '-', '-', 0) found on session 166 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:16:00.097001 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:16:00.100183 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:00.117626 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 166 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:16:00.117869 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:16:00.118384 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.118384 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.118384 np0000001565 nova-compute[98289]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af7b8a4a-25fa-4960-81f6-ada1d7eac621 (non-flash)
May 27 23:16:00.118384 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:00.118384 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:00.118384 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:00.118599 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.118599 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:00.118599 np0000001565 nova-compute[98289]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af7b8a4a-25fa-4960-81f6-ada1d7eac621 (non-flash)
May 27 23:16:00.118599 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:00.118599 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:00.118599 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:00.119744 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:00.119744 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:16:00.119919 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('9', '-', '-', 0) found on session 167 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:16:00.120021 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:16:00.134733 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 167 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:16:00.134824 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:16:00.582429 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.188s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:00.582941 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:16:00.969641 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:16:01.090436 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:16:01.091023 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:16:01.091023 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:01.091804 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:01.164907 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6418d61428124c1c98659435dd6b8bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d4267649c9432993626e440932bf08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:16:01.593232 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:16:01.662739 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Successfully created port: 374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:16:01.876302 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:01.984678 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Found WWN 330000000051606d1 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:16:01.984944 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:01.985100 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000051606d1', 'path': '/dev/dm-0', 'multipath_id': '330000000051606d1'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:16:01.985205 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000051606d1', 'path': '/dev/dm-0', 'multipath_id': '330000000051606d1'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:16:02.096036 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:16:02.158789 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Successfully updated port: 374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:16:02.201932 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d5b61cee-ddae-483f-a97b-b6703aa774ec req-bad4335b-3d47-4cd0-b2b4-60d946295ddf service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Received event network-changed-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:02.202355 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d5b61cee-ddae-483f-a97b-b6703aa774ec req-bad4335b-3d47-4cd0-b2b4-60d946295ddf service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Refreshing instance network info cache due to event network-changed-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:16:02.202557 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d5b61cee-ddae-483f-a97b-b6703aa774ec req-bad4335b-3d47-4cd0-b2b4-60d946295ddf service nova] Acquiring lock "refresh_cache-8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:16:02.202722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d5b61cee-ddae-483f-a97b-b6703aa774ec req-bad4335b-3d47-4cd0-b2b4-60d946295ddf service nova] Acquired lock "refresh_cache-8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:16:02.202869 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d5b61cee-ddae-483f-a97b-b6703aa774ec req-bad4335b-3d47-4cd0-b2b4-60d946295ddf service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Refreshing network info cache for port 374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:16:02.490080 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-463731406',display_name='tempest-TestVolumeBootPattern-server-463731406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-463731406',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbXjNqZIkBKnP/+2930HFp9hdiI6QWACfhegL2HjQuYxyl97n7kx0ZdgHYrA5w7hNmqJA9hz6FXJH5saBA+yfxXYRQZt7r7Q+RorNeKJdqAMODXSbOrlvm9yjCeKn/NGQ==',key_name='tempest-keypair-2044399334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-cj2mrips',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:15:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=6db5e829-7198-437f-885e-7afcda6ded06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31d06057-37c3-493d-988a-26e88ad43978", "address": "fa:16:3e:30:f1:2b", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d06057-37", "ovs_interfaceid": "31d06057-37c3-493d-988a-26e88ad43978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:16:02.490241 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "31d06057-37c3-493d-988a-26e88ad43978", "address": "fa:16:3e:30:f1:2b", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d06057-37", "ovs_interfaceid": "31d06057-37c3-493d-988a-26e88ad43978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:16:02.490783 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=31d06057-37c3-493d-988a-26e88ad43978,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d06057-37') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:16:02.491288 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'pci_devices' on Instance uuid 6db5e829-7198-437f-885e-7afcda6ded06 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:02.661930 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "refresh_cache-8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:16:02.704745 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d5b61cee-ddae-483f-a97b-b6703aa774ec req-bad4335b-3d47-4cd0-b2b4-60d946295ddf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:02.757193 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d5b61cee-ddae-483f-a97b-b6703aa774ec req-bad4335b-3d47-4cd0-b2b4-60d946295ddf service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:16:02.878246 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d5b61cee-ddae-483f-a97b-b6703aa774ec req-bad4335b-3d47-4cd0-b2b4-60d946295ddf service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:02.893546 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:16:02.893831 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:16:02.894124 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:16:02.894472 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:16:02.894777 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:16:02.895041 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.23 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:16:02.994031 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] End _get_guest_xml xml=<domain type="qemu">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <uuid>6db5e829-7198-437f-885e-7afcda6ded06</uuid>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <name>instance-0000003f</name>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPattern-server-463731406</nova:name>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:15:58</nova:creationTime>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:user uuid="31823a44e786429f80ba607958f8b63e">tempest-TestVolumeBootPattern-314561297-project-member</nova:user>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:project uuid="5dda425dab8946dc926808806eeedced">tempest-TestVolumeBootPattern-314561297</nova:project>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         <nova:port uuid="31d06057-37c3-493d-988a-26e88ad43978">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <system>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <entry name="serial">6db5e829-7198-437f-885e-7afcda6ded06</entry>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <entry name="uuid">6db5e829-7198-437f-885e-7afcda6ded06</entry>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     </system>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <os>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   </os>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <features>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   </features>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   <devices>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/6db5e829-7198-437f-885e-7afcda6ded06/disk.config"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     </disk>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <alias name="ua-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <serial>3ca0f3e3-2af9-47b6-b667-28dc7ce730c2</serial>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     </disk>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:30:f1:2b"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <target dev="tap31d06057-37"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     </interface>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/6db5e829-7198-437f-885e-7afcda6ded06/console.log" append="off"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     </serial>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <video>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     </video>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     </rng>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:   </devices>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]: </domain>
May 27 23:16:02.994031 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:16:02.995941 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Preparing to wait for external event network-vif-plugged-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:16:02.995941 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "6db5e829-7198-437f-885e-7afcda6ded06-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:02.995941 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:02.995941 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:02.995941 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-463731406',display_name='tempest-TestVolumeBootPattern-server-463731406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-463731406',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbXjNqZIkBKnP/+2930HFp9hdiI6QWACfhegL2HjQuYxyl97n7kx0ZdgHYrA5w7hNmqJA9hz6FXJH5saBA+yfxXYRQZt7r7Q+RorNeKJdqAMODXSbOrlvm9yjCeKn/NGQ==',key_name='tempest-keypair-2044399334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-cj2mrips',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:15:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=6db5e829-7198-437f-885e-7afcda6ded06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31d06057-37c3-493d-988a-26e88ad43978", "address": "fa:16:3e:30:f1:2b", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d06057-37", "ovs_interfaceid": "31d06057-37c3-493d-988a-26e88ad43978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:16:02.995941 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "31d06057-37c3-493d-988a-26e88ad43978", "address": "fa:16:3e:30:f1:2b", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d06057-37", "ovs_interfaceid": "31d06057-37c3-493d-988a-26e88ad43978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:16:02.995941 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=31d06057-37c3-493d-988a-26e88ad43978,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d06057-37') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:16:02.995941 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=31d06057-37c3-493d-988a-26e88ad43978,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d06057-37') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:16:02.996341 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:02.996673 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:02.996906 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:16:02.997473 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:02.997660 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db62047b-5725-5516-93f9-7fa46d8fe5c9', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:03.015344 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:03.016798 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:03.018235 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:03.018441 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31d06057-37, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:03.018785 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31d06057-37, col_values=(('qos', UUID('a62da1f6-4b6a-438f-ad25-e7587c737de1')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:03.018963 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31d06057-37, col_values=(('external_ids', {'iface-id': '31d06057-37c3-493d-988a-26e88ad43978', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:f1:2b', 'vm-uuid': '6db5e829-7198-437f-885e-7afcda6ded06'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:03.021513 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:03.024930 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:03.025708 np0000001565 nova-compute[98289]: INFO os_vif [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=31d06057-37c3-493d-988a-26e88ad43978,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d06057-37')
May 27 23:16:03.103101 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:16:03.103934 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:16:03.104271 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Creating image(s)
May 27 23:16:03.104685 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:03.104818 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "/opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:03.105229 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "/opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:03.105811 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:16:03.108305 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:16:03.109152 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:03.124839 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:16:03.125408 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:16:03.125683 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:16:03.126063 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:16:03.200756 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.091s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:03.201109 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:03.201586 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:03.202056 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:16:03.204780 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:16:03.205090 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:03.288708 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:03.289153 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:03.350292 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk 1073741824" returned: 0 in 0.061s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:03.350755 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.149s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:03.351169 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:03.381522 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d5b61cee-ddae-483f-a97b-b6703aa774ec req-bad4335b-3d47-4cd0-b2b4-60d946295ddf service nova] Releasing lock "refresh_cache-8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:16:03.382732 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquired lock "refresh_cache-8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:16:03.383166 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:16:03.441416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:03.441890 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:16:03.442191 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:03.527481 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:03.528029 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Cannot resize image /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:16:03.528611 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:16:03.528872 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Ensure instance console log exists: /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:16:03.529234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:03.529563 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:03.529768 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:03.947251 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:16:04.089828 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:04.203581 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Updating instance_info_cache with network_info: [{"id": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "address": "fa:16:3e:ae:84:8b", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap374c7ef3-e2", "ovs_interfaceid": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:04.276566 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:04.542416 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:04.542544 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:04.542667 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No VIF found with MAC fa:16:3e:30:f1:2b, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:16:04.543133 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Using config drive
May 27 23:16:04.705418 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Releasing lock "refresh_cache-8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:16:04.705644 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Instance network_info: |[{"id": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "address": "fa:16:3e:ae:84:8b", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap374c7ef3-e2", "ovs_interfaceid": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:16:04.707428 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Start _get_guest_xml network_info=[{"id": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "address": "fa:16:3e:ae:84:8b", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap374c7ef3-e2", "ovs_interfaceid": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:16:04.709564 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:16:04.710991 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-2125159277', uuid='8a03dbd9-b34d-468b-ac17-54efa1c4e9a5'), owner=OwnerMeta(userid='6418d61428124c1c98659435dd6b8bff', username='tempest-TestEncryptedCinderVolumes-274929604-project-member', projectid='e2d4267649c9432993626e440932bf08', projectname='tempest-TestEncryptedCinderVolumes-274929604'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "address": "fa:16:3e:ae:84:8b", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap374c7ef3-e2", "ovs_interfaceid": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923764.710606) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:16:04.712142 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:16:04.712467 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:16:04.713216 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:16:04.713405 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:16:04.714285 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:16:04.714684 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:16:04.714866 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:16:04.714968 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:16:04.715079 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:16:04.715168 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:16:04.715440 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:16:04.715608 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:16:04.715711 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:16:04.715855 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:16:04.715979 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:16:04.716102 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:16:04.727197 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2125159277',display_name='tempest-TestEncryptedCinderVolumes-server-2125159277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-2125159277',id=64,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKYM4qXuY2Q/Eyw1ImqnPZoIN2kYmLHuuHih9u4JPQvnLdTpKnpq9SWbSbLzKvyOcAmUHVQZzxH212WtSK2XW5dUGDRD9Xz3ubS8oLoCFipc7EnNsa99HYvJ0DjkT/Qlg==',key_name='tempest-keypair-953699768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d4267649c9432993626e440932bf08',ramdisk_id='',reservation_id='r-9clhoway',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-274929604',owner_user_name='tempest-TestEncryptedCinderVolumes-274929604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:16:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6418d61428124c1c98659435dd6b8bff',uuid=8a03dbd9-b34d-468b-ac17-54efa1c4e9a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "address": "fa:16:3e:ae:84:8b", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap374c7ef3-e2", "ovs_interfaceid": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:16:04.727473 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converting VIF {"id": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "address": "fa:16:3e:ae:84:8b", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap374c7ef3-e2", "ovs_interfaceid": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:16:04.727968 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:84:8b,bridge_name='br-int',has_traffic_filtering=True,id=374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374c7ef3-e2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:16:04.728476 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:05.048066 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:05.124538 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:16:05.124969 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:16:05.148392 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Creating config drive at /opt/stack/data/nova/instances/6db5e829-7198-437f-885e-7afcda6ded06/disk.config
May 27 23:16:05.152065 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6db5e829-7198-437f-885e-7afcda6ded06/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxoihnt58 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:05.206695 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6db5e829-7198-437f-885e-7afcda6ded06/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxoihnt58" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:05.231883 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] End _get_guest_xml xml=<domain type="qemu">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <uuid>8a03dbd9-b34d-468b-ac17-54efa1c4e9a5</uuid>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <name>instance-00000040</name>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-2125159277</nova:name>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:16:04</nova:creationTime>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:user uuid="6418d61428124c1c98659435dd6b8bff">tempest-TestEncryptedCinderVolumes-274929604-project-member</nova:user>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:project uuid="e2d4267649c9432993626e440932bf08">tempest-TestEncryptedCinderVolumes-274929604</nova:project>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         <nova:port uuid="374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <system>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <entry name="serial">8a03dbd9-b34d-468b-ac17-54efa1c4e9a5</entry>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <entry name="uuid">8a03dbd9-b34d-468b-ac17-54efa1c4e9a5</entry>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     </system>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <os>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   </os>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <features>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   </features>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   <devices>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     </disk>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk.config"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     </disk>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ae:84:8b"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <target dev="tap374c7ef3-e2"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     </interface>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/console.log" append="off"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     </serial>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <video>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     </video>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     </rng>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:   </devices>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]: </domain>
May 27 23:16:05.231883 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:16:05.233754 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Preparing to wait for external event network-vif-plugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:16:05.233754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:05.233754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:05.233754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:05.233754 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2125159277',display_name='tempest-TestEncryptedCinderVolumes-server-2125159277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-2125159277',id=64,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKYM4qXuY2Q/Eyw1ImqnPZoIN2kYmLHuuHih9u4JPQvnLdTpKnpq9SWbSbLzKvyOcAmUHVQZzxH212WtSK2XW5dUGDRD9Xz3ubS8oLoCFipc7EnNsa99HYvJ0DjkT/Qlg==',key_name='tempest-keypair-953699768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d4267649c9432993626e440932bf08',ramdisk_id='',reservation_id='r-9clhoway',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-274929604',owner_user_name='tempest-TestEncryptedCinderVolumes-274929604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:16:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6418d61428124c1c98659435dd6b8bff',uuid=8a03dbd9-b34d-468b-ac17-54efa1c4e9a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "address": "fa:16:3e:ae:84:8b", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap374c7ef3-e2", "ovs_interfaceid": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:16:05.233987 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converting VIF {"id": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "address": "fa:16:3e:ae:84:8b", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap374c7ef3-e2", "ovs_interfaceid": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:16:05.234507 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:84:8b,bridge_name='br-int',has_traffic_filtering=True,id=374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374c7ef3-e2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:16:05.234729 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:84:8b,bridge_name='br-int',has_traffic_filtering=True,id=374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374c7ef3-e2') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:16:05.235063 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.235388 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:05.235693 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:16:05.236317 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.236489 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c43222a4-7f85-5a55-bc7c-b23613270a98', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:05.237250 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.237968 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:05.242523 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.244291 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.244431 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap374c7ef3-e2, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:05.244754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap374c7ef3-e2, col_values=(('qos', UUID('fdde7842-9522-4d99-a1fc-4b4155a32eb6')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:05.244924 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap374c7ef3-e2, col_values=(('external_ids', {'iface-id': '374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:84:8b', 'vm-uuid': '8a03dbd9-b34d-468b-ac17-54efa1c4e9a5'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:05.245647 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.246722 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:05.255151 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.256135 np0000001565 nova-compute[98289]: INFO os_vif [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:84:8b,bridge_name='br-int',has_traffic_filtering=True,id=374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374c7ef3-e2')
May 27 23:16:05.603378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.626735 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.709650 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.777157 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-02de9fd7-599f-4f3a-9e6e-4f1c92d671ab req-fdf8f46f-b33a-438c-ba0a-5a419d90500b service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Received event network-vif-plugged-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:05.777291 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-02de9fd7-599f-4f3a-9e6e-4f1c92d671ab req-fdf8f46f-b33a-438c-ba0a-5a419d90500b service nova] Acquiring lock "6db5e829-7198-437f-885e-7afcda6ded06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:05.777415 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-02de9fd7-599f-4f3a-9e6e-4f1c92d671ab req-fdf8f46f-b33a-438c-ba0a-5a419d90500b service nova] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:05.777561 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-02de9fd7-599f-4f3a-9e6e-4f1c92d671ab req-fdf8f46f-b33a-438c-ba0a-5a419d90500b service nova] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:05.777709 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-02de9fd7-599f-4f3a-9e6e-4f1c92d671ab req-fdf8f46f-b33a-438c-ba0a-5a419d90500b service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Processing event network-vif-plugged-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:16:05.935819 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.941162 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.942972 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.966523 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:05.973359 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:06.340688 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:16:06.341271 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923766.3410013, 6db5e829-7198-437f-885e-7afcda6ded06 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:06.341436 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] VM Started (Lifecycle Event)
May 27 23:16:06.343910 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:16:06.346479 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Instance spawned successfully.
May 27 23:16:06.347154 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:16:06.773430 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:06.773430 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:06.773430 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No VIF found with MAC fa:16:3e:ae:84:8b, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:16:06.773577 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Using config drive
May 27 23:16:06.844082 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:06.847016 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:16:06.853710 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:06.853916 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:06.854215 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:06.854473 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:06.854761 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:06.855018 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:07.279216 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:07.351459 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:16:07.351816 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923767.3515115, 6db5e829-7198-437f-885e-7afcda6ded06 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:07.351816 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] VM Paused (Lifecycle Event)
May 27 23:16:07.360194 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Took 8.55 seconds to spawn the instance on the hypervisor.
May 27 23:16:07.360401 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:07.406581 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Creating config drive at /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk.config
May 27 23:16:07.410902 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv6ys70jc {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:07.467496 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv6ys70jc" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:07.854316 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:07.858012 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923767.8577397, 6db5e829-7198-437f-885e-7afcda6ded06 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:07.858127 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] VM Resumed (Lifecycle Event)
May 27 23:16:07.867572 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-22ef9c69-beac-486a-8654-9846d1389d1c req-6bf9ddff-82fa-416e-9368-ce8666925447 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Received event network-vif-plugged-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:07.871614 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-22ef9c69-beac-486a-8654-9846d1389d1c req-6bf9ddff-82fa-416e-9368-ce8666925447 service nova] Acquiring lock "6db5e829-7198-437f-885e-7afcda6ded06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:07.872470 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Took 15.56 seconds to build instance.
May 27 23:16:07.874267 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-22ef9c69-beac-486a-8654-9846d1389d1c req-6bf9ddff-82fa-416e-9368-ce8666925447 service nova] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:07.874267 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-22ef9c69-beac-486a-8654-9846d1389d1c req-6bf9ddff-82fa-416e-9368-ce8666925447 service nova] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:07.874267 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-22ef9c69-beac-486a-8654-9846d1389d1c req-6bf9ddff-82fa-416e-9368-ce8666925447 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] No waiting events found dispatching network-vif-plugged-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:16:07.874267 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-22ef9c69-beac-486a-8654-9846d1389d1c req-6bf9ddff-82fa-416e-9368-ce8666925447 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Received unexpected event network-vif-plugged-31d06057-37c3-493d-988a-26e88ad43978 for instance with vm_state active and task_state None.
May 27 23:16:07.890848 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:07.916613 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:07.920048 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:08.010912 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:08.217284 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d9dc0a7b-80f1-41a8-9184-e472a34895d0 req-7e3a15ff-1d82-4f7e-8344-a675d61c1cdf service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Received event network-vif-plugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:08.217505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d9dc0a7b-80f1-41a8-9184-e472a34895d0 req-7e3a15ff-1d82-4f7e-8344-a675d61c1cdf service nova] Acquiring lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:08.217687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d9dc0a7b-80f1-41a8-9184-e472a34895d0 req-7e3a15ff-1d82-4f7e-8344-a675d61c1cdf service nova] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:08.217869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d9dc0a7b-80f1-41a8-9184-e472a34895d0 req-7e3a15ff-1d82-4f7e-8344-a675d61c1cdf service nova] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:08.217929 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d9dc0a7b-80f1-41a8-9184-e472a34895d0 req-7e3a15ff-1d82-4f7e-8344-a675d61c1cdf service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Processing event network-vif-plugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:16:08.270720 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:08.296702 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:08.298710 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:08.361144 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:08.364433 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:16:08.376709 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc2c1ea4-9b48-4789-af23-0f9d8a684686 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "6db5e829-7198-437f-885e-7afcda6ded06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.068s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:08.674830 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:16:08.679793 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:16:08.681909 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Instance spawned successfully.
May 27 23:16:08.682218 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:16:08.751877 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:16:08.867452 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923768.8669808, 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:08.867586 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] VM Started (Lifecycle Event)
May 27 23:16:09.188263 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:09.188740 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:09.188740 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:09.188880 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:09.189130 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:09.189385 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:09.278538 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:09.371958 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:09.375004 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:16:09.696421 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Took 6.59 seconds to spawn the instance on the hypervisor.
May 27 23:16:09.696659 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:09.877999 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:16:09.878274 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923769.8780613, 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:09.878460 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] VM Paused (Lifecycle Event)
May 27 23:16:10.206157 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Took 11.86 seconds to build instance.
May 27 23:16:10.247112 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:10.293957 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Received event network-vif-plugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:10.293957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] Acquiring lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:10.293957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:10.293957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:10.293957 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] No waiting events found dispatching network-vif-plugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:16:10.293957 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Received unexpected event network-vif-plugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc for instance with vm_state active and task_state None.
May 27 23:16:10.293957 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Received event network-changed-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:10.293957 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Refreshing instance network info cache due to event network-changed-31d06057-37c3-493d-988a-26e88ad43978. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:16:10.293957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] Acquiring lock "refresh_cache-6db5e829-7198-437f-885e-7afcda6ded06" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:16:10.293957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] Acquired lock "refresh_cache-6db5e829-7198-437f-885e-7afcda6ded06" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:16:10.293957 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Refreshing network info cache for port 31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:16:10.380933 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:10.382705 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923770.3824673, 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:10.382866 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] VM Resumed (Lifecycle Event)
May 27 23:16:10.707612 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7ac8bdcf-a7bf-4d03-ac78-8e56fa044e2e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.373s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:10.797482 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:10.885451 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:10.887115 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:16:11.119712 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:11.261214 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Updated VIF entry in instance network info cache for port 31d06057-37c3-493d-988a-26e88ad43978. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:16:11.261542 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Updating instance_info_cache with network_info: [{"id": "31d06057-37c3-493d-988a-26e88ad43978", "address": "fa:16:3e:30:f1:2b", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d06057-37", "ovs_interfaceid": "31d06057-37c3-493d-988a-26e88ad43978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:11.269708 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:11.269898 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:11.648416 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-13f00ad8-cfb2-41a1-ad58-b5dea2a11f70 req-035e3cfd-69bb-4045-93af-82c0b9b6c128 service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Received event network-changed-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:11.648785 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-13f00ad8-cfb2-41a1-ad58-b5dea2a11f70 req-035e3cfd-69bb-4045-93af-82c0b9b6c128 service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Refreshing instance network info cache due to event network-changed-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:16:11.648785 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-13f00ad8-cfb2-41a1-ad58-b5dea2a11f70 req-035e3cfd-69bb-4045-93af-82c0b9b6c128 service nova] Acquiring lock "refresh_cache-8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:16:11.648843 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-13f00ad8-cfb2-41a1-ad58-b5dea2a11f70 req-035e3cfd-69bb-4045-93af-82c0b9b6c128 service nova] Acquired lock "refresh_cache-8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:16:11.649035 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-13f00ad8-cfb2-41a1-ad58-b5dea2a11f70 req-035e3cfd-69bb-4045-93af-82c0b9b6c128 service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Refreshing network info cache for port 374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:16:11.763472 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c619fdad-7d93-4548-8b1c-ecf3fdaf1755 req-4da527f0-4028-444d-a0fb-d58fe9ee5dd1 service nova] Releasing lock "refresh_cache-6db5e829-7198-437f-885e-7afcda6ded06" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:16:11.771935 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:16:12.152192 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-13f00ad8-cfb2-41a1-ad58-b5dea2a11f70 req-035e3cfd-69bb-4045-93af-82c0b9b6c128 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:12.322673 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:12.325616 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:12.328892 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:16:12.329024 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Claim successful on node np0000001565
May 27 23:16:12.418641 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-13f00ad8-cfb2-41a1-ad58-b5dea2a11f70 req-035e3cfd-69bb-4045-93af-82c0b9b6c128 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:12.542098 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-13f00ad8-cfb2-41a1-ad58-b5dea2a11f70 req-035e3cfd-69bb-4045-93af-82c0b9b6c128 service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Updated VIF entry in instance network info cache for port 374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:16:12.542422 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-13f00ad8-cfb2-41a1-ad58-b5dea2a11f70 req-035e3cfd-69bb-4045-93af-82c0b9b6c128 service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Updating instance_info_cache with network_info: [{"id": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "address": "fa:16:3e:ae:84:8b", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap374c7ef3-e2", "ovs_interfaceid": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:13.044502 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-13f00ad8-cfb2-41a1-ad58-b5dea2a11f70 req-035e3cfd-69bb-4045-93af-82c0b9b6c128 service nova] Releasing lock "refresh_cache-8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:16:13.537542 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:16:13.537712 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:16:14.040185 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:16:14.280136 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:14.546558 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.221s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:14.546880 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:16:15.053068 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:16:15.053068 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:16:15.053068 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:15.053068 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:15.141292 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f45f6afa2b7e42148a7685164b694ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed98b56db004061b06363a72405f6ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:16:15.248967 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:15.462901 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:15.555359 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:16:15.622979 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Successfully created port: 525fd759-a763-46ed-8666-24514170260b {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:16:16.056816 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:16:16.116155 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Successfully updated port: 525fd759-a763-46ed-8666-24514170260b {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:16:16.170206 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d3e88edc-5f6c-4bef-93d1-ac8f339c62a6 req-4e6f593c-16e8-49d7-ad2a-d72f450ee07e service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Received event network-changed-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:16.170206 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d3e88edc-5f6c-4bef-93d1-ac8f339c62a6 req-4e6f593c-16e8-49d7-ad2a-d72f450ee07e service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Refreshing instance network info cache due to event network-changed-525fd759-a763-46ed-8666-24514170260b. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:16:16.170206 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d3e88edc-5f6c-4bef-93d1-ac8f339c62a6 req-4e6f593c-16e8-49d7-ad2a-d72f450ee07e service nova] Acquiring lock "refresh_cache-5c2e5882-a178-4759-be58-b0e717d8dc0f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:16:16.170206 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d3e88edc-5f6c-4bef-93d1-ac8f339c62a6 req-4e6f593c-16e8-49d7-ad2a-d72f450ee07e service nova] Acquired lock "refresh_cache-5c2e5882-a178-4759-be58-b0e717d8dc0f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:16:16.170206 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d3e88edc-5f6c-4bef-93d1-ac8f339c62a6 req-4e6f593c-16e8-49d7-ad2a-d72f450ee07e service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Refreshing network info cache for port 525fd759-a763-46ed-8666-24514170260b {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:16:16.618700 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "refresh_cache-5c2e5882-a178-4759-be58-b0e717d8dc0f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:16:16.670551 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d3e88edc-5f6c-4bef-93d1-ac8f339c62a6 req-4e6f593c-16e8-49d7-ad2a-d72f450ee07e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:16.732229 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d3e88edc-5f6c-4bef-93d1-ac8f339c62a6 req-4e6f593c-16e8-49d7-ad2a-d72f450ee07e service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:16:16.885619 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d3e88edc-5f6c-4bef-93d1-ac8f339c62a6 req-4e6f593c-16e8-49d7-ad2a-d72f450ee07e service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:17.067682 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:16:17.068554 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:16:17.068783 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Creating image(s)
May 27 23:16:17.069394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:17.069603 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "/opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:17.070118 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "/opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:17.070664 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:16:17.072996 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:16:17.074153 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:17.163157 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:17.163656 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:17.164393 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:17.164862 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:16:17.167292 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:16:17.167720 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:17.254670 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:17.255160 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:17.311138 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk 1073741824" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:17.311734 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:17.312178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:17.388185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d3e88edc-5f6c-4bef-93d1-ac8f339c62a6 req-4e6f593c-16e8-49d7-ad2a-d72f450ee07e service nova] Releasing lock "refresh_cache-5c2e5882-a178-4759-be58-b0e717d8dc0f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:16:17.389046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquired lock "refresh_cache-5c2e5882-a178-4759-be58-b0e717d8dc0f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:16:17.389464 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:16:17.401394 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:17.401828 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:16:17.402086 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:17.484931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:17.485522 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Cannot resize image /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:16:17.486200 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:16:17.486546 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Ensure instance console log exists: /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:16:17.486938 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:17.487298 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:17.487558 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:17.971438 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:16:18.183584 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:18.321190 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Updating instance_info_cache with network_info: [{"id": "525fd759-a763-46ed-8666-24514170260b", "address": "fa:16:3e:da:71:e2", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd759-a7", "ovs_interfaceid": "525fd759-a763-46ed-8666-24514170260b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:18.823797 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Releasing lock "refresh_cache-5c2e5882-a178-4759-be58-b0e717d8dc0f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:16:18.824148 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Instance network_info: |[{"id": "525fd759-a763-46ed-8666-24514170260b", "address": "fa:16:3e:da:71:e2", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd759-a7", "ovs_interfaceid": "525fd759-a763-46ed-8666-24514170260b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:16:18.826292 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Start _get_guest_xml network_info=[{"id": "525fd759-a763-46ed-8666-24514170260b", "address": "fa:16:3e:da:71:e2", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd759-a7", "ovs_interfaceid": "525fd759-a763-46ed-8666-24514170260b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:16:18.830405 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:16:18.831974 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-168792464', uuid='5c2e5882-a178-4759-be58-b0e717d8dc0f'), owner=OwnerMeta(userid='f45f6afa2b7e42148a7685164b694ff3', username='tempest-VolumesBackupsTest-188258886-project-member', projectid='8ed98b56db004061b06363a72405f6ae', projectname='tempest-VolumesBackupsTest-188258886'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "525fd759-a763-46ed-8666-24514170260b", "address": "fa:16:3e:da:71:e2", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd759-a7", "ovs_interfaceid": "525fd759-a763-46ed-8666-24514170260b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923778.8315701) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:16:18.833118 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:16:18.833668 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:16:18.834920 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:16:18.835284 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:16:18.836346 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:16:18.836845 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:16:18.837129 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:16:18.837404 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:16:18.837717 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:16:18.838039 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:16:18.838380 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:16:18.838641 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:16:18.838801 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:16:18.838943 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:16:18.839076 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:16:18.839256 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:16:18.854264 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-168792464',display_name='tempest-VolumesBackupsTest-instance-168792464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesbackupstest-instance-168792464',id=65,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWmjCiTlDmXf3sG2Xa+0oDAVup9j2obkQ5esxrHCMuzuXGWPe1qwb1G1iAYEtWJAXtlf89EsRtdf4GZKqkQ+GpMarcXOKtm8FrR3x2Y1iOZqF1Py2AJwawj3Hi+isbx0Q==',key_name='tempest-keypair-499895313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ed98b56db004061b06363a72405f6ae',ramdisk_id='',reservation_id='r-w2iyahqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-188258886',owner_user_name='tempest-VolumesBackupsTest-188258886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f45f6afa2b7e42148a7685164b694ff3',uuid=5c2e5882-a178-4759-be58-b0e717d8dc0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525fd759-a763-46ed-8666-24514170260b", "address": "fa:16:3e:da:71:e2", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd759-a7", "ovs_interfaceid": "525fd759-a763-46ed-8666-24514170260b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:16:18.854951 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converting VIF {"id": "525fd759-a763-46ed-8666-24514170260b", "address": "fa:16:3e:da:71:e2", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd759-a7", "ovs_interfaceid": "525fd759-a763-46ed-8666-24514170260b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:16:18.856142 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:71:e2,bridge_name='br-int',has_traffic_filtering=True,id=525fd759-a763-46ed-8666-24514170260b,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd759-a7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:16:18.857000 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c2e5882-a178-4759-be58-b0e717d8dc0f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:19.282124 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:19.360609 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] End _get_guest_xml xml=<domain type="qemu">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <uuid>5c2e5882-a178-4759-be58-b0e717d8dc0f</uuid>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <name>instance-00000041</name>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumesBackupsTest-instance-168792464</nova:name>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:16:18</nova:creationTime>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:user uuid="f45f6afa2b7e42148a7685164b694ff3">tempest-VolumesBackupsTest-188258886-project-member</nova:user>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:project uuid="8ed98b56db004061b06363a72405f6ae">tempest-VolumesBackupsTest-188258886</nova:project>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         <nova:port uuid="525fd759-a763-46ed-8666-24514170260b">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <system>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <entry name="serial">5c2e5882-a178-4759-be58-b0e717d8dc0f</entry>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <entry name="uuid">5c2e5882-a178-4759-be58-b0e717d8dc0f</entry>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     </system>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <os>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   </os>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <features>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   </features>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   <devices>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     </disk>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk.config"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     </disk>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:da:71:e2"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <target dev="tap525fd759-a7"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     </interface>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/console.log" append="off"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     </serial>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <video>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     </video>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     </rng>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:   </devices>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]: </domain>
May 27 23:16:19.360609 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:16:19.363005 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Preparing to wait for external event network-vif-plugged-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:16:19.363005 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:19.363005 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:19.363005 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:19.363005 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-168792464',display_name='tempest-VolumesBackupsTest-instance-168792464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesbackupstest-instance-168792464',id=65,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWmjCiTlDmXf3sG2Xa+0oDAVup9j2obkQ5esxrHCMuzuXGWPe1qwb1G1iAYEtWJAXtlf89EsRtdf4GZKqkQ+GpMarcXOKtm8FrR3x2Y1iOZqF1Py2AJwawj3Hi+isbx0Q==',key_name='tempest-keypair-499895313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ed98b56db004061b06363a72405f6ae',ramdisk_id='',reservation_id='r-w2iyahqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-188258886',owner_user_name='tempest-VolumesBackupsTest-188258886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f45f6afa2b7e42148a7685164b694ff3',uuid=5c2e5882-a178-4759-be58-b0e717d8dc0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525fd759-a763-46ed-8666-24514170260b", "address": "fa:16:3e:da:71:e2", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd759-a7", "ovs_interfaceid": "525fd759-a763-46ed-8666-24514170260b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:16:19.363005 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converting VIF {"id": "525fd759-a763-46ed-8666-24514170260b", "address": "fa:16:3e:da:71:e2", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd759-a7", "ovs_interfaceid": "525fd759-a763-46ed-8666-24514170260b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:16:19.363755 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:71:e2,bridge_name='br-int',has_traffic_filtering=True,id=525fd759-a763-46ed-8666-24514170260b,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd759-a7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:16:19.364140 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:71:e2,bridge_name='br-int',has_traffic_filtering=True,id=525fd759-a763-46ed-8666-24514170260b,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd759-a7') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:16:19.364632 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:19.364960 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:19.365262 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:16:19.366097 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:19.366277 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a91ca9f-56cf-5da6-bd4e-a4cc3467790d', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:19.367121 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:19.367729 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:19.368892 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:19.370956 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:19.371115 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap525fd759-a7, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:19.371472 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap525fd759-a7, col_values=(('qos', UUID('e8ed0ba8-1856-441a-9fdd-4da76ef49a49')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:19.371662 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap525fd759-a7, col_values=(('external_ids', {'iface-id': '525fd759-a763-46ed-8666-24514170260b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:71:e2', 'vm-uuid': '5c2e5882-a178-4759-be58-b0e717d8dc0f'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:19.375046 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:19.377413 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:19.378401 np0000001565 nova-compute[98289]: INFO os_vif [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:71:e2,bridge_name='br-int',has_traffic_filtering=True,id=525fd759-a763-46ed-8666-24514170260b,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd759-a7')
May 27 23:16:20.222344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "b0ad0e52-02bc-40ff-992e-64d9d660c266" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:20.222697 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:20.727758 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:16:20.895352 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:20.895352 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:20.895352 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No VIF found with MAC fa:16:3e:da:71:e2, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:16:20.895352 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Using config drive
May 27 23:16:21.276989 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:21.277217 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:21.280173 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:16:21.280384 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Claim successful on node np0000001565
May 27 23:16:21.399794 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:21.506991 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Creating config drive at /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk.config
May 27 23:16:21.511435 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmoxpj_vj {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:21.565494 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmoxpj_vj" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:22.002442 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:22.031345 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:22.134894 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:22.222168 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2c1c9455-bf7d-49a1-9916-6e6147359504 req-8a217d5b-982c-4d81-ae45-4be927450cd4 service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Received event network-vif-plugged-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:22.223834 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2c1c9455-bf7d-49a1-9916-6e6147359504 req-8a217d5b-982c-4d81-ae45-4be927450cd4 service nova] Acquiring lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:22.224016 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2c1c9455-bf7d-49a1-9916-6e6147359504 req-8a217d5b-982c-4d81-ae45-4be927450cd4 service nova] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:22.224178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2c1c9455-bf7d-49a1-9916-6e6147359504 req-8a217d5b-982c-4d81-ae45-4be927450cd4 service nova] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:22.224356 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2c1c9455-bf7d-49a1-9916-6e6147359504 req-8a217d5b-982c-4d81-ae45-4be927450cd4 service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Processing event network-vif-plugged-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:16:22.360469 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:22.362381 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:22.372640 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:22.390812 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:22.598799 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:16:22.599010 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:16:22.796686 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923782.7961867, 5c2e5882-a178-4759-be58-b0e717d8dc0f => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:22.797310 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:16:22.797595 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] VM Started (Lifecycle Event)
May 27 23:16:22.800961 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:16:22.803288 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Instance spawned successfully.
May 27 23:16:22.804310 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:16:23.102680 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:16:23.300877 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:23.302630 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:16:23.311659 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:23.311659 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:23.311659 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:23.311856 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:23.312222 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:23.312615 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:23.610631 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.333s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:23.611105 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:16:23.804698 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:16:23.804985 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923783.8047898, 5c2e5882-a178-4759-be58-b0e717d8dc0f => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:23.805122 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] VM Paused (Lifecycle Event)
May 27 23:16:23.818372 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Took 6.75 seconds to spawn the instance on the hypervisor.
May 27 23:16:23.818711 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:24.117742 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:16:24.118432 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:16:24.121149 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:24.121149 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:24.198345 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5afdb0f7fb014ac993fc36395de07be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d095aed76494dd7b4c64e9209c14483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:16:24.283229 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-806b99d3-0e36-4240-923e-f4478a3c3f3f req-070c2178-ce37-428f-9f19-a45691a9ed81 service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Received event network-vif-plugged-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:24.283229 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-806b99d3-0e36-4240-923e-f4478a3c3f3f req-070c2178-ce37-428f-9f19-a45691a9ed81 service nova] Acquiring lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:24.283229 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-806b99d3-0e36-4240-923e-f4478a3c3f3f req-070c2178-ce37-428f-9f19-a45691a9ed81 service nova] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:24.283229 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-806b99d3-0e36-4240-923e-f4478a3c3f3f req-070c2178-ce37-428f-9f19-a45691a9ed81 service nova] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:24.283229 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-806b99d3-0e36-4240-923e-f4478a3c3f3f req-070c2178-ce37-428f-9f19-a45691a9ed81 service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] No waiting events found dispatching network-vif-plugged-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:16:24.283229 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-806b99d3-0e36-4240-923e-f4478a3c3f3f req-070c2178-ce37-428f-9f19-a45691a9ed81 service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Received unexpected event network-vif-plugged-525fd759-a763-46ed-8666-24514170260b for instance with vm_state active and task_state None.
May 27 23:16:24.286934 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:24.307247 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:24.309058 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923784.3088691, 5c2e5882-a178-4759-be58-b0e717d8dc0f => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:24.309201 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] VM Resumed (Lifecycle Event)
May 27 23:16:24.326215 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Took 12.05 seconds to build instance.
May 27 23:16:24.386236 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:24.596116 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Successfully created port: c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:16:24.619059 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:16:24.811679 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:24.813704 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:16:24.827523 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.558s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:25.043777 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Successfully updated port: c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:16:25.095825 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7981e72e-9dd8-4c7f-8a0a-611974821d27 req-d93ac0a1-7e2b-4c8e-bf4a-1ae7abb003d1 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Received event network-changed-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:25.099321 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7981e72e-9dd8-4c7f-8a0a-611974821d27 req-d93ac0a1-7e2b-4c8e-bf4a-1ae7abb003d1 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Refreshing instance network info cache due to event network-changed-c8474dbe-3166-457b-b300-69d6a51095aa. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:16:25.099321 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7981e72e-9dd8-4c7f-8a0a-611974821d27 req-d93ac0a1-7e2b-4c8e-bf4a-1ae7abb003d1 service nova] Acquiring lock "refresh_cache-b0ad0e52-02bc-40ff-992e-64d9d660c266" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:16:25.099321 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7981e72e-9dd8-4c7f-8a0a-611974821d27 req-d93ac0a1-7e2b-4c8e-bf4a-1ae7abb003d1 service nova] Acquired lock "refresh_cache-b0ad0e52-02bc-40ff-992e-64d9d660c266" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:16:25.099321 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7981e72e-9dd8-4c7f-8a0a-611974821d27 req-d93ac0a1-7e2b-4c8e-bf4a-1ae7abb003d1 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Refreshing network info cache for port c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:16:25.122927 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:16:25.547529 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "refresh_cache-b0ad0e52-02bc-40ff-992e-64d9d660c266" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:16:25.600846 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7981e72e-9dd8-4c7f-8a0a-611974821d27 req-d93ac0a1-7e2b-4c8e-bf4a-1ae7abb003d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:25.627744 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Booting with volume 2690aa32-d545-44c3-9b62-b6946fe6187f at /dev/vda
May 27 23:16:25.655624 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7981e72e-9dd8-4c7f-8a0a-611974821d27 req-d93ac0a1-7e2b-4c8e-bf4a-1ae7abb003d1 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:16:25.665512 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:16:25.676015 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:16:25.696731 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:25.744769 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:16:25.745079 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:16:25.753146 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:16:25.754203 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fece:a0a4', 'fe80::dcaa:c7ff:fef8:d23c', 'fe80::fc16:3eff:fe30:f12b', 'fe80::b098:84ff:fe18:24bd', 'fe80::fc16:3eff:feae:848b', 'fe80::cc06:4bff:fe3b:6e14', 'fe80::fc16:3eff:feda:71e2', 'fe80::3ca1:7dff:fece:9122'] 
May 27 23:16:25.754321 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:16:25.754457 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:16:25.754686 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:16:25.754871 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Updating existing volume attachment record: 134fba48-f264-45d6-9587-de8e98a007d2 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:16:25.836428 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7981e72e-9dd8-4c7f-8a0a-611974821d27 req-d93ac0a1-7e2b-4c8e-bf4a-1ae7abb003d1 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:26.339124 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7981e72e-9dd8-4c7f-8a0a-611974821d27 req-d93ac0a1-7e2b-4c8e-bf4a-1ae7abb003d1 service nova] Releasing lock "refresh_cache-b0ad0e52-02bc-40ff-992e-64d9d660c266" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:16:26.341019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquired lock "refresh_cache-b0ad0e52-02bc-40ff-992e-64d9d660c266" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:16:26.341019 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:16:26.356156 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8eabb01b-ed0a-4909-b274-355412a4a440 req-24e83a6f-41b6-4282-b51a-d668575d94ae service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Received event network-changed-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:26.356347 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8eabb01b-ed0a-4909-b274-355412a4a440 req-24e83a6f-41b6-4282-b51a-d668575d94ae service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Refreshing instance network info cache due to event network-changed-525fd759-a763-46ed-8666-24514170260b. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:16:26.356607 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8eabb01b-ed0a-4909-b274-355412a4a440 req-24e83a6f-41b6-4282-b51a-d668575d94ae service nova] Acquiring lock "refresh_cache-5c2e5882-a178-4759-be58-b0e717d8dc0f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:16:26.356747 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8eabb01b-ed0a-4909-b274-355412a4a440 req-24e83a6f-41b6-4282-b51a-d668575d94ae service nova] Acquired lock "refresh_cache-5c2e5882-a178-4759-be58-b0e717d8dc0f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:16:26.356893 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8eabb01b-ed0a-4909-b274-355412a4a440 req-24e83a6f-41b6-4282-b51a-d668575d94ae service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Refreshing network info cache for port 525fd759-a763-46ed-8666-24514170260b {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:16:26.859812 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8eabb01b-ed0a-4909-b274-355412a4a440 req-24e83a6f-41b6-4282-b51a-d668575d94ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:26.916401 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:16:27.069561 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:27.163623 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8eabb01b-ed0a-4909-b274-355412a4a440 req-24e83a6f-41b6-4282-b51a-d668575d94ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:27.203924 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Updating instance_info_cache with network_info: [{"id": "c8474dbe-3166-457b-b300-69d6a51095aa", "address": "fa:16:3e:2e:16:40", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8474dbe-31", "ovs_interfaceid": "c8474dbe-3166-457b-b300-69d6a51095aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:27.305803 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8eabb01b-ed0a-4909-b274-355412a4a440 req-24e83a6f-41b6-4282-b51a-d668575d94ae service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Updated VIF entry in instance network info cache for port 525fd759-a763-46ed-8666-24514170260b. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:16:27.306088 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8eabb01b-ed0a-4909-b274-355412a4a440 req-24e83a6f-41b6-4282-b51a-d668575d94ae service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Updating instance_info_cache with network_info: [{"id": "525fd759-a763-46ed-8666-24514170260b", "address": "fa:16:3e:da:71:e2", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd759-a7", "ovs_interfaceid": "525fd759-a763-46ed-8666-24514170260b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:27.705037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Releasing lock "refresh_cache-b0ad0e52-02bc-40ff-992e-64d9d660c266" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:16:27.706097 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Instance network_info: |[{"id": "c8474dbe-3166-457b-b300-69d6a51095aa", "address": "fa:16:3e:2e:16:40", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8474dbe-31", "ovs_interfaceid": "c8474dbe-3166-457b-b300-69d6a51095aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:16:27.808348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8eabb01b-ed0a-4909-b274-355412a4a440 req-24e83a6f-41b6-4282-b51a-d668575d94ae service nova] Releasing lock "refresh_cache-5c2e5882-a178-4759-be58-b0e717d8dc0f" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:16:27.859645 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:16:27.860762 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:16:27.860999 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Creating image(s)
May 27 23:16:27.861275 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:16:27.861416 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Ensure instance console log exists: /opt/stack/data/nova/instances/b0ad0e52-02bc-40ff-992e-64d9d660c266/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:16:27.861663 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:27.861804 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:27.861924 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:27.862366 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Start _get_guest_xml network_info=[{"id": "c8474dbe-3166-457b-b300-69d6a51095aa", "address": "fa:16:3e:2e:16:40", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8474dbe-31", "ovs_interfaceid": "c8474dbe-3166-457b-b300-69d6a51095aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '134fba48-f264-45d6-9587-de8e98a007d2', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2690aa32-d545-44c3-9b62-b6946fe6187f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b0ad0e52-02bc-40ff-992e-64d9d660c266', 'attached_at': '', 'detached_at': '', 'volume_id': '2690aa32-d545-44c3-9b62-b6946fe6187f', 'serial': '2690aa32-d545-44c3-9b62-b6946fe6187f'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:16:27.865841 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:16:27.866794 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-2028657933', uuid='b0ad0e52-02bc-40ff-992e-64d9d660c266'), owner=OwnerMeta(userid='5afdb0f7fb014ac993fc36395de07be6', username='tempest-TestVolumeBootPatternV346-405934088-project-member', projectid='0d095aed76494dd7b4c64e9209c14483', projectname='tempest-TestVolumeBootPatternV346-405934088'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c8474dbe-3166-457b-b300-69d6a51095aa", "address": "fa:16:3e:2e:16:40", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8474dbe-31", "ovs_interfaceid": "c8474dbe-3166-457b-b300-69d6a51095aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923787.8664727) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:16:27.867842 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:16:27.868179 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:16:27.869062 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:16:27.869232 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:16:27.870073 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:16:27.870342 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:16:27.870473 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:16:27.870586 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:16:27.870752 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:16:27.870752 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:16:27.870842 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:16:27.870991 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:16:27.871079 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:16:27.871219 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:16:27.871319 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:16:27.871458 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:16:27.880674 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:16:27.880980 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2690aa32-d545-44c3-9b62-b6946fe6187f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:16:27.881121 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:16:27.881509 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:16:27.881694 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2690aa32-d545-44c3-9b62-b6946fe6187f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:16:27.894402 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:16:27.895251 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:16:27.895815 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:16:27.896045 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:16:27.896577 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:16:27.896910 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:16:27.910578 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:16:27.910578 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:27.912512 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:16:27.912512 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:27.923214 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f] added
May 27 23:16:27.923214 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:16:27.923214 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:27.923214 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:27.923214 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:27.923214 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:27.923214 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:27.923600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:16:27.923922 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:16:27.924115 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:16:27.926696 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f] added
May 27 23:16:27.926696 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:16:27.926696 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:27.926696 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:27.926696 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:27.926696 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:27.926696 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:27.926844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:16:27.927082 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:16:27.927235 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:16:28.924578 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:16:28.929678 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:16:28.937616 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:16:28.937616 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:16:28.943794 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:16:28.943794 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:28.949531 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:28.958710 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:28.966633 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:28.966633 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:28.966633 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:28.966633 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:28.966633 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:28.966803 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:28.966803 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:28.966803 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:28.966803 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:28.966803 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:28.972097 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:28.972097 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:28.972097 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:28.972097 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:28.972097 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:28.972287 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:28.972287 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:28.972287 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:28.972287 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:28.972287 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:29.002857 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f, portal: 192.168.50.100,3260]
May 27 23:16:29.002857 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f, portal: 192.168.50.100,3260] successful.
May 27 23:16:29.002857 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:29.010896 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f, portal: 192.168.40.100,3260]
May 27 23:16:29.010896 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f, portal: 192.168.40.100,3260] successful.
May 27 23:16:29.010896 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:29.015897 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:29.024355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:29.029845 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:29.029845 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:29.029845 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:29.029845 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:29.029845 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:29.029845 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:29.029845 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:29.030037 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:29.030037 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:29.030037 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:29.030037 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:29.030037 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:29.030037 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:29.030037 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:29.030307 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:29.030307 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:16:29.031026 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] HCTL ('7', '-', '-', 0) found on session 168 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:16:29.031115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:16:29.040660 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:29.040660 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:29.040660 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:29.040660 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:29.040660 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:29.040660 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:29.040660 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:29.040852 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:29.040852 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:29.040852 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:29.040852 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:29.040852 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:29.040852 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:29.040852 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:29.041106 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:29.041202 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:16:29.042034 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] HCTL ('12', '-', '-', 0) found on session 169 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:16:29.042155 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:16:29.048884 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching for a device in session 168 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:16:29.049029 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2690aa32-d545-44c3-9b62-b6946fe6187f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:16:29.058680 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching for a device in session 169 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:16:29.059615 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2690aa32-d545-44c3-9b62-b6946fe6187f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:16:29.286683 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:29.387023 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:29.896780 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:16:30.912207 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Found WWN 330000000b4caae7a for multipath device dm-6 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:16:30.912656 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:30.912656 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000b4caae7a', 'path': '/dev/dm-6', 'multipath_id': '330000000b4caae7a'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:16:30.912807 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b4caae7a', 'path': '/dev/dm-6', 'multipath_id': '330000000b4caae7a'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:16:31.417613 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2028657933',display_name='tempest-TestVolumeBootPatternV346-server-2028657933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpatternv346-server-2028657933',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi7TE1EjOBXND3pNTLCOWOnGwv4c1ynF8I5Yqg53Mkbb+M+fP3FSCFtelDRDubDA8QBy1vGLL9MdJMbAwEASz8Jpdlh9yvDJA6qHG2cYEACTBtD/8CudU7oCY+KjoHH1A==',key_name='tempest-keypair-2032128959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d095aed76494dd7b4c64e9209c14483',ramdisk_id='',reservation_id='r-ubaptd6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-405934088',owner_user_name='tempest-TestVolumeBootPatternV346-405934088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:16:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afdb0f7fb014ac993fc36395de07be6',uuid=b0ad0e52-02bc-40ff-992e-64d9d660c266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8474dbe-3166-457b-b300-69d6a51095aa", "address": "fa:16:3e:2e:16:40", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8474dbe-31", "ovs_interfaceid": "c8474dbe-3166-457b-b300-69d6a51095aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:16:31.417895 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converting VIF {"id": "c8474dbe-3166-457b-b300-69d6a51095aa", "address": "fa:16:3e:2e:16:40", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8474dbe-31", "ovs_interfaceid": "c8474dbe-3166-457b-b300-69d6a51095aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:16:31.418563 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=c8474dbe-3166-457b-b300-69d6a51095aa,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8474dbe-31') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:16:31.419222 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lazy-loading 'pci_devices' on Instance uuid b0ad0e52-02bc-40ff-992e-64d9d660c266 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:31.922148 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] End _get_guest_xml xml=<domain type="qemu">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <uuid>b0ad0e52-02bc-40ff-992e-64d9d660c266</uuid>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <name>instance-00000042</name>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPatternV346-server-2028657933</nova:name>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:16:27</nova:creationTime>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:user uuid="5afdb0f7fb014ac993fc36395de07be6">tempest-TestVolumeBootPatternV346-405934088-project-member</nova:user>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:project uuid="0d095aed76494dd7b4c64e9209c14483">tempest-TestVolumeBootPatternV346-405934088</nova:project>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         <nova:port uuid="c8474dbe-3166-457b-b300-69d6a51095aa">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <system>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <entry name="serial">b0ad0e52-02bc-40ff-992e-64d9d660c266</entry>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <entry name="uuid">b0ad0e52-02bc-40ff-992e-64d9d660c266</entry>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     </system>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <os>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   </os>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <features>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   </features>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   <devices>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/b0ad0e52-02bc-40ff-992e-64d9d660c266/disk.config"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     </disk>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <alias name="ua-2690aa32-d545-44c3-9b62-b6946fe6187f"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-6"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <serial>2690aa32-d545-44c3-9b62-b6946fe6187f</serial>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     </disk>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:2e:16:40"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <target dev="tapc8474dbe-31"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     </interface>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/b0ad0e52-02bc-40ff-992e-64d9d660c266/console.log" append="off"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     </serial>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <video>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     </video>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     </rng>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:   </devices>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]: </domain>
May 27 23:16:31.922148 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Preparing to wait for external event network-vif-plugged-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2028657933',display_name='tempest-TestVolumeBootPatternV346-server-2028657933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpatternv346-server-2028657933',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi7TE1EjOBXND3pNTLCOWOnGwv4c1ynF8I5Yqg53Mkbb+M+fP3FSCFtelDRDubDA8QBy1vGLL9MdJMbAwEASz8Jpdlh9yvDJA6qHG2cYEACTBtD/8CudU7oCY+KjoHH1A==',key_name='tempest-keypair-2032128959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d095aed76494dd7b4c64e9209c14483',ramdisk_id='',reservation_id='r-ubaptd6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-405934088',owner_user_name='tempest-TestVolumeBootPatternV346-405934088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:16:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afdb0f7fb014ac993fc36395de07be6',uuid=b0ad0e52-02bc-40ff-992e-64d9d660c266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8474dbe-3166-457b-b300-69d6a51095aa", "address": "fa:16:3e:2e:16:40", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8474dbe-31", "ovs_interfaceid": "c8474dbe-3166-457b-b300-69d6a51095aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converting VIF {"id": "c8474dbe-3166-457b-b300-69d6a51095aa", "address": "fa:16:3e:2e:16:40", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8474dbe-31", "ovs_interfaceid": "c8474dbe-3166-457b-b300-69d6a51095aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=c8474dbe-3166-457b-b300-69d6a51095aa,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8474dbe-31') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=c8474dbe-3166-457b-b300-69d6a51095aa,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8474dbe-31') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:31.926754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8bc43895-da4c-5d0e-bfcc-150867609501', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:31.947094 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:31.948272 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:31.950955 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:31.951174 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8474dbe-31, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:31.951598 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8474dbe-31, col_values=(('qos', UUID('671911a7-54f0-43d0-acc1-cb9606e5bfd0')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:31.951754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8474dbe-31, col_values=(('external_ids', {'iface-id': 'c8474dbe-3166-457b-b300-69d6a51095aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:16:40', 'vm-uuid': 'b0ad0e52-02bc-40ff-992e-64d9d660c266'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:31.952647 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:31.953649 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:31.958942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:31.959875 np0000001565 nova-compute[98289]: INFO os_vif [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=c8474dbe-3166-457b-b300-69d6a51095aa,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8474dbe-31')
May 27 23:16:33.475273 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:33.475725 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:33.475725 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] No VIF found with MAC fa:16:3e:2e:16:40, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:16:33.476085 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Using config drive
May 27 23:16:33.982980 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:34.119040 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Creating config drive at /opt/stack/data/nova/instances/b0ad0e52-02bc-40ff-992e-64d9d660c266/disk.config
May 27 23:16:34.123986 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b0ad0e52-02bc-40ff-992e-64d9d660c266/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi4mfuit2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:34.170411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:34.174722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:34.184949 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b0ad0e52-02bc-40ff-992e-64d9d660c266/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi4mfuit2" returned: 0 in 0.061s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:34.288211 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:34.592214 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:34.621466 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:34.623506 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:34.680341 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lazy-loading 'flavor' on Instance uuid 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:34.705691 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:34.805342 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-160bc969-2579-489b-bb59-6614be088c61 req-638a75c1-1413-4367-803b-385650e546a5 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Received event network-vif-plugged-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:34.805557 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-160bc969-2579-489b-bb59-6614be088c61 req-638a75c1-1413-4367-803b-385650e546a5 service nova] Acquiring lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:34.805762 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-160bc969-2579-489b-bb59-6614be088c61 req-638a75c1-1413-4367-803b-385650e546a5 service nova] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:34.805953 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-160bc969-2579-489b-bb59-6614be088c61 req-638a75c1-1413-4367-803b-385650e546a5 service nova] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:34.806126 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-160bc969-2579-489b-bb59-6614be088c61 req-638a75c1-1413-4367-803b-385650e546a5 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Processing event network-vif-plugged-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:16:34.818042 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:34.818982 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:35.300386 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923795.2998989, b0ad0e52-02bc-40ff-992e-64d9d660c266 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:35.300973 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:16:35.301192 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] VM Started (Lifecycle Event)
May 27 23:16:35.304905 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:16:35.308679 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Instance spawned successfully.
May 27 23:16:35.308943 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:16:35.688391 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:35.804322 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:35.806424 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:16:35.816696 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:35.816858 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:35.819327 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:35.819327 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:35.819327 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:35.819327 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:16:36.309241 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:16:36.309715 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923796.3094468, b0ad0e52-02bc-40ff-992e-64d9d660c266 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:36.309894 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] VM Paused (Lifecycle Event)
May 27 23:16:36.323910 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Took 8.46 seconds to spawn the instance on the hypervisor.
May 27 23:16:36.323910 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:36.745730 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:36.746143 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:36.746143 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Attaching volume b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 to /dev/vdb
May 27 23:16:36.781228 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:16:36.791812 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:16:36.810162 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:36.824630 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:36.838991 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Took 15.60 seconds to build instance.
May 27 23:16:36.840469 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923796.8401191, b0ad0e52-02bc-40ff-992e-64d9d660c266 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:16:36.840659 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] VM Resumed (Lifecycle Event)
May 27 23:16:36.857019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:16:36.857264 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:16:36.864966 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:16:36.867366 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fece:a0a4', 'fe80::dcaa:c7ff:fef8:d23c', 'fe80::fc16:3eff:fe30:f12b', 'fe80::b098:84ff:fe18:24bd', 'fe80::fc16:3eff:feae:848b', 'fe80::cc06:4bff:fe3b:6e14', 'fe80::fc16:3eff:feda:71e2', 'fe80::3ca1:7dff:fece:9122', 'fe80::fc16:3eff:fe2e:1640'] 
May 27 23:16:36.867366 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:16:36.867366 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:16:36.867683 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:16:36.867683 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Updating existing volume attachment record: e7e60d3b-a79f-4b7c-bfe7-92c8063bca81 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:16:36.873226 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5a2022a5-7789-46e1-922e-79807bf3dc3b req-78aec46b-a777-4f81-a6f2-15f794dad5b1 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Received event network-vif-plugged-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:36.873644 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5a2022a5-7789-46e1-922e-79807bf3dc3b req-78aec46b-a777-4f81-a6f2-15f794dad5b1 service nova] Acquiring lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:36.874404 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5a2022a5-7789-46e1-922e-79807bf3dc3b req-78aec46b-a777-4f81-a6f2-15f794dad5b1 service nova] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:36.874404 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5a2022a5-7789-46e1-922e-79807bf3dc3b req-78aec46b-a777-4f81-a6f2-15f794dad5b1 service nova] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:36.874404 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5a2022a5-7789-46e1-922e-79807bf3dc3b req-78aec46b-a777-4f81-a6f2-15f794dad5b1 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] No waiting events found dispatching network-vif-plugged-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:16:36.874404 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5a2022a5-7789-46e1-922e-79807bf3dc3b req-78aec46b-a777-4f81-a6f2-15f794dad5b1 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Received unexpected event network-vif-plugged-c8474dbe-3166-457b-b300-69d6a51095aa for instance with vm_state active and task_state None.
May 27 23:16:36.963666 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:37.340057 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.117s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:37.343019 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:37.345716 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:16:37.450437 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8a03dbd9-b34d-468b-ac17-54efa1c4e9a5', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'serial': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:16:37.453191 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:16:37.453191 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:16:37.453191 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:16:37.453191 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:16:37.453191 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:16:37.464770 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:16:37.465352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:16:37.465750 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:16:37.465959 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:16:37.466419 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:16:37.466419 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:16:37.480201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:16:37.480201 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:37.486201 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:16:37.486201 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:37.494406 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732] added
May 27 23:16:37.494406 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:16:37.494406 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:37.494406 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:37.494406 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:37.494406 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:37.494406 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:37.494732 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:16:37.494796 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:16:37.494992 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:16:37.504405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732] added
May 27 23:16:37.504405 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:16:37.504405 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:37.504405 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:37.504405 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:37.504405 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:37.504405 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:37.504405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:16:37.504405 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0377(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:16:37.504405 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:16:37.908688 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0b05e209-4263-4fac-a833-4cc22aec59c0 req-c1ac00a7-1d81-4c11-a40f-2abafeb1b5fd service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Received event network-changed-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:37.909180 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0b05e209-4263-4fac-a833-4cc22aec59c0 req-c1ac00a7-1d81-4c11-a40f-2abafeb1b5fd service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Refreshing instance network info cache due to event network-changed-c8474dbe-3166-457b-b300-69d6a51095aa. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:16:37.909180 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0b05e209-4263-4fac-a833-4cc22aec59c0 req-c1ac00a7-1d81-4c11-a40f-2abafeb1b5fd service nova] Acquiring lock "refresh_cache-b0ad0e52-02bc-40ff-992e-64d9d660c266" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:16:37.909180 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0b05e209-4263-4fac-a833-4cc22aec59c0 req-c1ac00a7-1d81-4c11-a40f-2abafeb1b5fd service nova] Acquired lock "refresh_cache-b0ad0e52-02bc-40ff-992e-64d9d660c266" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:16:37.909285 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0b05e209-4263-4fac-a833-4cc22aec59c0 req-c1ac00a7-1d81-4c11-a40f-2abafeb1b5fd service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Refreshing network info cache for port c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:16:38.411749 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-0b05e209-4263-4fac-a833-4cc22aec59c0 req-c1ac00a7-1d81-4c11-a40f-2abafeb1b5fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:38.495477 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:16:38.504868 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:16:38.506212 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:16:38.506212 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:16:38.517844 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:16:38.517844 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:38.527356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:38.528770 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:38.541717 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.541717 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.541717 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.541717 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.541717 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.541717 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.541717 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:38.541982 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.541982 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.541982 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.541982 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.541982 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.541982 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.541982 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.549040 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:38.578668 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732, portal: 192.168.50.100,3260]
May 27 23:16:38.578668 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732, portal: 192.168.50.100,3260] successful.
May 27 23:16:38.578668 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:38.584479 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732, portal: 192.168.40.100,3260]
May 27 23:16:38.584479 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732, portal: 192.168.40.100,3260] successful.
May 27 23:16:38.584479 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:38.590239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:38.596640 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:38.605837 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.605837 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.605837 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.605837 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.605837 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.605837 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.605837 np0000001565 nova-compute[98289]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:38.605837 np0000001565 nova-compute[98289]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:38.605837 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:38.606161 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.606161 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.606161 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.606161 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.606161 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.606161 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.606161 np0000001565 nova-compute[98289]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:38.606161 np0000001565 nova-compute[98289]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:38.606161 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:38.606161 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:38.606500 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:16:38.607301 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] HCTL ('13', '-', '-', 0) found on session 170 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:16:38.607426 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:38.617729 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] HCTL ('14', '-', '-', 0) found on session 171 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:16:38.617729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:16:38.632009 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching for a device in session 170 and hctl ['13', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:16:38.640232 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching for a device in session 171 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:16:38.640232 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:16:38.755505 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-0b05e209-4263-4fac-a833-4cc22aec59c0 req-c1ac00a7-1d81-4c11-a40f-2abafeb1b5fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:38.875854 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0b05e209-4263-4fac-a833-4cc22aec59c0 req-c1ac00a7-1d81-4c11-a40f-2abafeb1b5fd service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Updated VIF entry in instance network info cache for port c8474dbe-3166-457b-b300-69d6a51095aa. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:16:38.876192 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0b05e209-4263-4fac-a833-4cc22aec59c0 req-c1ac00a7-1d81-4c11-a40f-2abafeb1b5fd service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Updating instance_info_cache with network_info: [{"id": "c8474dbe-3166-457b-b300-69d6a51095aa", "address": "fa:16:3e:2e:16:40", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8474dbe-31", "ovs_interfaceid": "c8474dbe-3166-457b-b300-69d6a51095aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:39.290021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:39.377871 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0b05e209-4263-4fac-a833-4cc22aec59c0 req-c1ac00a7-1d81-4c11-a40f-2abafeb1b5fd service nova] Releasing lock "refresh_cache-b0ad0e52-02bc-40ff-992e-64d9d660c266" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:16:39.630226 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching for a device in session 170 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:16:39.630354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:16:40.480842 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Found WWN 330000000410655e8 for multipath device dm-9 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:16:40.480842 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:40.481590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '330000000410655e8', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '330000000410655e8'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:16:40.481824 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000410655e8', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '330000000410655e8'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:16:40.483503 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:16:40.483775 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:16:40.484274 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:16:40.497705 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 23:16:40.497705 np0000001565 nova-compute[98289]:   <usage type="volume">
May 27 23:16:40.497705 np0000001565 nova-compute[98289]:     <volume>b6cf55d2-1dcc-4ede-8bb3-243d98aa2732</volume>
May 27 23:16:40.497705 np0000001565 nova-compute[98289]:   </usage>
May 27 23:16:40.497705 np0000001565 nova-compute[98289]: </secret>
May 27 23:16:40.497705 np0000001565 nova-compute[98289]:  {{(pid=98289) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 23:16:40.502466 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lazy-loading 'flavor' on Instance uuid 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:41.005322 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Attempting to attach volume b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:16:41.006726 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:16:41.006726 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:16:41.006726 np0000001565 nova-compute[98289]:   <alias name="ua-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732"/>
May 27 23:16:41.006726 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 27 23:16:41.006726 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:16:41.006726 np0000001565 nova-compute[98289]:   <serial>b6cf55d2-1dcc-4ede-8bb3-243d98aa2732</serial>
May 27 23:16:41.006726 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:16:41.006726 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="da24da64-f613-4b42-93cf-b924c692a459"/>
May 27 23:16:41.006726 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:16:41.006726 np0000001565 nova-compute[98289]: </disk>
May 27 23:16:41.006726 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:16:41.974919 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:43.590820 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:43.591256 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:43.591256 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:43.591256 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No VIF found with MAC fa:16:3e:ae:84:8b, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:16:44.291444 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:45.138802 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-e5a8fe47-477b-4233-9230-fc5c33ce49fd tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.393s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:45.620766 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:45.620971 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:46.123234 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Detaching volume b6cf55d2-1dcc-4ede-8bb3-243d98aa2732
May 27 23:16:46.172993 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Attempting to driver detach volume b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 from mountpoint /dev/vdb
May 27 23:16:46.218132 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '8a03dbd9-b34d-468b-ac17-54efa1c4e9a5', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'serial': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:16:46.221178 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Found disk vdb by alias ua-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:16:46.222302 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Found disk vdb by alias ua-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:16:46.222542 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Attempting to detach device vdb from instance 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:16:46.222542 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:16:46.222542 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:16:46.222542 np0000001565 nova-compute[98289]:   <alias name="ua-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732"/>
May 27 23:16:46.222542 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 27 23:16:46.222542 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:16:46.222542 np0000001565 nova-compute[98289]:   <serial>b6cf55d2-1dcc-4ede-8bb3-243d98aa2732</serial>
May 27 23:16:46.222542 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:16:46.222542 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:16:46.222542 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="da24da64-f613-4b42-93cf-b924c692a459"/>
May 27 23:16:46.222542 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:16:46.222542 np0000001565 nova-compute[98289]: </disk>
May 27 23:16:46.222542 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:16:46.226711 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Successfully detached device vdb from instance 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 from the persistent domain config.
May 27 23:16:46.226908 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] (1/8): Attempting to detach device vdb with device alias ua-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 from instance 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:16:46.227107 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:16:46.227107 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:16:46.227107 np0000001565 nova-compute[98289]:   <alias name="ua-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732"/>
May 27 23:16:46.227107 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 27 23:16:46.227107 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:16:46.227107 np0000001565 nova-compute[98289]:   <serial>b6cf55d2-1dcc-4ede-8bb3-243d98aa2732</serial>
May 27 23:16:46.227107 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:16:46.227107 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:16:46.227107 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="da24da64-f613-4b42-93cf-b924c692a459"/>
May 27 23:16:46.227107 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:16:46.227107 np0000001565 nova-compute[98289]: </disk>
May 27 23:16:46.227107 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:16:46.703699 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923806.7033243, 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 => ua-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:16:46.704785 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 for instance 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:16:46.706725 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Successfully detached device vdb from instance 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 from the live domain config.
May 27 23:16:46.708869 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:16:46.709160 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:16:46.709418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:16:46.709843 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:16:46.710170 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:16:46.710329 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:16:46.735645 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:46.735645 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:46.735645 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:46.735645 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:46.735645 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:46.735645 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:46.735645 np0000001565 nova-compute[98289]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:46.735645 np0000001565 nova-compute[98289]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:46.735645 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:46.735919 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:46.735919 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:46.735919 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:46.735919 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:46.735919 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:46.735919 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:46.735919 np0000001565 nova-compute[98289]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:46.735919 np0000001565 nova-compute[98289]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732 (non-flash)
May 27 23:16:46.735919 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:46.735919 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', '167'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', '171')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:16:46.736153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', '171')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:16:46.736791 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732', '170')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:16:46.737481 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e60509c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732'): ({'sdh'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:16:46.737653 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Removing multipathed devices sdi, sdh {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:16:46.738025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Flush multipath device 330000000410655e8 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:16:46.774410 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:16:46.824722 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:16:46.870721 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:16:46.870891 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:16:46.871862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:16:46.887053 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:16:46.887246 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:16:46.898544 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:46.928492 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 171, target: iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732, portal: 192.168.40.100,3260]
May 27 23:16:46.928492 np0000001565 nova-compute[98289]: Logout of [sid: 171, target: iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732, portal: 192.168.40.100,3260] successful.
May 27 23:16:46.928492 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:46.943710 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:46.954988 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:46.991842 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:46.993545 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 170, target: iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732, portal: 192.168.50.100,3260]
May 27 23:16:46.993545 np0000001565 nova-compute[98289]: Logout of [sid: 170, target: iqn.2023-03.storpool.com:os--volume-b6cf55d2-1dcc-4ede-8bb3-243d98aa2732, portal: 192.168.50.100,3260] successful.
May 27 23:16:46.993545 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:47.012867 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:47.013741 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:47.013873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] <== disconnect_volume: return (304ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:16:47.014006 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:16:47.558143 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lazy-loading 'flavor' on Instance uuid 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:48.563542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-85d42ad7-b03a-4eb5-a8b4-ae58717116b3 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.942s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:48.898200 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b6330d85-c778-4050-a7ec-3520d258f12c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "6db5e829-7198-437f-885e-7afcda6ded06" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:48.898447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b6330d85-c778-4050-a7ec-3520d258f12c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "6db5e829-7198-437f-885e-7afcda6ded06" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:48.898616 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b6330d85-c778-4050-a7ec-3520d258f12c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:48.900916 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b6330d85-c778-4050-a7ec-3520d258f12c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98289) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 27 23:16:48.901438 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b6330d85-c778-4050-a7ec-3520d258f12c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'flavor' on Instance uuid 6db5e829-7198-437f-885e-7afcda6ded06 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:48.933280 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:48.933495 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:48.933695 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:48.933871 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:48.934025 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:48.935921 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Terminating instance
May 27 23:16:49.293394 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:49.438507 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:16:49.464024 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:49.486019 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:49.487981 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:49.505536 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:49.510593 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:49.627454 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a7cd0ebe-bbd8-4794-9f68-d3275694c76d req-d7aec018-c3c5-4ddd-a118-82d064f72c4c service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Received event network-vif-unplugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:49.628249 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a7cd0ebe-bbd8-4794-9f68-d3275694c76d req-d7aec018-c3c5-4ddd-a118-82d064f72c4c service nova] Acquiring lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:49.629084 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a7cd0ebe-bbd8-4794-9f68-d3275694c76d req-d7aec018-c3c5-4ddd-a118-82d064f72c4c service nova] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:49.629278 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a7cd0ebe-bbd8-4794-9f68-d3275694c76d req-d7aec018-c3c5-4ddd-a118-82d064f72c4c service nova] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:49.629655 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a7cd0ebe-bbd8-4794-9f68-d3275694c76d req-d7aec018-c3c5-4ddd-a118-82d064f72c4c service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] No waiting events found dispatching network-vif-unplugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:16:49.629975 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a7cd0ebe-bbd8-4794-9f68-d3275694c76d req-d7aec018-c3c5-4ddd-a118-82d064f72c4c service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Received event network-vif-unplugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:16:49.780686 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998764610000308 future=<Future at 0x726e386a7320 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:16:49.780686 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998260914000184 future=<Future at 0x726e386a7320 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:16:49.780906 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998054747999959 future=<Future at 0x726e386a7320 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:16:49.783286 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Instance destroyed successfully.
May 27 23:16:49.783726 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lazy-loading 'resources' on Instance uuid 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:49.928971 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:49.930983 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:49.953590 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:49.965011 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:49.992713 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:49.993201 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:50.075977 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ea522aae-5659-457a-8b06-c01a4794777d req-1d14bacf-bc4b-40e5-a52c-faf7f6b424fa service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Received event network-vif-unplugged-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:50.076292 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ea522aae-5659-457a-8b06-c01a4794777d req-1d14bacf-bc4b-40e5-a52c-faf7f6b424fa service nova] Acquiring lock "6db5e829-7198-437f-885e-7afcda6ded06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:50.076499 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ea522aae-5659-457a-8b06-c01a4794777d req-1d14bacf-bc4b-40e5-a52c-faf7f6b424fa service nova] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:50.076536 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ea522aae-5659-457a-8b06-c01a4794777d req-1d14bacf-bc4b-40e5-a52c-faf7f6b424fa service nova] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:50.076775 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ea522aae-5659-457a-8b06-c01a4794777d req-1d14bacf-bc4b-40e5-a52c-faf7f6b424fa service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] No waiting events found dispatching network-vif-unplugged-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:16:50.076775 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-ea522aae-5659-457a-8b06-c01a4794777d req-1d14bacf-bc4b-40e5-a52c-faf7f6b424fa service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Received unexpected event network-vif-unplugged-31d06057-37c3-493d-988a-26e88ad43978 for instance with vm_state active and task_state powering-off.
May 27 23:16:50.124114 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:16:50.222541 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999674316999972 future=<Future at 0x726e6a2b8cb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:16:50.226457 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Instance destroyed successfully.
May 27 23:16:50.226962 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b6330d85-c778-4050-a7ec-3520d258f12c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'numa_topology' on Instance uuid 6db5e829-7198-437f-885e-7afcda6ded06 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:50.287157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2125159277',display_name='tempest-TestEncryptedCinderVolumes-server-2125159277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-2125159277',id=64,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKYM4qXuY2Q/Eyw1ImqnPZoIN2kYmLHuuHih9u4JPQvnLdTpKnpq9SWbSbLzKvyOcAmUHVQZzxH212WtSK2XW5dUGDRD9Xz3ubS8oLoCFipc7EnNsa99HYvJ0DjkT/Qlg==',key_name='tempest-keypair-953699768',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:16:09Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2d4267649c9432993626e440932bf08',ramdisk_id='',reservation_id='r-9clhoway',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-274929604',owner_user_name='tempest-TestEncryptedCinderVolumes-274929604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6418d61428124c1c98659435dd6b8bff',uuid=8a03dbd9-b34d-468b-ac17-54efa1c4e9a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "address": "fa:16:3e:ae:84:8b", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap374c7ef3-e2", "ovs_interfaceid": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:16:50.287442 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converting VIF {"id": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "address": "fa:16:3e:ae:84:8b", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap374c7ef3-e2", "ovs_interfaceid": "374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:16:50.287869 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:84:8b,bridge_name='br-int',has_traffic_filtering=True,id=374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374c7ef3-e2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:16:50.288251 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:84:8b,bridge_name='br-int',has_traffic_filtering=True,id=374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374c7ef3-e2') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:16:50.290060 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:50.290310 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap374c7ef3-e2, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:50.291252 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:50.291964 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:50.296942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:50.297939 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:50.298061 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdde7842-9522-4d99-a1fc-4b4155a32eb6) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:50.298534 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:50.299127 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:50.303159 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:50.305538 np0000001565 nova-compute[98289]: INFO os_vif [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:84:8b,bridge_name='br-int',has_traffic_filtering=True,id=374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374c7ef3-e2')
May 27 23:16:50.306042 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Deleting instance files /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5_del
May 27 23:16:50.306764 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Deletion of /opt/stack/data/nova/instances/8a03dbd9-b34d-468b-ac17-54efa1c4e9a5_del complete
May 27 23:16:50.628905 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:50.629477 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:50.629477 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:50.629477 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:16:50.728906 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-b6330d85-c778-4050-a7ec-3520d258f12c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Object Instance<6db5e829-7198-437f-885e-7afcda6ded06> lazy-loaded attributes: flavor,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:16:50.729095 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b6330d85-c778-4050-a7ec-3520d258f12c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:16:50.812353 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Took 1.37 seconds to destroy the instance on the hypervisor.
May 27 23:16:50.813070 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:16:50.813432 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:16:50.813546 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:16:50.814027 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:50.879443 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:51.235284 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b6330d85-c778-4050-a7ec-3520d258f12c tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "6db5e829-7198-437f-885e-7afcda6ded06" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.337s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:51.283655 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:51.284006 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:51.650230 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:51.682460 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-190fa9f6-0187-4e75-be1c-e8a91a70e28d req-add1fea5-bb79-4023-8b02-28351342197e service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Received event network-vif-unplugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:51.683209 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-190fa9f6-0187-4e75-be1c-e8a91a70e28d req-add1fea5-bb79-4023-8b02-28351342197e service nova] Acquiring lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:51.683514 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-190fa9f6-0187-4e75-be1c-e8a91a70e28d req-add1fea5-bb79-4023-8b02-28351342197e service nova] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:51.683705 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-190fa9f6-0187-4e75-be1c-e8a91a70e28d req-add1fea5-bb79-4023-8b02-28351342197e service nova] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:51.683873 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-190fa9f6-0187-4e75-be1c-e8a91a70e28d req-add1fea5-bb79-4023-8b02-28351342197e service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] No waiting events found dispatching network-vif-unplugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:16:51.684050 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-190fa9f6-0187-4e75-be1c-e8a91a70e28d req-add1fea5-bb79-4023-8b02-28351342197e service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Received event network-vif-unplugged-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:16:51.737035 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:51.737488 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:51.788118 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lazy-loading 'flavor' on Instance uuid 5c2e5882-a178-4759-be58-b0e717d8dc0f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:51.822872 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:51.827946 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:51.831033 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Error from libvirt while getting description of instance-00000040: [Error Code 42] Domain not found: no domain with matching uuid '8a03dbd9-b34d-468b-ac17-54efa1c4e9a5' (instance-00000040): libvirt.libvirtError: Domain not found: no domain with matching uuid '8a03dbd9-b34d-468b-ac17-54efa1c4e9a5' (instance-00000040)
May 27 23:16:51.832854 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:16:51.834294 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:16:51.835764 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:16:51.837705 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:16:51.838557 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:51.884904 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:16:51.885555 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=12906MB free_disk=72.77946090698242GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:16:51.885782 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:51.886146 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:52.148508 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d0a6921f-2363-4cfa-a4ee-01e8222f029b req-716226cc-1fc2-4b23-ab4f-6b11e8f52d39 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Received event network-vif-unplugged-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:52.148713 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d0a6921f-2363-4cfa-a4ee-01e8222f029b req-716226cc-1fc2-4b23-ab4f-6b11e8f52d39 service nova] Acquiring lock "6db5e829-7198-437f-885e-7afcda6ded06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:52.148874 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d0a6921f-2363-4cfa-a4ee-01e8222f029b req-716226cc-1fc2-4b23-ab4f-6b11e8f52d39 service nova] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:52.148995 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d0a6921f-2363-4cfa-a4ee-01e8222f029b req-716226cc-1fc2-4b23-ab4f-6b11e8f52d39 service nova] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:52.149110 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d0a6921f-2363-4cfa-a4ee-01e8222f029b req-716226cc-1fc2-4b23-ab4f-6b11e8f52d39 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] No waiting events found dispatching network-vif-unplugged-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:16:52.149232 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-d0a6921f-2363-4cfa-a4ee-01e8222f029b req-716226cc-1fc2-4b23-ab4f-6b11e8f52d39 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Received unexpected event network-vif-unplugged-31d06057-37c3-493d-988a-26e88ad43978 for instance with vm_state stopped and task_state None.
May 27 23:16:52.149345 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d0a6921f-2363-4cfa-a4ee-01e8222f029b req-716226cc-1fc2-4b23-ab4f-6b11e8f52d39 service nova] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Received event network-vif-deleted-374c7ef3-e292-40d0-b5ba-b42a6f9fe4dc {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:52.291660 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Ignoring supplied device name: /dev/vdb
May 27 23:16:52.324246 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Took 1.51 seconds to deallocate network for instance.
May 27 23:16:52.794178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:52.831839 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:52.945603 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance fa66e95f-2701-4fde-92d4-668f096aa9cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:16:52.945749 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 6db5e829-7198-437f-885e-7afcda6ded06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:16:52.945883 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:16:52.946008 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 5c2e5882-a178-4759-be58-b0e717d8dc0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:16:52.946134 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance b0ad0e52-02bc-40ff-992e-64d9d660c266 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:16:52.946363 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:16:52.946532 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:16:51 up 45 min,  2 users,  load average: 3.27, 4.46, 4.16\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_0d095aed76494dd7b4c64e9209c14483': '2', 'io_workload': '0', 'num_vm_stopped': '1', 'num_proj_5dda425dab8946dc926808806eeedced': '1', 'num_task_deleting': '1', 'num_proj_e2d4267649c9432993626e440932bf08': '1', 'num_proj_8ed98b56db004061b06363a72405f6ae': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:16:53.169997 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:16:53.170342 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:16:53.672980 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:16:53.851020 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:53.851481 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:53.851592 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Attaching volume 11264d72-68fe-4c2b-b63a-b896204d32d1 to /dev/vdb
May 27 23:16:53.888407 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:16:53.899684 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:16:53.923669 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:16:53.965520 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:16:53.965801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:16:53.974184 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:16:53.975144 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fece:a0a4', 'fe80::dcaa:c7ff:fef8:d23c', 'fe80::fc16:3eff:feda:71e2', 'fe80::3ca1:7dff:fece:9122', 'fe80::fc16:3eff:fe2e:1640'] 
May 27 23:16:53.975282 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:16:53.975446 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:16:53.975717 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:16:53.975985 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Updating existing volume attachment record: d5a2d240-ddf9-4c28-924a-bccef0e6773f {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:16:54.181143 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:16:54.181343 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.295s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:54.181800 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.350s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:54.182319 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:16:54.294716 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:54.419724 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:16:54.420013 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:16:54.524484 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:16:54.524800 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11264d72-68fe-4c2b-b63a-b896204d32d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:16:54.524932 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:16:54.525295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:16:54.525511 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11264d72-68fe-4c2b-b63a-b896204d32d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:16:54.539210 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:16:54.539900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:16:54.540382 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:16:54.540581 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:16:54.540974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:16:54.541580 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:16:54.550708 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:16:54.550708 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:54.555738 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:16:54.555738 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:54.561161 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1] added
May 27 23:16:54.561161 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:16:54.561161 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:54.561161 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:54.561161 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:54.561161 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:54.561161 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:54.561383 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:16:54.561541 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0209(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:16:54.561623 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:16:54.565981 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1] added
May 27 23:16:54.565981 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:16:54.565981 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:54.565981 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:54.565981 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:16:54.565981 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:16:54.565981 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:54.566237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:16:54.566311 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:16:54.566522 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:16:54.923013 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:16:54.941291 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "6db5e829-7198-437f-885e-7afcda6ded06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:54.941556 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "6db5e829-7198-437f-885e-7afcda6ded06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:54.941798 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "6db5e829-7198-437f-885e-7afcda6ded06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:16:54.941988 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:16:54.942167 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "6db5e829-7198-437f-885e-7afcda6ded06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:54.944087 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Terminating instance
May 27 23:16:55.298596 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:55.430349 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.249s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:55.447133 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:16:55.450958 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Instance destroyed successfully.
May 27 23:16:55.451325 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'resources' on Instance uuid 6db5e829-7198-437f-885e-7afcda6ded06 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:55.481561 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Deleted allocations for instance 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5
May 27 23:16:55.562234 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:16:55.567449 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:16:55.575273 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:16:55.575273 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:16:55.581223 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:16:55.581223 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:55.587671 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:55.594248 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:55.602684 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.602684 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.602684 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.602684 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.602684 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.602684 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.602684 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:55.602958 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.602958 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.602958 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.602958 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.602958 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.602958 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.602958 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:55.611026 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.611026 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.611026 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.611026 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.611026 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.611026 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.611026 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:55.611185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.611185 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.611185 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.611185 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.611185 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.611185 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.611185 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:55.648292 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1, portal: 192.168.50.100,3260]
May 27 23:16:55.648292 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1, portal: 192.168.50.100,3260] successful.
May 27 23:16:55.648292 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:55.658645 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1, portal: 192.168.40.100,3260]
May 27 23:16:55.658645 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1, portal: 192.168.40.100,3260] successful.
May 27 23:16:55.658645 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:55.659121 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:55.673319 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:55.674959 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.674959 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.674959 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.674959 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.674959 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.674959 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.674959 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:55.674959 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:55.674959 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:55.675160 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.675160 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.675160 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.675160 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.675160 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.675160 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.675160 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:55.675160 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:55.675160 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:55.675515 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:55.675615 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:16:55.676488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] HCTL ('13', '-', '-', 0) found on session 172 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:16:55.676627 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:16:55.691873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Searching for a device in session 172 and hctl ['13', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:16:55.693376 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.693376 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.693376 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.693376 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.693376 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.693376 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.693376 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:55.693376 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:55.693376 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:55.693699 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.693699 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:55.693699 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.693699 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:55.693699 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.693699 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:55.693699 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:55.693699 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:55.693699 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:55.694021 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:55.694021 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:16:55.694866 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] HCTL ('14', '-', '-', 0) found on session 173 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:16:55.695025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:16:55.708756 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Searching for a device in session 173 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:16:55.708756 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11264d72-68fe-4c2b-b63a-b896204d32d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:16:55.953933 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-463731406',display_name='tempest-TestVolumeBootPattern-server-463731406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-463731406',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbXjNqZIkBKnP/+2930HFp9hdiI6QWACfhegL2HjQuYxyl97n7kx0ZdgHYrA5w7hNmqJA9hz6FXJH5saBA+yfxXYRQZt7r7Q+RorNeKJdqAMODXSbOrlvm9yjCeKn/NGQ==',key_name='tempest-keypair-2044399334',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:16:07Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-cj2mrips',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=6db5e829-7198-437f-885e-7afcda6ded06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "31d06057-37c3-493d-988a-26e88ad43978", "address": "fa:16:3e:30:f1:2b", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d06057-37", "ovs_interfaceid": "31d06057-37c3-493d-988a-26e88ad43978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:16:55.954520 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "31d06057-37c3-493d-988a-26e88ad43978", "address": "fa:16:3e:30:f1:2b", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d06057-37", "ovs_interfaceid": "31d06057-37c3-493d-988a-26e88ad43978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:16:55.954841 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=31d06057-37c3-493d-988a-26e88ad43978,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d06057-37') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:16:55.955106 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=31d06057-37c3-493d-988a-26e88ad43978,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d06057-37') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:16:55.956501 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:55.956762 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31d06057-37, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:55.957849 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:55.958635 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:55.959128 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:55.959700 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:55.959836 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a62da1f6-4b6a-438f-ad25-e7587c737de1) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:16:55.960234 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:55.960682 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:16:55.961148 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:55.962782 np0000001565 nova-compute[98289]: INFO os_vif [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=31d06057-37c3-493d-988a-26e88ad43978,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d06057-37')
May 27 23:16:55.964006 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:16:55.964363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:16:55.964579 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:16:56.489356 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-90429dab-b0ef-42b8-b5ff-b37f42d5e2d0 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "8a03dbd9-b34d-468b-ac17-54efa1c4e9a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.556s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:16:56.691832 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Searching for a device in session 172 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:16:56.691988 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '11264d72-68fe-4c2b-b63a-b896204d32d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:16:57.322850 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:57.555062 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Found WWN 330000000e33bceea for multipath device dm-9 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:16:57.555294 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:57.555478 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000e33bceea', 'path': '/dev/dm-9', 'multipath_id': '330000000e33bceea'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:16:57.555598 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e33bceea', 'path': '/dev/dm-9', 'multipath_id': '330000000e33bceea'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:16:57.556157 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.591s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:16:57.556522 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:16:57.556651 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:16:57.558435 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lazy-loading 'flavor' on Instance uuid 5c2e5882-a178-4759-be58-b0e717d8dc0f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:16:57.582198 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:57.582198 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:57.582198 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:57.582198 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:57.582198 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:57.582198 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:57.582198 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:57.582198 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:57.582198 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:16:57.582537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:57.582537 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:16:57.582537 np0000001565 nova-compute[98289]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:57.582537 np0000001565 nova-compute[98289]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2 (non-flash)
May 27 23:16:57.582537 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:57.582537 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:16:57.582537 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:57.582537 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:16:57.582537 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:16:57.582537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', '167'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', '172'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', '173')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:16:57.582537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', '166')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:16:57.583387 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2', '167')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:16:57.584060 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e605ef740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2'): ({'sdd'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:16:57.584259 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Removing multipathed devices sdd, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:16:57.584649 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flush multipath device 330000000051606d1 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:16:57.651062 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:16:57.694807 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:16:57.745828 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:16:57.746053 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:16:57.747606 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:16:57.759452 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:16:57.759736 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:16:57.771800 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:57.807209 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2, portal: 192.168.40.100,3260]
May 27 23:16:57.807209 np0000001565 nova-compute[98289]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2, portal: 192.168.40.100,3260] successful.
May 27 23:16:57.807209 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:57.824073 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:57.836539 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:57.869630 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 167, target: iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2, portal: 192.168.50.100,3260]
May 27 23:16:57.869630 np0000001565 nova-compute[98289]: Logout of [sid: 167, target: iqn.2023-03.storpool.com:os--volume-3ca0f3e3-2af9-47b6-b667-28dc7ce730c2, portal: 192.168.50.100,3260] successful.
May 27 23:16:57.869630 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:57.889160 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:16:57.889433 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:16:57.889563 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== disconnect_volume: return (1924ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:16:57.889719 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:16:57.889989 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Deleting instance files /opt/stack/data/nova/instances/6db5e829-7198-437f-885e-7afcda6ded06_del
May 27 23:16:57.890531 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Deletion of /opt/stack/data/nova/instances/6db5e829-7198-437f-885e-7afcda6ded06_del complete
May 27 23:16:58.060913 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Attempting to attach volume 11264d72-68fe-4c2b-b63a-b896204d32d1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:16:58.062172 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:16:58.062172 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:16:58.062172 np0000001565 nova-compute[98289]:   <alias name="ua-11264d72-68fe-4c2b-b63a-b896204d32d1"/>
May 27 23:16:58.062172 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-9"/>
May 27 23:16:58.062172 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:16:58.062172 np0000001565 nova-compute[98289]:   <serial>11264d72-68fe-4c2b-b63a-b896204d32d1</serial>
May 27 23:16:58.062172 np0000001565 nova-compute[98289]: </disk>
May 27 23:16:58.062172 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:16:58.396278 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Took 2.95 seconds to destroy the instance on the hypervisor.
May 27 23:16:58.396841 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:16:58.397104 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:16:58.397199 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:16:58.397467 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:58.504487 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:16:58.888758 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-92ad44f4-9093-4bfa-9cc4-c016802f344b req-b6e824b9-e8a3-477b-9980-fa24ff80a986 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Received event network-vif-deleted-31d06057-37c3-493d-988a-26e88ad43978 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:16:58.889094 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-92ad44f4-9093-4bfa-9cc4-c016802f344b req-b6e824b9-e8a3-477b-9980-fa24ff80a986 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Neutron deleted interface 31d06057-37c3-493d-988a-26e88ad43978; detaching it from the instance and deleting it from the info cache
May 27 23:16:58.890495 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-92ad44f4-9093-4bfa-9cc4-c016802f344b req-b6e824b9-e8a3-477b-9980-fa24ff80a986 service nova] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Detach interface failed, port_id=31d06057-37c3-493d-988a-26e88ad43978, reason: Instance 6db5e829-7198-437f-885e-7afcda6ded06 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:16:59.296448 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:16:59.347103 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:16:59.688905 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:59.689234 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:59.689234 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:16:59.689304 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] No VIF found with MAC fa:16:3e:da:71:e2, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:16:59.849253 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Took 1.45 seconds to deallocate network for instance.
May 27 23:17:00.391931 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Took 0.54 seconds to detach 1 volumes for instance.
May 27 23:17:00.896806 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:00.897087 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:00.960028 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:01.142848 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:17:01.143131 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:17:01.235614 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-51020237-c921-4a44-b354-51dbeef9507f tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.384s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:01.645471 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:17:02.152137 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.255s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:02.199921 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deleted allocations for instance 6db5e829-7198-437f-885e-7afcda6ded06
May 27 23:17:03.208640 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-964e81ec-9340-425a-83fc-b256ac59b384 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "6db5e829-7198-437f-885e-7afcda6ded06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.267s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:04.182142 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:17:04.182499 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:17:04.182725 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:17:04.182974 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:17:04.183188 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:17:04.183358 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:17:04.183661 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:17:04.183866 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.94 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:17:04.297862 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:04.779351 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00045306199990591267 future=<Future at 0x726e386a7320 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:17:04.779556 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:17:04.779671 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.44252380299985816 future=<Future at 0x726e6a2b8cb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:17:04.779788 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.4423878849997891 future=<Future at 0x726e6a2b8cb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:17:04.780282 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Emitting event <LifecycleEvent: 1779923809.7787588, 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:17:04.780458 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] VM Stopped (Lifecycle Event)
May 27 23:17:05.127715 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:17:05.128059 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:17:05.222619 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004001430002062989 future=<Future at 0x726e6a2b8cb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:17:05.223431 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Emitting event <LifecycleEvent: 1779923810.2221127, 6db5e829-7198-437f-885e-7afcda6ded06 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:17:05.224183 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:17:05.224402 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] VM Stopped (Lifecycle Event)
May 27 23:17:05.283793 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 8a03dbd9-b34d-468b-ac17-54efa1c4e9a5] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:05.728036 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2c624f52-2a30-4d5f-9580-9d63c013527a tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: 6db5e829-7198-437f-885e-7afcda6ded06] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:05.959910 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:08.693138 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:08.693552 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "c5922e78-9736-4a78-88dd-e32d56e81658" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:09.195116 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:17:09.299512 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:09.745325 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:09.745772 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:09.748799 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:17:09.748969 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Claim successful on node np0000001565
May 27 23:17:10.959971 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:11.058726 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:17:11.058904 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:17:11.561230 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:17:12.069019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.323s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:12.069542 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:17:12.576532 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:17:12.576532 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:17:12.576532 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:12.576532 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:12.644351 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31823a44e786429f80ba607958f8b63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda425dab8946dc926808806eeedced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:17:13.077466 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:17:13.102352 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Successfully created port: f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:17:13.578606 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Successfully updated port: f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:17:13.582062 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:17:13.626440 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-00951cd5-2a9d-4859-b646-b73236e9fd81 req-fc7a78af-80db-4abe-bc50-ed337cf37a2b service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-changed-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:13.626510 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-00951cd5-2a9d-4859-b646-b73236e9fd81 req-fc7a78af-80db-4abe-bc50-ed337cf37a2b service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Refreshing instance network info cache due to event network-changed-f4cd13a8-b033-4d11-b8a3-586f1b916698. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:17:13.626652 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-00951cd5-2a9d-4859-b646-b73236e9fd81 req-fc7a78af-80db-4abe-bc50-ed337cf37a2b service nova] Acquiring lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:17:13.626771 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-00951cd5-2a9d-4859-b646-b73236e9fd81 req-fc7a78af-80db-4abe-bc50-ed337cf37a2b service nova] Acquired lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:17:13.626899 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-00951cd5-2a9d-4859-b646-b73236e9fd81 req-fc7a78af-80db-4abe-bc50-ed337cf37a2b service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Refreshing network info cache for port f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:17:14.080740 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:17:14.096558 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Booting with volume 132d63da-df76-4b59-a7bf-f9f58ec107b1 at /dev/vda
May 27 23:17:14.130068 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-00951cd5-2a9d-4859-b646-b73236e9fd81 req-fc7a78af-80db-4abe-bc50-ed337cf37a2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:14.148231 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:17:14.166891 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:17:14.190307 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:17:14.213116 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-00951cd5-2a9d-4859-b646-b73236e9fd81 req-fc7a78af-80db-4abe-bc50-ed337cf37a2b service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:17:14.232357 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:17:14.234002 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:17:14.249381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:17:14.249381 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fece:a0a4', 'fe80::dcaa:c7ff:fef8:d23c', 'fe80::fc16:3eff:feda:71e2', 'fe80::3ca1:7dff:fece:9122', 'fe80::fc16:3eff:fe2e:1640'] 
May 27 23:17:14.249381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:17:14.249381 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:17:14.249381 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:17:14.249815 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Updating existing volume attachment record: 20858cf5-0b21-401a-b39f-b3c855fa0e78 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:17:14.304763 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:14.352834 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-00951cd5-2a9d-4859-b646-b73236e9fd81 req-fc7a78af-80db-4abe-bc50-ed337cf37a2b service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:17:14.855556 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-00951cd5-2a9d-4859-b646-b73236e9fd81 req-fc7a78af-80db-4abe-bc50-ed337cf37a2b service nova] Releasing lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:17:14.856070 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquired lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:17:14.856376 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:17:15.415962 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:17:15.585728 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:15.748304 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Updating instance_info_cache with network_info: [{"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:17:15.962612 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:16.250430 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Releasing lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:17:16.250828 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Instance network_info: |[{"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:17:16.351646 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:17:16.352714 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:17:16.352951 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Creating image(s)
May 27 23:17:16.353288 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:17:16.353983 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Ensure instance console log exists: /opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:17:16.354198 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:16.354499 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:16.354642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:16.355135 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Start _get_guest_xml network_info=[{"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '20858cf5-0b21-401a-b39f-b3c855fa0e78', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c5922e78-9736-4a78-88dd-e32d56e81658', 'attached_at': '', 'detached_at': '', 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'serial': '132d63da-df76-4b59-a7bf-f9f58ec107b1'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:17:16.359671 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:17:16.360688 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1151699872', uuid='c5922e78-9736-4a78-88dd-e32d56e81658'), owner=OwnerMeta(userid='31823a44e786429f80ba607958f8b63e', username='tempest-TestVolumeBootPattern-314561297-project-member', projectid='5dda425dab8946dc926808806eeedced', projectname='tempest-TestVolumeBootPattern-314561297'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923836.3603828) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:17:16.361724 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:17:16.361993 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:17:16.363851 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:17:16.364081 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:17:16.365306 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:17:16.365649 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:17:16.365782 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:17:16.365877 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:17:16.366011 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:17:16.366092 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:17:16.366179 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:17:16.366371 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:17:16.366506 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:17:16.366683 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:17:16.366759 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:17:16.366869 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:17:16.377476 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:17:16.377843 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:17:16.378029 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:17:16.378400 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:17:16.378630 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:17:16.391058 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:17:16.391695 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:17:16.392030 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:17:16.392261 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:17:16.392646 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:17:16.392800 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:17:16.403507 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:17:16.403507 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:16.408318 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:17:16.408318 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:16.416120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1] added
May 27 23:17:16.416120 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:17:16.416120 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:16.416120 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:16.416120 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:16.416120 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:16.416120 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:16.416545 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:17:16.416639 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:17:16.416839 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:17:16.419346 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1] added
May 27 23:17:16.419346 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:17:16.419346 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:16.419346 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:16.419346 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:16.419346 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:16.419346 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:16.419495 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:17:16.419732 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:17:16.419809 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:17:17.417295 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:17:17.420193 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:17:17.429092 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:17:17.429092 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:17:17.434501 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:17:17.434501 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:17.441060 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:17.445967 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:17.454614 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.454614 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.454614 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.454614 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.454614 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.454614 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.454614 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:17.454823 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.454823 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.454823 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.454823 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.454823 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.454823 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.454823 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:17.461914 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.461914 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.461914 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.461914 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.461914 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.461914 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.461914 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:17.462184 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.462184 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.462184 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.462184 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.462184 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.462184 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.462184 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:17.486458 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.40.100,3260]
May 27 23:17:17.486458 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.40.100,3260] successful.
May 27 23:17:17.486458 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:17.496719 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:17.507549 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.50.100,3260]
May 27 23:17:17.507549 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.50.100,3260] successful.
May 27 23:17:17.507549 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:17.512345 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.512345 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.512345 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.512345 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.512345 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.512345 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.512345 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:17.512345 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:17.512345 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:17.512712 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.512712 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.512712 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.512712 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.512712 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.512712 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.512712 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:17.512712 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:17.512712 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:17.512712 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.121s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:17:17.513076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:17:17.513729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('8', '-', '-', 0) found on session 177 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:17:17.513837 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:17:17.519048 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:17.528156 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 177 and hctl ['8', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:17:17.536694 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.536694 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.536694 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.536694 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.536694 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.536694 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.536694 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:17.536694 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:17.536694 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:17.536931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.536931 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:17.536931 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.536931 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:17.536931 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.536931 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:17.536931 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:17.536931 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:17.536931 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:17.537101 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:17:17.537180 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:17:17.537970 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('9', '-', '-', 0) found on session 178 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:17:17.538073 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:17:17.552337 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 178 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:17:17.552541 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:17:17.576401 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "2232483d-3400-4452-a398-d253b4f6cb88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:17.576730 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "2232483d-3400-4452-a398-d253b4f6cb88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:18.078640 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:17:18.527918 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 177 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:17:18.528462 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:17:18.622548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:18.622744 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:18.625620 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:17:18.625762 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Claim successful on node np0000001565
May 27 23:17:19.411893 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Found WWN 330000000a51c1468 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:17:19.412099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:17:19.412257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000a51c1468', 'path': '/dev/dm-0', 'multipath_id': '330000000a51c1468'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:17:19.412421 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a51c1468', 'path': '/dev/dm-0', 'multipath_id': '330000000a51c1468'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:17:19.893977 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:17:19.894295 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:17:19.917012 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1151699872',display_name='tempest-TestVolumeBootPattern-server-1151699872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1151699872',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrAVGTgm2VzIShXJzbfnm8BU22rDg/lkgw+oDhkdsWrFKf0925HUM6hZfOKvJiwz8AJs5At33nJv2EgruZOHIVLKt07xsBG0gcYb9z1nfWS45ND0vVM4HZYodJ6dw3i9Q==',key_name='tempest-keypair-1096794055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-j3y0k0sb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:17:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=c5922e78-9736-4a78-88dd-e32d56e81658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:17:19.917216 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:17:19.918659 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:17:19.919746 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'pci_devices' on Instance uuid c5922e78-9736-4a78-88dd-e32d56e81658 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:17:20.396871 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:17:20.422350 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] End _get_guest_xml xml=<domain type="qemu">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <uuid>c5922e78-9736-4a78-88dd-e32d56e81658</uuid>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <name>instance-00000043</name>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPattern-server-1151699872</nova:name>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:17:16</nova:creationTime>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:user uuid="31823a44e786429f80ba607958f8b63e">tempest-TestVolumeBootPattern-314561297-project-member</nova:user>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:project uuid="5dda425dab8946dc926808806eeedced">tempest-TestVolumeBootPattern-314561297</nova:project>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         <nova:port uuid="f4cd13a8-b033-4d11-b8a3-586f1b916698">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <system>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <entry name="serial">c5922e78-9736-4a78-88dd-e32d56e81658</entry>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <entry name="uuid">c5922e78-9736-4a78-88dd-e32d56e81658</entry>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     </system>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <os>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   </os>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <features>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   </features>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   <devices>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/disk.config"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     </disk>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <alias name="ua-132d63da-df76-4b59-a7bf-f9f58ec107b1"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <serial>132d63da-df76-4b59-a7bf-f9f58ec107b1</serial>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     </disk>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ee:5c:c0"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <target dev="tapf4cd13a8-b0"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     </interface>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/console.log" append="off"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     </serial>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <video>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     </video>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     </rng>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:   </devices>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]: </domain>
May 27 23:17:20.422350 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:17:20.424205 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Preparing to wait for external event network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:17:20.424205 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:20.424205 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:20.424205 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:20.424205 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1151699872',display_name='tempest-TestVolumeBootPattern-server-1151699872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1151699872',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrAVGTgm2VzIShXJzbfnm8BU22rDg/lkgw+oDhkdsWrFKf0925HUM6hZfOKvJiwz8AJs5At33nJv2EgruZOHIVLKt07xsBG0gcYb9z1nfWS45ND0vVM4HZYodJ6dw3i9Q==',key_name='tempest-keypair-1096794055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-j3y0k0sb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:17:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=c5922e78-9736-4a78-88dd-e32d56e81658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:17:20.424205 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:17:20.424205 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:17:20.424574 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:17:20.425041 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:20.425285 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:20.425605 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:17:20.426223 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:20.426376 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c0a7325-8cc5-5a8c-afe4-4c9babda4120', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:20.438006 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:20.438892 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:17:20.441084 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:20.441211 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4cd13a8-b0, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:20.441511 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4cd13a8-b0, col_values=(('qos', UUID('169e3af1-93d1-460a-8963-212df4c98ab1')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:20.441657 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4cd13a8-b0, col_values=(('external_ids', {'iface-id': 'f4cd13a8-b033-4d11-b8a3-586f1b916698', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:5c:c0', 'vm-uuid': 'c5922e78-9736-4a78-88dd-e32d56e81658'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:20.442265 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:20.443621 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:17:20.447550 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:20.448267 np0000001565 nova-compute[98289]: INFO os_vif [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0')
May 27 23:17:20.464638 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "e54d5157-0f40-462b-84c9-c6ac326ed182" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:20.464807 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:20.903671 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.281s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:20.904185 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:17:20.966347 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:17:21.410672 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:17:21.410851 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:17:21.411172 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:21.411434 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:21.474092 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6418d61428124c1c98659435dd6b8bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d4267649c9432993626e440932bf08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:17:21.532454 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:21.532662 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:21.535676 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:17:21.535798 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Claim successful on node np0000001565
May 27 23:17:21.914074 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:17:21.946479 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Successfully created port: f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:17:21.963686 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:17:21.963790 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:17:21.963914 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No VIF found with MAC fa:16:3e:ee:5c:c0, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:17:21.964515 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Using config drive
May 27 23:17:22.419771 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:17:22.444035 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Successfully updated port: f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:17:22.469928 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:22.496654 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-14f87ff3-ba99-4cee-86a9-2977aa422078 req-0146b78f-dafd-49a4-8094-6afa3c14a68c service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Received event network-changed-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:22.496864 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-14f87ff3-ba99-4cee-86a9-2977aa422078 req-0146b78f-dafd-49a4-8094-6afa3c14a68c service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Refreshing instance network info cache due to event network-changed-f6f9a8b2-de44-424a-a7cc-b0c2204af066. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:17:22.497068 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-14f87ff3-ba99-4cee-86a9-2977aa422078 req-0146b78f-dafd-49a4-8094-6afa3c14a68c service nova] Acquiring lock "refresh_cache-2232483d-3400-4452-a398-d253b4f6cb88" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:17:22.497206 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-14f87ff3-ba99-4cee-86a9-2977aa422078 req-0146b78f-dafd-49a4-8094-6afa3c14a68c service nova] Acquired lock "refresh_cache-2232483d-3400-4452-a398-d253b4f6cb88" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:17:22.497414 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-14f87ff3-ba99-4cee-86a9-2977aa422078 req-0146b78f-dafd-49a4-8094-6afa3c14a68c service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Refreshing network info cache for port f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:17:22.605587 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Creating config drive at /opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/disk.config
May 27 23:17:22.609151 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_lultfcy {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:17:22.756186 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_lultfcy" returned: 0 in 0.147s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:17:22.883233 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:17:22.883494 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:17:22.923977 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Booting with volume 0329c084-0daf-4ac7-9cb6-e3ae3ed36807 at /dev/vda
May 27 23:17:22.950886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "refresh_cache-2232483d-3400-4452-a398-d253b4f6cb88" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:17:22.960392 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:17:22.971916 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:17:22.991258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:17:23.009188 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-14f87ff3-ba99-4cee-86a9-2977aa422078 req-0146b78f-dafd-49a4-8094-6afa3c14a68c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:23.090782 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-14f87ff3-ba99-4cee-86a9-2977aa422078 req-0146b78f-dafd-49a4-8094-6afa3c14a68c service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:17:23.109290 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:17:23.109590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:17:23.118604 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:17:23.119631 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fece:a0a4', 'fe80::dcaa:c7ff:fef8:d23c', 'fe80::fc16:3eff:feda:71e2', 'fe80::3ca1:7dff:fece:9122', 'fe80::fc16:3eff:fe2e:1640'] 
May 27 23:17:23.119811 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:17:23.119966 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:17:23.120287 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:17:23.120602 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Updating existing volume attachment record: b64f0eb3-0cf1-4b49-8d15-e383ed6bd9d4 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:17:23.197663 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:23.220711 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:23.243003 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-14f87ff3-ba99-4cee-86a9-2977aa422078 req-0146b78f-dafd-49a4-8094-6afa3c14a68c service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:17:23.314489 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:23.388435 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:17:23.397855 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-df664910-a164-46a3-8e16-0bcf9d41e2d7 req-60234b97-526c-4398-9dcf-01a8ce96a213 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:23.397855 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-df664910-a164-46a3-8e16-0bcf9d41e2d7 req-60234b97-526c-4398-9dcf-01a8ce96a213 service nova] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:23.397944 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-df664910-a164-46a3-8e16-0bcf9d41e2d7 req-60234b97-526c-4398-9dcf-01a8ce96a213 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:23.398220 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-df664910-a164-46a3-8e16-0bcf9d41e2d7 req-60234b97-526c-4398-9dcf-01a8ce96a213 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:23.398402 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-df664910-a164-46a3-8e16-0bcf9d41e2d7 req-60234b97-526c-4398-9dcf-01a8ce96a213 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Processing event network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:17:23.581109 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:23.583392 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:23.585028 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:23.602996 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:23.746859 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-14f87ff3-ba99-4cee-86a9-2977aa422078 req-0146b78f-dafd-49a4-8094-6afa3c14a68c service nova] Releasing lock "refresh_cache-2232483d-3400-4452-a398-d253b4f6cb88" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:17:23.747647 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquired lock "refresh_cache-2232483d-3400-4452-a398-d253b4f6cb88" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:17:23.747647 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:17:23.895906 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.363s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:23.896353 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:17:23.932064 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:17:23.933371 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923843.9328728, c5922e78-9736-4a78-88dd-e32d56e81658 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:17:23.933563 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] VM Started (Lifecycle Event)
May 27 23:17:23.934920 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:17:23.942084 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Instance spawned successfully.
May 27 23:17:23.942625 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:17:24.314130 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:24.326852 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:17:24.405064 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:17:24.405064 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:17:24.405064 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:24.405064 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:24.438392 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:24.441222 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:17:24.454705 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:24.454883 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:24.455085 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:24.455344 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:24.455913 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:24.456149 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:24.487349 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5afdb0f7fb014ac993fc36395de07be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d095aed76494dd7b4c64e9209c14483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:17:24.556960 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:24.708379 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Updating instance_info_cache with network_info: [{"id": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "address": "fa:16:3e:98:e8:7d", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f9a8b2-de", "ovs_interfaceid": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:17:24.908440 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:17:24.949803 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:17:24.950267 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923844.9497907, c5922e78-9736-4a78-88dd-e32d56e81658 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:17:24.950267 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] VM Paused (Lifecycle Event)
May 27 23:17:24.967085 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Took 8.62 seconds to spawn the instance on the hypervisor.
May 27 23:17:24.967470 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:25.003284 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Successfully created port: 37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:17:25.210973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Releasing lock "refresh_cache-2232483d-3400-4452-a398-d253b4f6cb88" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:17:25.211323 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Instance network_info: |[{"id": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "address": "fa:16:3e:98:e8:7d", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f9a8b2-de", "ovs_interfaceid": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:17:25.216792 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:17:25.217546 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:17:25.217747 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Creating image(s)
May 27 23:17:25.218032 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:17:25.218270 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Ensure instance console log exists: /opt/stack/data/nova/instances/2232483d-3400-4452-a398-d253b4f6cb88/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:17:25.218876 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:25.219044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:25.219178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:25.219923 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Start _get_guest_xml network_info=[{"id": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "address": "fa:16:3e:98:e8:7d", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f9a8b2-de", "ovs_interfaceid": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b64f0eb3-0cf1-4b49-8d15-e383ed6bd9d4', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2232483d-3400-4452-a398-d253b4f6cb88', 'attached_at': '', 'detached_at': '', 'volume_id': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'serial': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:17:25.223350 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:17:25.224248 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1477133638', uuid='2232483d-3400-4452-a398-d253b4f6cb88'), owner=OwnerMeta(userid='6418d61428124c1c98659435dd6b8bff', username='tempest-TestEncryptedCinderVolumes-274929604-project-member', projectid='e2d4267649c9432993626e440932bf08', projectname='tempest-TestEncryptedCinderVolumes-274929604'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "address": "fa:16:3e:98:e8:7d", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f9a8b2-de", "ovs_interfaceid": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923845.223945) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:17:25.225848 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:17:25.226151 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:17:25.227909 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:17:25.228105 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:17:25.228964 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:17:25.229240 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:17:25.229380 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:17:25.229473 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:17:25.229584 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:17:25.229684 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:17:25.229758 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:17:25.229855 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:17:25.229935 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:17:25.230085 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:17:25.230177 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:17:25.230284 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:17:25.241554 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:17:25.241814 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:17:25.241938 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:17:25.242284 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:17:25.242481 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:17:25.256472 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:17:25.257028 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:17:25.257529 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:17:25.257807 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:17:25.258140 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:17:25.258392 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:17:25.271911 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:17:25.271911 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:25.278966 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:17:25.278966 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:25.296870 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807] added
May 27 23:17:25.296870 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:17:25.296870 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:25.296870 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:25.296870 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:25.296870 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:25.296870 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:25.297122 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:17:25.297452 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.039(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:17:25.297766 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:17:25.304267 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807] added
May 27 23:17:25.304267 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:17:25.304267 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:25.304267 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:25.304267 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:25.304267 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:25.304267 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:25.304476 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:17:25.304596 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0468(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:17:25.304744 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:17:25.414523 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:17:25.453094 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:25.454803 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923845.454606, c5922e78-9736-4a78-88dd-e32d56e81658 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:17:25.455300 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] VM Resumed (Lifecycle Event)
May 27 23:17:25.458211 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:25.485300 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e949c9e6-0b18-4708-a572-2e88f2b21516 req-cfdc0332-2a65-4fd8-94a8-b95eeb248728 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:25.485519 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e949c9e6-0b18-4708-a572-2e88f2b21516 req-cfdc0332-2a65-4fd8-94a8-b95eeb248728 service nova] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:25.488176 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e949c9e6-0b18-4708-a572-2e88f2b21516 req-cfdc0332-2a65-4fd8-94a8-b95eeb248728 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:25.490690 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e949c9e6-0b18-4708-a572-2e88f2b21516 req-cfdc0332-2a65-4fd8-94a8-b95eeb248728 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:25.490875 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e949c9e6-0b18-4708-a572-2e88f2b21516 req-cfdc0332-2a65-4fd8-94a8-b95eeb248728 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] No waiting events found dispatching network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:17:25.491039 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-e949c9e6-0b18-4708-a572-2e88f2b21516 req-cfdc0332-2a65-4fd8-94a8-b95eeb248728 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received unexpected event network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 for instance with vm_state active and task_state None.
May 27 23:17:25.492878 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Took 15.79 seconds to build instance.
May 27 23:17:25.553594 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Successfully updated port: 37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:17:25.918401 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Booting with volume d2d4bec6-c18c-4c78-ba4b-8451875747f5 at /dev/vda
May 27 23:17:25.957498 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:25.959901 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:17:25.960396 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:17:25.973143 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:17:25.997863 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:17:26.012637 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "c5922e78-9736-4a78-88dd-e32d56e81658" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.305s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:26.048698 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:17:26.048983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:17:26.058950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "refresh_cache-e54d5157-0f40-462b-84c9-c6ac326ed182" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:17:26.058950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquired lock "refresh_cache-e54d5157-0f40-462b-84c9-c6ac326ed182" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:17:26.058950 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:17:26.061447 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:17:26.062876 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fece:a0a4', 'fe80::dcaa:c7ff:fef8:d23c', 'fe80::fc16:3eff:feda:71e2', 'fe80::3ca1:7dff:fece:9122', 'fe80::fc16:3eff:fe2e:1640', 'fe80::fc16:3eff:feee:5cc0', 'fe80::b098:84ff:fe18:24bd'] 
May 27 23:17:26.063324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:17:26.063324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:17:26.066276 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:17:26.066276 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Updating existing volume attachment record: c186c0e2-589c-4850-ad62-1d7f7d1eac3a {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:17:26.299560 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:17:26.307536 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:17:26.312665 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:17:26.312665 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:17:26.322239 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:17:26.322239 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:26.333571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:26.343951 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:26.350666 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:26.360802 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.360802 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.360802 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.360802 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.360802 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.360802 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.360802 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.360802 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.360802 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:26.360802 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:26.360988 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.360988 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.360988 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.360988 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.360988 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.360988 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.360988 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.360988 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.360988 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:26.360988 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:26.394884 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807, portal: 192.168.50.100,3260]
May 27 23:17:26.394884 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807, portal: 192.168.50.100,3260] successful.
May 27 23:17:26.394884 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:26.407385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807, portal: 192.168.40.100,3260]
May 27 23:17:26.407385 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807, portal: 192.168.40.100,3260] successful.
May 27 23:17:26.407385 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:26.412203 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:26.422084 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:26.437362 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:17:26.437362 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] HCTL ('16', '-', '-', 0) found on session 180 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:17:26.442350 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:17:26.448945 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.448945 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.448945 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.448945 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.448945 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.448945 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.448945 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.448945 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.448945 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:26.448945 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:26.448945 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:26.448945 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:26.449759 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:17:26.449759 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:17:26.450984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] HCTL ('17', '-', '-', 0) found on session 181 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:17:26.450984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:17:26.458467 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching for a device in session 180 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:17:26.458467 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:17:26.463955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching for a device in session 181 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:17:26.463955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:17:26.631214 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:17:26.788205 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:26.916437 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Updating instance_info_cache with network_info: [{"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:17:27.258606 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:17:27.418346 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Releasing lock "refresh_cache-e54d5157-0f40-462b-84c9-c6ac326ed182" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:17:27.418618 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Instance network_info: |[{"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:17:27.550382 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Received event network-changed-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:27.550534 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Refreshing instance network info cache due to event network-changed-37929967-bd9f-4e8d-ae0e-c387494c50c1. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:17:27.550679 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] Acquiring lock "refresh_cache-e54d5157-0f40-462b-84c9-c6ac326ed182" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:17:27.550772 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] Acquired lock "refresh_cache-e54d5157-0f40-462b-84c9-c6ac326ed182" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:17:27.550873 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Refreshing network info cache for port 37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:17:28.054788 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:28.171244 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:17:28.172344 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:17:28.172591 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Creating image(s)
May 27 23:17:28.172853 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:17:28.172974 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Ensure instance console log exists: /opt/stack/data/nova/instances/e54d5157-0f40-462b-84c9-c6ac326ed182/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:17:28.173226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:28.173386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:28.173509 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:28.174018 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Start _get_guest_xml network_info=[{"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c186c0e2-589c-4850-ad62-1d7f7d1eac3a', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d4bec6-c18c-4c78-ba4b-8451875747f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e54d5157-0f40-462b-84c9-c6ac326ed182', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2d4bec6-c18c-4c78-ba4b-8451875747f5', 'serial': 'd2d4bec6-c18c-4c78-ba4b-8451875747f5'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:17:28.177869 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:17:28.178824 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-49678815', uuid='e54d5157-0f40-462b-84c9-c6ac326ed182'), owner=OwnerMeta(userid='5afdb0f7fb014ac993fc36395de07be6', username='tempest-TestVolumeBootPatternV346-405934088-project-member', projectid='0d095aed76494dd7b4c64e9209c14483', projectname='tempest-TestVolumeBootPatternV346-405934088'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923848.1785157) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:17:28.179696 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:17:28.179981 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:17:28.180858 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:17:28.181009 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:17:28.181826 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:17:28.182091 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:17:28.182239 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:17:28.182314 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:17:28.182445 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:17:28.182519 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:17:28.182607 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:17:28.182752 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:17:28.182845 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:17:28.182947 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:17:28.183071 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:17:28.183201 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:17:28.192607 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:17:28.192911 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d4bec6-c18c-4c78-ba4b-8451875747f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:17:28.193039 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:17:28.277735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Found WWN 33000000018ee3933 for multipath device dm-10 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:17:28.278113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:17:28.278602 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.086s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:17:28.278873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d4bec6-c18c-4c78-ba4b-8451875747f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:17:28.281531 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '33000000018ee3933', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '33000000018ee3933'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:17:28.281776 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000018ee3933', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '33000000018ee3933'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:17:28.290736 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:17:28.291367 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:17:28.292570 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:17:28.292812 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:17:28.293219 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:17:28.295549 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:17:28.307720 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:17:28.307720 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:28.313619 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:17:28.313619 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:28.323983 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:28.325800 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5] added
May 27 23:17:28.325800 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:17:28.325800 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:28.325800 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:28.325800 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:28.325800 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:28.325800 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:28.326001 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:17:28.326213 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:17:28.326726 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:17:28.327184 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5] added
May 27 23:17:28.327184 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:17:28.327184 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:28.327184 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:28.327184 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:17:28.327184 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:17:28.327184 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:28.327408 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:17:28.327586 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0342(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:17:28.327712 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:17:28.330946 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': '2232483d-3400-4452-a398-d253b4f6cb88', 'attached_at': '', 'detached_at': '', 'volume_id': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'serial': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:17:28.330946 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:17:28.330946 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:17:28.330946 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:17:28.346813 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 23:17:28.346813 np0000001565 nova-compute[98289]:   <usage type="volume">
May 27 23:17:28.346813 np0000001565 nova-compute[98289]:     <volume>0329c084-0daf-4ac7-9cb6-e3ae3ed36807</volume>
May 27 23:17:28.346813 np0000001565 nova-compute[98289]:   </usage>
May 27 23:17:28.346813 np0000001565 nova-compute[98289]: </secret>
May 27 23:17:28.346813 np0000001565 nova-compute[98289]:  {{(pid=98289) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 23:17:28.447754 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Updated VIF entry in instance network info cache for port 37929967-bd9f-4e8d-ae0e-c387494c50c1. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:17:28.448242 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Updating instance_info_cache with network_info: [{"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:17:28.855876 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1477133638',display_name='tempest-TestEncryptedCinderVolumes-server-1477133638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1477133638',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwpLIDJzmmj8DOOIr1KJSEMd+lIpXx0aX3N2m8iUzldrJ/GuIUPYvReVhfmMiDVx83K1VHGQco6OTrLiBD8PtdDgFRaFsX4ihfkPtv7oJvf/xEiMdyvlvg2/fN1X+W+HA==',key_name='tempest-TestEncryptedCinderVolumes-418939601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d4267649c9432993626e440932bf08',ramdisk_id='',reservation_id='r-d08wypaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-274929604',owner_user_name='tempest-TestEncryptedCinderVolumes-274929604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:17:22Z,user_data=None,user_id='6418d61428124c1c98659435dd6b8bff',uuid=2232483d-3400-4452-a398-d253b4f6cb88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "address": "fa:16:3e:98:e8:7d", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f9a8b2-de", "ovs_interfaceid": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:17:28.856313 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converting VIF {"id": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "address": "fa:16:3e:98:e8:7d", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f9a8b2-de", "ovs_interfaceid": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:17:28.858572 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e8:7d,bridge_name='br-int',has_traffic_filtering=True,id=f6f9a8b2-de44-424a-a7cc-b0c2204af066,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f9a8b2-de') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:17:28.858572 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lazy-loading 'pci_devices' on Instance uuid 2232483d-3400-4452-a398-d253b4f6cb88 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:17:28.950274 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] Releasing lock "refresh_cache-e54d5157-0f40-462b-84c9-c6ac326ed182" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:17:28.950454 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-changed-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:28.950563 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Refreshing instance network info cache due to event network-changed-f4cd13a8-b033-4d11-b8a3-586f1b916698. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:17:28.950699 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] Acquiring lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:17:28.950779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] Acquired lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:17:28.950874 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Refreshing network info cache for port f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:17:29.315734 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:29.327190 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:17:29.328315 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:17:29.341914 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:17:29.341914 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:17:29.346991 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:17:29.346991 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:29.355430 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:29.363358 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] End _get_guest_xml xml=<domain type="qemu">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <uuid>2232483d-3400-4452-a398-d253b4f6cb88</uuid>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <name>instance-00000044</name>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1477133638</nova:name>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:17:25</nova:creationTime>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:user uuid="6418d61428124c1c98659435dd6b8bff">tempest-TestEncryptedCinderVolumes-274929604-project-member</nova:user>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:project uuid="e2d4267649c9432993626e440932bf08">tempest-TestEncryptedCinderVolumes-274929604</nova:project>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <nova:port uuid="f6f9a8b2-de44-424a-a7cc-b0c2204af066">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <system>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <entry name="serial">2232483d-3400-4452-a398-d253b4f6cb88</entry>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <entry name="uuid">2232483d-3400-4452-a398-d253b4f6cb88</entry>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     </system>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <os>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   </os>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <features>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   </features>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   <devices>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/2232483d-3400-4452-a398-d253b4f6cb88/disk.config"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     </disk>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <alias name="ua-0329c084-0daf-4ac7-9cb6-e3ae3ed36807"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <serial>0329c084-0daf-4ac7-9cb6-e3ae3ed36807</serial>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <encryption format="luks">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:         <secret type="passphrase" uuid="e249389e-785b-4572-a137-ad585248e578"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       </encryption>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     </disk>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:98:e8:7d"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <target dev="tapf6f9a8b2-de"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     </interface>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/2232483d-3400-4452-a398-d253b4f6cb88/console.log" append="off"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     </serial>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <video>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     </video>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     </rng>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:   </devices>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]: </domain>
May 27 23:17:29.363358 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:17:29.363358 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Preparing to wait for external event network-vif-plugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:17:29.363358 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "2232483d-3400-4452-a398-d253b4f6cb88-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:29.363358 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:29.363358 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:29.363358 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1477133638',display_name='tempest-TestEncryptedCinderVolumes-server-1477133638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1477133638',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwpLIDJzmmj8DOOIr1KJSEMd+lIpXx0aX3N2m8iUzldrJ/GuIUPYvReVhfmMiDVx83K1VHGQco6OTrLiBD8PtdDgFRaFsX4ihfkPtv7oJvf/xEiMdyvlvg2/fN1X+W+HA==',key_name='tempest-TestEncryptedCinderVolumes-418939601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d4267649c9432993626e440932bf08',ramdisk_id='',reservation_id='r-d08wypaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-274929604',owner_user_name='tempest-TestEncryptedCinderVolumes-274929604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:17:22Z,user_data=None,user_id='6418d61428124c1c98659435dd6b8bff',uuid=2232483d-3400-4452-a398-d253b4f6cb88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "address": "fa:16:3e:98:e8:7d", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f9a8b2-de", "ovs_interfaceid": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:17:29.363358 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converting VIF {"id": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "address": "fa:16:3e:98:e8:7d", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f9a8b2-de", "ovs_interfaceid": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:17:29.363358 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e8:7d,bridge_name='br-int',has_traffic_filtering=True,id=f6f9a8b2-de44-424a-a7cc-b0c2204af066,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f9a8b2-de') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:17:29.363358 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e8:7d,bridge_name='br-int',has_traffic_filtering=True,id=f6f9a8b2-de44-424a-a7cc-b0c2204af066,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f9a8b2-de') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:17:29.367371 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:29.367619 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:29.367830 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:17:29.368943 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:29.369127 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95ddc073-625c-5e21-a4ac-d97528eafb01', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:29.369833 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:29.370787 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:17:29.370997 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:29.378305 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.378305 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.378305 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.378305 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.378305 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.378305 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.378305 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.378305 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.378305 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:29.378305 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.378305 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.378305 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:29.378628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.378628 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.378628 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.378628 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.378628 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.378628 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.378628 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.378628 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.378628 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:29.378628 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.378628 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.378628 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:29.379018 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:29.379231 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6f9a8b2-de, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:29.379548 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6f9a8b2-de, col_values=(('qos', UUID('92158b83-d120-469c-8434-4d163dde111f')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:29.379709 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6f9a8b2-de, col_values=(('external_ids', {'iface-id': 'f6f9a8b2-de44-424a-a7cc-b0c2204af066', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:e8:7d', 'vm-uuid': '2232483d-3400-4452-a398-d253b4f6cb88'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:29.380593 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:29.381740 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:17:29.386568 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:29.387986 np0000001565 nova-compute[98289]: INFO os_vif [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e8:7d,bridge_name='br-int',has_traffic_filtering=True,id=f6f9a8b2-de44-424a-a7cc-b0c2204af066,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f9a8b2-de')
May 27 23:17:29.394028 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.394028 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.394028 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.394028 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.394028 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.394028 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.394028 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.394028 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.394028 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:29.394028 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.394028 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.394028 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:29.394559 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.394559 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.394559 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.394559 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.394559 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.394559 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.394559 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.394559 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.394559 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:29.394559 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.394559 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.394559 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:29.436467 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5, portal: 192.168.40.100,3260]
May 27 23:17:29.436467 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5, portal: 192.168.40.100,3260] successful.
May 27 23:17:29.436467 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:29.448309 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:29.448774 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5, portal: 192.168.50.100,3260]
May 27 23:17:29.448774 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5, portal: 192.168.50.100,3260] successful.
May 27 23:17:29.448774 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:29.453096 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:29.465551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:29.470674 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:29.471025 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:29.471268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:17:29.471325 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:17:29.472845 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] HCTL ('18', '-', '-', 0) found on session 182 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:17:29.472981 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67825e05-fdce-4fe5-b797-bbfb95b9d9db (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:29.490315 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:17:29.490315 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:17:29.491954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching for a device in session 182 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:17:29.491954 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d4bec6-c18c-4c78-ba4b-8451875747f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:17:29.493146 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] HCTL ('19', '-', '-', 0) found on session 183 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:17:29.493621 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:17:29.510809 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Searching for a device in session 183 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:17:29.510809 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd2d4bec6-c18c-4c78-ba4b-8451875747f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:17:29.783245 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:29.909867 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Updated VIF entry in instance network info cache for port f4cd13a8-b033-4d11-b8a3-586f1b916698. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:17:29.910138 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Updating instance_info_cache with network_info: [{"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:17:30.293307 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:17:30.411767 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d24f17ff-da57-468b-8a9c-589faa76c57f req-00996e3b-c649-43b5-af28-9639169fded8 service nova] Releasing lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:17:30.902613 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:17:30.902770 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:17:30.902927 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No VIF found with MAC fa:16:3e:98:e8:7d, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:17:30.903404 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Using config drive
May 27 23:17:31.308265 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Found WWN 330000000593ce071 for multipath device dm-11 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:17:31.308517 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:17:31.308651 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] <== connect_volume: return (3116ms) {'type': 'block', 'scsi_wwn': '330000000593ce071', 'path': '/dev/dm-11', 'multipath_id': '330000000593ce071'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:17:31.308771 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000593ce071', 'path': '/dev/dm-11', 'multipath_id': '330000000593ce071'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:17:31.408309 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:31.533083 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Creating config drive at /opt/stack/data/nova/instances/2232483d-3400-4452-a398-d253b4f6cb88/disk.config
May 27 23:17:31.536240 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2232483d-3400-4452-a398-d253b4f6cb88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk_1cw48b {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:17:31.595106 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2232483d-3400-4452-a398-d253b4f6cb88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk_1cw48b" returned: 0 in 0.059s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:17:31.813850 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-49678815',display_name='tempest-TestVolumeBootPatternV346-server-49678815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpatternv346-server-49678815',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPqq5vFG69+WQjViZG6CZ4+evGplG34z3VI84lRebsZ69u55zPq7fw3upGNPOmH6PRoJ4e3DSlGsIfwtP/rT7DNI5rpjYT2DZEN9rdU16t4cnnV7C510Ky1Ec5SU3xxmA==',key_name='tempest-keypair-1017057203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d095aed76494dd7b4c64e9209c14483',ramdisk_id='',reservation_id='r-agsi33m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-405934088',owner_user_name='tempest-TestVolumeBootPatternV346-405934088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afdb0f7fb014ac993fc36395de07be6',uuid=e54d5157-0f40-462b-84c9-c6ac326ed182,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:17:31.814068 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converting VIF {"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:17:31.814658 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=37929967-bd9f-4e8d-ae0e-c387494c50c1,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37929967-bd') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:17:31.815720 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lazy-loading 'pci_devices' on Instance uuid e54d5157-0f40-462b-84c9-c6ac326ed182 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:17:31.961218 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:31.989506 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.103356 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.159857 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-762d6717-bedb-4e35-8fbf-88a2e8107c21 req-7a1e818a-38d4-4a9a-8b5d-ee889ddf5123 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Received event network-vif-plugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:32.160791 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-762d6717-bedb-4e35-8fbf-88a2e8107c21 req-7a1e818a-38d4-4a9a-8b5d-ee889ddf5123 service nova] Acquiring lock "2232483d-3400-4452-a398-d253b4f6cb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:32.161061 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-762d6717-bedb-4e35-8fbf-88a2e8107c21 req-7a1e818a-38d4-4a9a-8b5d-ee889ddf5123 service nova] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:32.161250 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-762d6717-bedb-4e35-8fbf-88a2e8107c21 req-7a1e818a-38d4-4a9a-8b5d-ee889ddf5123 service nova] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:32.161431 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-762d6717-bedb-4e35-8fbf-88a2e8107c21 req-7a1e818a-38d4-4a9a-8b5d-ee889ddf5123 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Processing event network-vif-plugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:17:32.321227 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] End _get_guest_xml xml=<domain type="qemu">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <uuid>e54d5157-0f40-462b-84c9-c6ac326ed182</uuid>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <name>instance-00000045</name>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPatternV346-server-49678815</nova:name>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:17:28</nova:creationTime>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:user uuid="5afdb0f7fb014ac993fc36395de07be6">tempest-TestVolumeBootPatternV346-405934088-project-member</nova:user>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:project uuid="0d095aed76494dd7b4c64e9209c14483">tempest-TestVolumeBootPatternV346-405934088</nova:project>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         <nova:port uuid="37929967-bd9f-4e8d-ae0e-c387494c50c1">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <system>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <entry name="serial">e54d5157-0f40-462b-84c9-c6ac326ed182</entry>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <entry name="uuid">e54d5157-0f40-462b-84c9-c6ac326ed182</entry>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     </system>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <os>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   </os>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <features>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   </features>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   <devices>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/e54d5157-0f40-462b-84c9-c6ac326ed182/disk.config"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     </disk>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <alias name="ua-d2d4bec6-c18c-4c78-ba4b-8451875747f5"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-11"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <serial>d2d4bec6-c18c-4c78-ba4b-8451875747f5</serial>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     </disk>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:18:c8:14"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <target dev="tap37929967-bd"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     </interface>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/e54d5157-0f40-462b-84c9-c6ac326ed182/console.log" append="off"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     </serial>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <video>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     </video>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     </rng>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:   </devices>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]: </domain>
May 27 23:17:32.321227 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:17:32.321227 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Preparing to wait for external event network-vif-plugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:17:32.321227 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:32.321227 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:32.321227 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:32.327016 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-49678815',display_name='tempest-TestVolumeBootPatternV346-server-49678815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpatternv346-server-49678815',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPqq5vFG69+WQjViZG6CZ4+evGplG34z3VI84lRebsZ69u55zPq7fw3upGNPOmH6PRoJ4e3DSlGsIfwtP/rT7DNI5rpjYT2DZEN9rdU16t4cnnV7C510Ky1Ec5SU3xxmA==',key_name='tempest-keypair-1017057203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d095aed76494dd7b4c64e9209c14483',ramdisk_id='',reservation_id='r-agsi33m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-405934088',owner_user_name='tempest-TestVolumeBootPatternV346-405934088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afdb0f7fb014ac993fc36395de07be6',uuid=e54d5157-0f40-462b-84c9-c6ac326ed182,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:17:32.327016 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converting VIF {"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:17:32.327016 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=37929967-bd9f-4e8d-ae0e-c387494c50c1,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37929967-bd') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:17:32.327016 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=37929967-bd9f-4e8d-ae0e-c387494c50c1,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37929967-bd') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:17:32.327016 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.327447 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:32.327525 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:17:32.328646 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.328817 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fae44b53-44f6-5175-b127-09b1c1059ea1', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:32.329516 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.330118 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:17:32.332474 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.334779 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.334933 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37929967-bd, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:32.335239 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37929967-bd, col_values=(('qos', UUID('394b6c7e-e881-4db7-bedf-4fc22081f290')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:32.335412 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37929967-bd, col_values=(('external_ids', {'iface-id': '37929967-bd9f-4e8d-ae0e-c387494c50c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:c8:14', 'vm-uuid': 'e54d5157-0f40-462b-84c9-c6ac326ed182'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:32.336354 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.337404 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:17:32.342403 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.343866 np0000001565 nova-compute[98289]: INFO os_vif [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=37929967-bd9f-4e8d-ae0e-c387494c50c1,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37929967-bd')
May 27 23:17:32.438654 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.444449 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.447704 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.473132 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:32.480014 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:33.649236 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:17:33.649903 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923853.649528, 2232483d-3400-4452-a398-d253b4f6cb88 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:17:33.650217 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] VM Started (Lifecycle Event)
May 27 23:17:33.652531 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:17:33.654616 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Instance spawned successfully.
May 27 23:17:33.655004 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:17:33.865812 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:17:33.866009 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:17:33.866090 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] No VIF found with MAC fa:16:3e:18:c8:14, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:17:33.866606 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Using config drive
May 27 23:17:34.152635 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:34.154404 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:17:34.162900 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:34.163008 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:34.163279 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:34.163751 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:34.163985 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:34.164252 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:34.242617 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-71e5f2dd-ef84-4b49-a176-b7e53ca7848d req-4d61b087-17d4-48c5-a373-082152beefed service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Received event network-vif-plugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:34.242801 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-71e5f2dd-ef84-4b49-a176-b7e53ca7848d req-4d61b087-17d4-48c5-a373-082152beefed service nova] Acquiring lock "2232483d-3400-4452-a398-d253b4f6cb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:34.243150 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-71e5f2dd-ef84-4b49-a176-b7e53ca7848d req-4d61b087-17d4-48c5-a373-082152beefed service nova] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:34.243316 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-71e5f2dd-ef84-4b49-a176-b7e53ca7848d req-4d61b087-17d4-48c5-a373-082152beefed service nova] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:34.243484 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-71e5f2dd-ef84-4b49-a176-b7e53ca7848d req-4d61b087-17d4-48c5-a373-082152beefed service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] No waiting events found dispatching network-vif-plugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:17:34.243627 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-71e5f2dd-ef84-4b49-a176-b7e53ca7848d req-4d61b087-17d4-48c5-a373-082152beefed service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Received unexpected event network-vif-plugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 for instance with vm_state building and task_state spawning.
May 27 23:17:34.320355 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:34.371677 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:34.495612 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Creating config drive at /opt/stack/data/nova/instances/e54d5157-0f40-462b-84c9-c6ac326ed182/disk.config
May 27 23:17:34.501871 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e54d5157-0f40-462b-84c9-c6ac326ed182/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6qg2zw6q {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:17:34.566504 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e54d5157-0f40-462b-84c9-c6ac326ed182/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6qg2zw6q" returned: 0 in 0.065s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:17:34.657875 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:17:34.658375 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923854.658077, 2232483d-3400-4452-a398-d253b4f6cb88 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:17:34.658558 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] VM Paused (Lifecycle Event)
May 27 23:17:34.670974 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Took 9.45 seconds to spawn the instance on the hypervisor.
May 27 23:17:34.671949 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:34.993619 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:35.018536 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:35.022233 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:35.104830 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:35.162998 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:35.164418 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:35.166808 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:35.171650 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923855.1699169, 2232483d-3400-4452-a398-d253b4f6cb88 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:17:35.171650 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] VM Resumed (Lifecycle Event)
May 27 23:17:35.187317 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Took 16.61 seconds to build instance.
May 27 23:17:35.672566 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:35.675559 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:17:35.688997 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "2232483d-3400-4452-a398-d253b4f6cb88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.112s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:36.179374 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923856.1774988, e54d5157-0f40-462b-84c9-c6ac326ed182 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:17:36.179374 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] VM Started (Lifecycle Event)
May 27 23:17:36.301282 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9f31e166-edcc-419f-a53b-f05377146f48 req-45b40fce-5c32-4139-86c3-224e0c0d1276 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Received event network-vif-plugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:36.302807 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f31e166-edcc-419f-a53b-f05377146f48 req-45b40fce-5c32-4139-86c3-224e0c0d1276 service nova] Acquiring lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:36.303015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f31e166-edcc-419f-a53b-f05377146f48 req-45b40fce-5c32-4139-86c3-224e0c0d1276 service nova] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:36.303155 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f31e166-edcc-419f-a53b-f05377146f48 req-45b40fce-5c32-4139-86c3-224e0c0d1276 service nova] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:36.303423 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9f31e166-edcc-419f-a53b-f05377146f48 req-45b40fce-5c32-4139-86c3-224e0c0d1276 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Processing event network-vif-plugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:17:36.303423 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9f31e166-edcc-419f-a53b-f05377146f48 req-45b40fce-5c32-4139-86c3-224e0c0d1276 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Received event network-vif-plugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:36.304197 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f31e166-edcc-419f-a53b-f05377146f48 req-45b40fce-5c32-4139-86c3-224e0c0d1276 service nova] Acquiring lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:36.304197 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f31e166-edcc-419f-a53b-f05377146f48 req-45b40fce-5c32-4139-86c3-224e0c0d1276 service nova] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:36.304197 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9f31e166-edcc-419f-a53b-f05377146f48 req-45b40fce-5c32-4139-86c3-224e0c0d1276 service nova] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:36.304197 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9f31e166-edcc-419f-a53b-f05377146f48 req-45b40fce-5c32-4139-86c3-224e0c0d1276 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] No waiting events found dispatching network-vif-plugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:17:36.304197 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9f31e166-edcc-419f-a53b-f05377146f48 req-45b40fce-5c32-4139-86c3-224e0c0d1276 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Received unexpected event network-vif-plugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 for instance with vm_state building and task_state spawning.
May 27 23:17:36.304516 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:17:36.307999 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:17:36.310723 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Instance spawned successfully.
May 27 23:17:36.312412 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:17:36.680287 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:36.683074 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:17:36.820403 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:36.820403 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:36.820403 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:36.820403 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:36.820403 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:36.820403 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:17:37.185346 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:17:37.185750 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923857.18549, e54d5157-0f40-462b-84c9-c6ac326ed182 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:17:37.185923 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] VM Paused (Lifecycle Event)
May 27 23:17:37.276973 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3dd7ea85-7d16-4076-9e8a-d4da4fd8a0c6 req-d0c0299f-7881-4674-9a6f-fc023bb90338 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Received event network-changed-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:37.277120 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3dd7ea85-7d16-4076-9e8a-d4da4fd8a0c6 req-d0c0299f-7881-4674-9a6f-fc023bb90338 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Refreshing instance network info cache due to event network-changed-f6f9a8b2-de44-424a-a7cc-b0c2204af066. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:17:37.278288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3dd7ea85-7d16-4076-9e8a-d4da4fd8a0c6 req-d0c0299f-7881-4674-9a6f-fc023bb90338 service nova] Acquiring lock "refresh_cache-2232483d-3400-4452-a398-d253b4f6cb88" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:17:37.278288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3dd7ea85-7d16-4076-9e8a-d4da4fd8a0c6 req-d0c0299f-7881-4674-9a6f-fc023bb90338 service nova] Acquired lock "refresh_cache-2232483d-3400-4452-a398-d253b4f6cb88" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:17:37.278288 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3dd7ea85-7d16-4076-9e8a-d4da4fd8a0c6 req-d0c0299f-7881-4674-9a6f-fc023bb90338 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Refreshing network info cache for port f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:17:37.324376 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Took 9.15 seconds to spawn the instance on the hypervisor.
May 27 23:17:37.325164 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:37.338031 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:37.688715 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:37.691024 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923857.6907623, e54d5157-0f40-462b-84c9-c6ac326ed182 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:17:37.691207 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] VM Resumed (Lifecycle Event)
May 27 23:17:37.781631 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3dd7ea85-7d16-4076-9e8a-d4da4fd8a0c6 req-d0c0299f-7881-4674-9a6f-fc023bb90338 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:37.842324 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Took 16.37 seconds to build instance.
May 27 23:17:38.151872 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3dd7ea85-7d16-4076-9e8a-d4da4fd8a0c6 req-d0c0299f-7881-4674-9a6f-fc023bb90338 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:38.195598 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:17:38.199371 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:17:38.344776 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.880s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:38.393776 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3dd7ea85-7d16-4076-9e8a-d4da4fd8a0c6 req-d0c0299f-7881-4674-9a6f-fc023bb90338 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Updated VIF entry in instance network info cache for port f6f9a8b2-de44-424a-a7cc-b0c2204af066. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:17:38.394205 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3dd7ea85-7d16-4076-9e8a-d4da4fd8a0c6 req-d0c0299f-7881-4674-9a6f-fc023bb90338 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Updating instance_info_cache with network_info: [{"id": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "address": "fa:16:3e:98:e8:7d", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f9a8b2-de", "ovs_interfaceid": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:17:38.550924 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5ba98f3b-0fba-4acb-bf41-0c8d5a4581f6 req-6836e776-78af-4de3-aede-57747cb61b71 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Received event network-changed-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:38.551306 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5ba98f3b-0fba-4acb-bf41-0c8d5a4581f6 req-6836e776-78af-4de3-aede-57747cb61b71 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Refreshing instance network info cache due to event network-changed-37929967-bd9f-4e8d-ae0e-c387494c50c1. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:17:38.551484 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5ba98f3b-0fba-4acb-bf41-0c8d5a4581f6 req-6836e776-78af-4de3-aede-57747cb61b71 service nova] Acquiring lock "refresh_cache-e54d5157-0f40-462b-84c9-c6ac326ed182" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:17:38.551667 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5ba98f3b-0fba-4acb-bf41-0c8d5a4581f6 req-6836e776-78af-4de3-aede-57747cb61b71 service nova] Acquired lock "refresh_cache-e54d5157-0f40-462b-84c9-c6ac326ed182" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:17:38.551777 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5ba98f3b-0fba-4acb-bf41-0c8d5a4581f6 req-6836e776-78af-4de3-aede-57747cb61b71 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Refreshing network info cache for port 37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:17:38.900068 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3dd7ea85-7d16-4076-9e8a-d4da4fd8a0c6 req-d0c0299f-7881-4674-9a6f-fc023bb90338 service nova] Releasing lock "refresh_cache-2232483d-3400-4452-a398-d253b4f6cb88" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:17:39.057826 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5ba98f3b-0fba-4acb-bf41-0c8d5a4581f6 req-6836e776-78af-4de3-aede-57747cb61b71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:39.336672 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:39.372930 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5ba98f3b-0fba-4acb-bf41-0c8d5a4581f6 req-6836e776-78af-4de3-aede-57747cb61b71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:39.523789 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5ba98f3b-0fba-4acb-bf41-0c8d5a4581f6 req-6836e776-78af-4de3-aede-57747cb61b71 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Updated VIF entry in instance network info cache for port 37929967-bd9f-4e8d-ae0e-c387494c50c1. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:17:39.524130 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5ba98f3b-0fba-4acb-bf41-0c8d5a4581f6 req-6836e776-78af-4de3-aede-57747cb61b71 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Updating instance_info_cache with network_info: [{"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:17:40.028048 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5ba98f3b-0fba-4acb-bf41-0c8d5a4581f6 req-6836e776-78af-4de3-aede-57747cb61b71 service nova] Releasing lock "refresh_cache-e54d5157-0f40-462b-84c9-c6ac326ed182" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:17:42.341066 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:44.339722 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:46.330536 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:46.330956 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:46.833190 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Detaching volume 11264d72-68fe-4c2b-b63a-b896204d32d1
May 27 23:17:46.870413 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Attempting to driver detach volume 11264d72-68fe-4c2b-b63a-b896204d32d1 from mountpoint /dev/vdb
May 27 23:17:46.873929 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Found disk vdb by alias ua-11264d72-68fe-4c2b-b63a-b896204d32d1 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:17:46.875183 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Found disk vdb by alias ua-11264d72-68fe-4c2b-b63a-b896204d32d1 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:17:46.876138 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Attempting to detach device vdb from instance 5c2e5882-a178-4759-be58-b0e717d8dc0f from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:17:46.876138 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:17:46.876138 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:17:46.876138 np0000001565 nova-compute[98289]:   <alias name="ua-11264d72-68fe-4c2b-b63a-b896204d32d1"/>
May 27 23:17:46.876138 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-9"/>
May 27 23:17:46.876138 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:17:46.876138 np0000001565 nova-compute[98289]:   <serial>11264d72-68fe-4c2b-b63a-b896204d32d1</serial>
May 27 23:17:46.876138 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:17:46.876138 np0000001565 nova-compute[98289]: </disk>
May 27 23:17:46.876138 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:17:46.881816 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Successfully detached device vdb from instance 5c2e5882-a178-4759-be58-b0e717d8dc0f from the persistent domain config.
May 27 23:17:46.881816 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] (1/8): Attempting to detach device vdb with device alias ua-11264d72-68fe-4c2b-b63a-b896204d32d1 from instance 5c2e5882-a178-4759-be58-b0e717d8dc0f from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:17:46.881816 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:17:46.881816 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:17:46.881816 np0000001565 nova-compute[98289]:   <alias name="ua-11264d72-68fe-4c2b-b63a-b896204d32d1"/>
May 27 23:17:46.881816 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-9"/>
May 27 23:17:46.881816 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:17:46.881816 np0000001565 nova-compute[98289]:   <serial>11264d72-68fe-4c2b-b63a-b896204d32d1</serial>
May 27 23:17:46.881816 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:17:46.881816 np0000001565 nova-compute[98289]: </disk>
May 27 23:17:46.881816 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:17:47.342788 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:47.374145 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923867.3732169, 5c2e5882-a178-4759-be58-b0e717d8dc0f => ua-11264d72-68fe-4c2b-b63a-b896204d32d1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:17:47.374631 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-11264d72-68fe-4c2b-b63a-b896204d32d1 for instance 5c2e5882-a178-4759-be58-b0e717d8dc0f {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:17:47.376896 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Successfully detached device vdb from instance 5c2e5882-a178-4759-be58-b0e717d8dc0f from the live domain config.
May 27 23:17:47.378000 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:17:47.378361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11264d72-68fe-4c2b-b63a-b896204d32d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:17:47.378590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:17:47.379127 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:17:47.379505 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11264d72-68fe-4c2b-b63a-b896204d32d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:17:47.379658 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:47.408456 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1 (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:17:47.409051 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', '172'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '178'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', '183')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:17:47.409051 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', '173')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:17:47.409895 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1', '172')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:17:47.410761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3879ff60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1'): ({'sdh'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:17:47.410948 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Removing multipathed devices sdi, sdh {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:17:47.411184 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Flush multipath device 330000000e33bceea {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:17:47.454804 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:17:47.508874 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:17:47.564771 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:17:47.564956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:17:47.566888 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:17:47.579323 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:17:47.579507 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:17:47.591356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:47.622413 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1, portal: 192.168.40.100,3260]
May 27 23:17:47.622413 np0000001565 nova-compute[98289]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1, portal: 192.168.40.100,3260] successful.
May 27 23:17:47.622413 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:47.641656 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:47.651822 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:47.683358 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1, portal: 192.168.50.100,3260]
May 27 23:17:47.683358 np0000001565 nova-compute[98289]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-11264d72-68fe-4c2b-b63a-b896204d32d1, portal: 192.168.50.100,3260] successful.
May 27 23:17:47.683358 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:47.705127 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:17:47.705349 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:17:47.705486 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] <== disconnect_volume: return (326ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:17:47.705618 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:17:48.250479 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lazy-loading 'flavor' on Instance uuid 5c2e5882-a178-4759-be58-b0e717d8dc0f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:17:49.255435 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b98a1ca4-0c4e-4900-94ee-78d9afa05052 tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.925s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:49.342387 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:49.543768 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:49.543768 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:49.543768 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:49.543768 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:49.543768 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:49.545925 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Terminating instance
May 27 23:17:50.049141 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:17:50.069368 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:50.093863 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:50.094646 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:50.118018 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:50.225255 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3fddf880-362c-49e0-9da4-ead483fc132c req-1fc67cc3-7206-4db7-b796-6e84c877975b service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Received event network-vif-unplugged-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:50.225501 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3fddf880-362c-49e0-9da4-ead483fc132c req-1fc67cc3-7206-4db7-b796-6e84c877975b service nova] Acquiring lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:50.225856 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3fddf880-362c-49e0-9da4-ead483fc132c req-1fc67cc3-7206-4db7-b796-6e84c877975b service nova] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:50.225976 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3fddf880-362c-49e0-9da4-ead483fc132c req-1fc67cc3-7206-4db7-b796-6e84c877975b service nova] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:50.226113 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3fddf880-362c-49e0-9da4-ead483fc132c req-1fc67cc3-7206-4db7-b796-6e84c877975b service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] No waiting events found dispatching network-vif-unplugged-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:17:50.226228 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3fddf880-362c-49e0-9da4-ead483fc132c req-1fc67cc3-7206-4db7-b796-6e84c877975b service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Received event network-vif-unplugged-525fd759-a763-46ed-8666-24514170260b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:17:50.380662 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999601586000153 future=<Future at 0x726e60193c80 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:17:50.381627 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998656346000189 future=<Future at 0x726e60193c80 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:17:50.381911 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99833175599997 future=<Future at 0x726e60193c80 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:17:50.382612 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Instance destroyed successfully.
May 27 23:17:50.383251 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lazy-loading 'resources' on Instance uuid 5c2e5882-a178-4759-be58-b0e717d8dc0f {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:17:50.885851 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-168792464',display_name='tempest-VolumesBackupsTest-instance-168792464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumesbackupstest-instance-168792464',id=65,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWmjCiTlDmXf3sG2Xa+0oDAVup9j2obkQ5esxrHCMuzuXGWPe1qwb1G1iAYEtWJAXtlf89EsRtdf4GZKqkQ+GpMarcXOKtm8FrR3x2Y1iOZqF1Py2AJwawj3Hi+isbx0Q==',key_name='tempest-keypair-499895313',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:16:23Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ed98b56db004061b06363a72405f6ae',ramdisk_id='',reservation_id='r-w2iyahqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-188258886',owner_user_name='tempest-VolumesBackupsTest-188258886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:16:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f45f6afa2b7e42148a7685164b694ff3',uuid=5c2e5882-a178-4759-be58-b0e717d8dc0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525fd759-a763-46ed-8666-24514170260b", "address": "fa:16:3e:da:71:e2", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd759-a7", "ovs_interfaceid": "525fd759-a763-46ed-8666-24514170260b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:17:50.886060 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converting VIF {"id": "525fd759-a763-46ed-8666-24514170260b", "address": "fa:16:3e:da:71:e2", "network": {"id": "58fe18e2-fb5e-4001-97ec-e1480f05d081", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-937084161-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed98b56db004061b06363a72405f6ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525fd759-a7", "ovs_interfaceid": "525fd759-a763-46ed-8666-24514170260b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:17:50.886732 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:71:e2,bridge_name='br-int',has_traffic_filtering=True,id=525fd759-a763-46ed-8666-24514170260b,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd759-a7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:17:50.887039 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:71:e2,bridge_name='br-int',has_traffic_filtering=True,id=525fd759-a763-46ed-8666-24514170260b,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd759-a7') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:17:50.888442 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:50.888516 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap525fd759-a7, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:50.897792 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:50.898582 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:17:50.899901 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:50.900587 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:50.900720 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8ed0ba8-1856-441a-9fdd-4da76ef49a49) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:17:50.901158 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:50.901671 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:17:50.902575 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:50.904891 np0000001565 nova-compute[98289]: INFO os_vif [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:71:e2,bridge_name='br-int',has_traffic_filtering=True,id=525fd759-a763-46ed-8666-24514170260b,network=Network(58fe18e2-fb5e-4001-97ec-e1480f05d081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525fd759-a7')
May 27 23:17:50.905431 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Deleting instance files /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f_del
May 27 23:17:50.906083 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Deletion of /opt/stack/data/nova/instances/5c2e5882-a178-4759-be58-b0e717d8dc0f_del complete
May 27 23:17:51.123964 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:17:51.412357 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 23:17:51.412942 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:17:51.413261 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:17:51.413423 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:17:51.413695 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:51.506602 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:17:51.628697 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:51.628898 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:51.629086 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:51.629305 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:17:52.309063 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c4a52399-31af-45f8-b9ee-4b352ba04384 req-e9a861ee-cdcf-4587-973e-e7d96a74485f service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Received event network-vif-unplugged-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:52.309883 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c4a52399-31af-45f8-b9ee-4b352ba04384 req-e9a861ee-cdcf-4587-973e-e7d96a74485f service nova] Acquiring lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:52.310045 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c4a52399-31af-45f8-b9ee-4b352ba04384 req-e9a861ee-cdcf-4587-973e-e7d96a74485f service nova] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:52.310285 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c4a52399-31af-45f8-b9ee-4b352ba04384 req-e9a861ee-cdcf-4587-973e-e7d96a74485f service nova] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:52.310418 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c4a52399-31af-45f8-b9ee-4b352ba04384 req-e9a861ee-cdcf-4587-973e-e7d96a74485f service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] No waiting events found dispatching network-vif-unplugged-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:17:52.310563 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c4a52399-31af-45f8-b9ee-4b352ba04384 req-e9a861ee-cdcf-4587-973e-e7d96a74485f service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Received event network-vif-unplugged-525fd759-a763-46ed-8666-24514170260b for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:17:52.310673 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c4a52399-31af-45f8-b9ee-4b352ba04384 req-e9a861ee-cdcf-4587-973e-e7d96a74485f service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Received event network-vif-deleted-525fd759-a763-46ed-8666-24514170260b {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:17:52.310806 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-c4a52399-31af-45f8-b9ee-4b352ba04384 req-e9a861ee-cdcf-4587-973e-e7d96a74485f service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Neutron deleted interface 525fd759-a763-46ed-8666-24514170260b; detaching it from the instance and deleting it from the info cache
May 27 23:17:52.312591 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c4a52399-31af-45f8-b9ee-4b352ba04384 req-e9a861ee-cdcf-4587-973e-e7d96a74485f service nova] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Detach interface failed, port_id=525fd759-a763-46ed-8666-24514170260b, reason: Instance 5c2e5882-a178-4759-be58-b0e717d8dc0f could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:17:52.416844 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:17:52.661201 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:17:52.662389 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-11 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:17:52.663704 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-10 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:17:52.664978 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:17:52.666156 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:17:52.667660 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:17:52.668591 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:17:52.724535 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:17:52.725167 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=12181MB free_disk=72.78910064697266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:17:52.725388 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:52.725729 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:52.919350 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Took 1.51 seconds to deallocate network for instance.
May 27 23:17:53.425790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:17:53.784229 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance fa66e95f-2701-4fde-92d4-668f096aa9cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:17:53.784379 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 5c2e5882-a178-4759-be58-b0e717d8dc0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:17:53.784495 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance b0ad0e52-02bc-40ff-992e-64d9d660c266 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:17:53.784565 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance c5922e78-9736-4a78-88dd-e32d56e81658 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:17:53.784658 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 2232483d-3400-4452-a398-d253b4f6cb88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:17:53.784720 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance e54d5157-0f40-462b-84c9-c6ac326ed182 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:17:53.784916 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:17:53.785057 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:17:52 up 46 min,  2 users,  load average: 2.98, 4.12, 4.06\n', 'num_instances': '6', 'num_vm_active': '6', 'num_task_None': '5', 'num_os_type_None': '6', 'num_proj_0d095aed76494dd7b4c64e9209c14483': '3', 'io_workload': '0', 'num_task_deleting': '1', 'num_proj_8ed98b56db004061b06363a72405f6ae': '1', 'num_proj_5dda425dab8946dc926808806eeedced': '1', 'num_proj_e2d4267649c9432993626e440932bf08': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:17:54.059966 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:17:54.060265 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:17:54.342077 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:54.562648 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:17:55.068217 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:17:55.068437 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.343s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:55.068677 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.643s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:17:55.069063 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.05 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:17:55.354759 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:17:55.354999 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:17:55.859721 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:17:55.916523 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:56.365598 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.297s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:56.418471 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Deleted allocations for instance 5c2e5882-a178-4759-be58-b0e717d8dc0f
May 27 23:17:57.242324 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:57.426679 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-72151767-f340-4157-9bbd-63a70ef1a8ff tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Lock "5c2e5882-a178-4759-be58-b0e717d8dc0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.885s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:17:59.344700 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:17:59.948401 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:00.929172 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:01.124213 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:01.124568 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:01.627799 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:18:02.620899 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:02.621259 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:18:03.117359 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:03.117819 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.01 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:18:03.123552 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:03.123853 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:03.124116 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:03.124829 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:18:03.238822 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c1e9731-a0da-4d4c-a249-479ec6be741f tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:03.238931 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c1e9731-a0da-4d4c-a249-479ec6be741f tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "c5922e78-9736-4a78-88dd-e32d56e81658" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:03.239010 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1c1e9731-a0da-4d4c-a249-479ec6be741f tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:03.241933 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1c1e9731-a0da-4d4c-a249-479ec6be741f tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98289) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 27 23:18:03.242310 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1c1e9731-a0da-4d4c-a249-479ec6be741f tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'flavor' on Instance uuid c5922e78-9736-4a78-88dd-e32d56e81658 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:04.112204 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:04.123846 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:04.124007 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:18:04.124576 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:18:04.264710 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:04.270716 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:04.282935 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:04.286398 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:04.302893 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:04.308528 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:04.348531 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:04.538504 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:04.545471 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:04.568247 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99970415200005 future=<Future at 0x726e604b16a0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:04.569458 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Instance destroyed successfully.
May 27 23:18:04.570043 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1c1e9731-a0da-4d4c-a249-479ec6be741f tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'numa_topology' on Instance uuid c5922e78-9736-4a78-88dd-e32d56e81658 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:05.072780 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-1c1e9731-a0da-4d4c-a249-479ec6be741f tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Object Instance<c5922e78-9736-4a78-88dd-e32d56e81658> lazy-loaded attributes: flavor,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:18:05.072957 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1c1e9731-a0da-4d4c-a249-479ec6be741f tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:05.380644 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003988979997302522 future=<Future at 0x726e60193c80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:05.381130 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Emitting event <LifecycleEvent: 1779923870.3801112, 5c2e5882-a178-4759-be58-b0e717d8dc0f => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:05.381319 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] VM Stopped (Lifecycle Event)
May 27 23:18:05.382507 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:05.382757 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.185155820000091 future=<Future at 0x726e604b16a0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:05.382832 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.185064814999805 future=<Future at 0x726e604b16a0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:05.557204 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:05.579887 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1c1e9731-a0da-4d4c-a249-479ec6be741f tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "c5922e78-9736-4a78-88dd-e32d56e81658" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.341s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:05.883811 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0ea083cf-db3e-4e7a-a636-498f7528a1f0 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: 5c2e5882-a178-4759-be58-b0e717d8dc0f] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:05.930369 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:06.124457 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:06.124843 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:18:06.711908 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5a227cfc-855e-4e46-bd64-601ae35569ee req-8e22dec7-4800-4356-a743-f1a55918001e service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:06.712383 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5a227cfc-855e-4e46-bd64-601ae35569ee req-8e22dec7-4800-4356-a743-f1a55918001e service nova] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:06.712513 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5a227cfc-855e-4e46-bd64-601ae35569ee req-8e22dec7-4800-4356-a743-f1a55918001e service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:06.712608 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5a227cfc-855e-4e46-bd64-601ae35569ee req-8e22dec7-4800-4356-a743-f1a55918001e service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:06.712778 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5a227cfc-855e-4e46-bd64-601ae35569ee req-8e22dec7-4800-4356-a743-f1a55918001e service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] No waiting events found dispatching network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:06.712987 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-5a227cfc-855e-4e46-bd64-601ae35569ee req-8e22dec7-4800-4356-a743-f1a55918001e service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received unexpected event network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 for instance with vm_state stopped and task_state powering-on.
May 27 23:18:07.123532 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'flavor' on Instance uuid c5922e78-9736-4a78-88dd-e32d56e81658 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:07.627227 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:18:07.627498 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquired lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:18:07.627625 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:18:07.627760 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'info_cache' on Instance uuid c5922e78-9736-4a78-88dd-e32d56e81658 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:07.976970 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:08.130441 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Object Instance<c5922e78-9736-4a78-88dd-e32d56e81658> lazy-loaded attributes: flavor,info_cache {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:18:08.632584 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:08.754811 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:18:08.780802 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-911a4b90-f06c-4c9e-ba87-45e0a48e9800 req-f19b15c4-9aa1-47fd-81cd-a1579098b030 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:08.780951 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-911a4b90-f06c-4c9e-ba87-45e0a48e9800 req-f19b15c4-9aa1-47fd-81cd-a1579098b030 service nova] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:08.781261 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-911a4b90-f06c-4c9e-ba87-45e0a48e9800 req-f19b15c4-9aa1-47fd-81cd-a1579098b030 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:08.781413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-911a4b90-f06c-4c9e-ba87-45e0a48e9800 req-f19b15c4-9aa1-47fd-81cd-a1579098b030 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:08.781527 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-911a4b90-f06c-4c9e-ba87-45e0a48e9800 req-f19b15c4-9aa1-47fd-81cd-a1579098b030 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] No waiting events found dispatching network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:08.781654 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-911a4b90-f06c-4c9e-ba87-45e0a48e9800 req-f19b15c4-9aa1-47fd-81cd-a1579098b030 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received unexpected event network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 for instance with vm_state stopped and task_state powering-on.
May 27 23:18:08.942477 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:09.082383 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Updating instance_info_cache with network_info: [{"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:09.350693 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:09.585562 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Releasing lock "refresh_cache-c5922e78-9736-4a78-88dd-e32d56e81658" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:18:09.595132 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:10.598946 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Instance destroyed successfully.
May 27 23:18:10.598946 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'numa_topology' on Instance uuid c5922e78-9736-4a78-88dd-e32d56e81658 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:10.932961 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:11.100696 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Object Instance<c5922e78-9736-4a78-88dd-e32d56e81658> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:18:11.101127 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'resources' on Instance uuid c5922e78-9736-4a78-88dd-e32d56e81658 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:11.124513 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:11.124673 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 27 23:18:11.602657 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Object Instance<c5922e78-9736-4a78-88dd-e32d56e81658> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:18:11.603189 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1151699872',display_name='tempest-TestVolumeBootPattern-server-1151699872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1151699872',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrAVGTgm2VzIShXJzbfnm8BU22rDg/lkgw+oDhkdsWrFKf0925HUM6hZfOKvJiwz8AJs5At33nJv2EgruZOHIVLKt07xsBG0gcYb9z1nfWS45ND0vVM4HZYodJ6dw3i9Q==',key_name='tempest-keypair-1096794055',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:17:24Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-j3y0k0sb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=c5922e78-9736-4a78-88dd-e32d56e81658,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:18:11.603386 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:11.604102 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:11.604462 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:18:11.606362 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:11.606362 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4cd13a8-b0, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:11.607104 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:11.607840 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:11.608299 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:11.609141 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:11.609305 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=169e3af1-93d1-460a-8963-212df4c98ab1) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:11.609789 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:11.610178 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:11.610634 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:11.612502 np0000001565 nova-compute[98289]: INFO os_vif [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0')
May 27 23:18:11.613998 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:18:11.614321 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:11.614519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:11.614946 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:11.615384 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:18:11.615578 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:18:11.627033 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] There are 0 instances to clean {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 27 23:18:11.627270 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:11.627414 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98289) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 27 23:18:11.640769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:11.640769 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:11.640769 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:11.640769 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:11.640769 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:11.640769 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:11.640769 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:11.640769 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:11.640769 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:11.640769 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:11.640769 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:11.641279 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:11.641279 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:11.641279 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:11.641279 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:11.641279 np0000001565 nova-compute[98289]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:11.641279 np0000001565 nova-compute[98289]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:11.641279 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:11.641279 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:11.641279 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:11.641279 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:11.641279 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:11.641279 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '178'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', '183')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:18:11.641844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '177')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:11.642740 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '178')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:11.643615 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e601c59e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'): ({'sdd'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:18:11.643839 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Removing multipathed devices sdd, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:18:11.644055 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flush multipath device 330000000a51c1468 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:18:11.719579 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:11.757924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:11.804770 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:18:11.804960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:18:11.806611 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:18:11.817451 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:18:11.817687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:18:11.828465 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:11.872399 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.40.100,3260]
May 27 23:18:11.872399 np0000001565 nova-compute[98289]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.40.100,3260] successful.
May 27 23:18:11.872399 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:11.890849 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:11.901887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:11.934690 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 178, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.50.100,3260]
May 27 23:18:11.934690 np0000001565 nova-compute[98289]: Logout of [sid: 178, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.50.100,3260] successful.
May 27 23:18:11.934690 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:11.951064 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:11.951384 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:11.951540 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== disconnect_volume: return (336ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:11.951693 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:18:11.955664 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Start _get_guest_xml network_info=[{"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '20858cf5-0b21-401a-b39f-b3c855fa0e78', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': 'c5922e78-9736-4a78-88dd-e32d56e81658', 'attached_at': '', 'detached_at': '', 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'serial': '132d63da-df76-4b59-a7bf-f9f58ec107b1'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:18:11.957669 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:18:11.958767 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1151699872', uuid='c5922e78-9736-4a78-88dd-e32d56e81658'), owner=OwnerMeta(userid='31823a44e786429f80ba607958f8b63e', username='tempest-TestVolumeBootPattern-314561297-project-member', projectid='5dda425dab8946dc926808806eeedced', projectname='tempest-TestVolumeBootPattern-314561297'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923891.9584522) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:18:11.959738 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:18:11.960098 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:18:11.961084 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:18:11.961283 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:18:11.962498 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:18:11.962842 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:18:11.963017 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:18:11.963135 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:18:11.963309 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:18:11.963443 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:18:11.963574 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:18:11.963763 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:18:11.963879 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:18:11.964388 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:18:11.964545 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:18:11.964841 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:18:11.964875 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'vcpu_model' on Instance uuid c5922e78-9736-4a78-88dd-e32d56e81658 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:12.129132 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 40.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:18:12.466719 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Object Instance<c5922e78-9736-4a78-88dd-e32d56e81658> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:18:12.475089 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:12.520686 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:12.521009 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:12.568716 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:12.569113 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:12.569302 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "/opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:12.569861 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "/opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:12.570199 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:18:12.570544 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:12.570678 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:12.571005 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:12.571231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:18:12.582114 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:12.582832 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:12.583101 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:12.583308 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:18:12.583649 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:12.583826 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:18:12.593988 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:18:12.593988 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:12.599239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:18:12.599239 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:12.605801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1] added
May 27 23:18:12.605801 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:18:12.605801 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:12.605801 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:12.605801 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:12.605801 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:12.605801 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:12.606251 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:18:12.606251 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0228(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:18:12.606312 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:18:12.609126 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1] added
May 27 23:18:12.609126 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:18:12.609126 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:12.609126 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:12.609126 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:12.609126 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:12.609126 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:12.609289 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:18:12.609430 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:18:12.609553 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:18:13.023397 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:18:13.606736 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:18:13.610197 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:18:13.623253 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:18:13.623253 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:18:13.629235 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:18:13.629235 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:13.636622 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:13.644563 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.654701 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:13.662472 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.662472 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.662472 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.662472 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.662472 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.662472 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.662472 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.662472 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.662472 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:13.662781 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.662781 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.662781 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.662781 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.662781 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.662781 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.662781 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.662781 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.662781 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:13.696698 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:13.696790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:13.700560 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.40.100,3260]
May 27 23:18:13.700560 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.40.100,3260] successful.
May 27 23:18:13.700560 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:13.702522 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:18:13.702682 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Claim successful on node np0000001565
May 27 23:18:13.712419 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:13.713153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.50.100,3260]
May 27 23:18:13.713153 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.50.100,3260] successful.
May 27 23:18:13.713153 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:13.727728 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:13.734448 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.734448 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.734448 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.734448 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.734448 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.734448 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.734448 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.734448 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.734448 np0000001565 nova-compute[98289]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:13.734448 np0000001565 nova-compute[98289]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:13.734448 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:13.734763 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.734763 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.734763 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.734763 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.734763 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.734763 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.734763 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.734763 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.734763 np0000001565 nova-compute[98289]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:13.734763 np0000001565 nova-compute[98289]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:13.734763 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:13.734955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:13.735099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:18:13.736390 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('8', '-', '-', 0) found on session 185 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:18:13.736502 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:18:13.746074 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.746074 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.746074 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.746074 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.746074 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.746074 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.746074 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.746074 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.746074 np0000001565 nova-compute[98289]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:13.746074 np0000001565 nova-compute[98289]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:13.746074 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:13.746709 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:13.746709 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:18:13.748462 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('9', '-', '-', 0) found on session 186 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:18:13.748631 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:18:13.750829 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 185 and hctl ['8', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:18:13.763250 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 186 and hctl ['9', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:18:14.351648 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:14.497395 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "2232483d-3400-4452-a398-d253b4f6cb88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:14.497564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "2232483d-3400-4452-a398-d253b4f6cb88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:14.497779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "2232483d-3400-4452-a398-d253b4f6cb88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:14.497922 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:14.498056 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:14.500175 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Terminating instance
May 27 23:18:14.750266 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Refreshing inventories for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 27 23:18:14.752048 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 185 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:18:14.752563 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:18:14.763892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 186 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:18:14.764152 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:18:14.789016 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Updating ProviderTree inventory for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 27 23:18:14.789181 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Updating inventory in ProviderTree for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 23:18:14.826400 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Refreshing aggregate associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, aggregates: None {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 27 23:18:14.869931 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Refreshing trait associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_PPC64LE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_AARCH64,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_STATELESS_FIRMWARE {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 27 23:18:15.003616 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:18:15.017643 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.024750 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.035654 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.037365 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.055904 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.149855 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:18:15.150079 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:18:15.316612 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999612746999901 future=<Future at 0x726e583aa750 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:15.317643 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Instance destroyed successfully.
May 27 23:18:15.318285 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lazy-loading 'resources' on Instance uuid 2232483d-3400-4452-a398-d253b4f6cb88 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:15.460466 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "e54d5157-0f40-462b-84c9-c6ac326ed182" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:15.460622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:15.460774 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:15.460876 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:15.460986 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:15.463282 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Terminating instance
May 27 23:18:15.584084 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:18:15.652792 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:18:15.821035 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1477133638',display_name='tempest-TestEncryptedCinderVolumes-server-1477133638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1477133638',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwpLIDJzmmj8DOOIr1KJSEMd+lIpXx0aX3N2m8iUzldrJ/GuIUPYvReVhfmMiDVx83K1VHGQco6OTrLiBD8PtdDgFRaFsX4ihfkPtv7oJvf/xEiMdyvlvg2/fN1X+W+HA==',key_name='tempest-TestEncryptedCinderVolumes-418939601',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:17:34Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2d4267649c9432993626e440932bf08',ramdisk_id='',reservation_id='r-d08wypaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-274929604',owner_user_name='tempest-TestEncryptedCinderVolumes-274929604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:17:35Z,user_data=None,user_id='6418d61428124c1c98659435dd6b8bff',uuid=2232483d-3400-4452-a398-d253b4f6cb88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "address": "fa:16:3e:98:e8:7d", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f9a8b2-de", "ovs_interfaceid": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:18:15.821672 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converting VIF {"id": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "address": "fa:16:3e:98:e8:7d", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f9a8b2-de", "ovs_interfaceid": "f6f9a8b2-de44-424a-a7cc-b0c2204af066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:15.822024 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:e8:7d,bridge_name='br-int',has_traffic_filtering=True,id=f6f9a8b2-de44-424a-a7cc-b0c2204af066,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f9a8b2-de') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:15.822313 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:e8:7d,bridge_name='br-int',has_traffic_filtering=True,id=f6f9a8b2-de44-424a-a7cc-b0c2204af066,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f9a8b2-de') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:18:15.823985 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.824241 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6f9a8b2-de, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:15.825435 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.826160 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:15.826433 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.827108 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.827241 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92158b83-d120-469c-8434-4d163dde111f) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:15.827641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.828101 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:15.828359 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.829944 np0000001565 nova-compute[98289]: INFO os_vif [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:e8:7d,bridge_name='br-int',has_traffic_filtering=True,id=f6f9a8b2-de44-424a-a7cc-b0c2204af066,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f9a8b2-de')
May 27 23:18:15.832473 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:18:15.832783 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:15.832937 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:15.965818 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:18:15.979476 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.981642 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:15.996850 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:16.111388 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:16.114088 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5f655a80-b0bc-4efa-832f-db4d6d644222 req-f981d8af-b32b-4b80-a2ca-8ce50e4e368b service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Received event network-vif-unplugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:16.114548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5f655a80-b0bc-4efa-832f-db4d6d644222 req-f981d8af-b32b-4b80-a2ca-8ce50e4e368b service nova] Acquiring lock "2232483d-3400-4452-a398-d253b4f6cb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:16.114548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5f655a80-b0bc-4efa-832f-db4d6d644222 req-f981d8af-b32b-4b80-a2ca-8ce50e4e368b service nova] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:16.114687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5f655a80-b0bc-4efa-832f-db4d6d644222 req-f981d8af-b32b-4b80-a2ca-8ce50e4e368b service nova] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:16.114838 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5f655a80-b0bc-4efa-832f-db4d6d644222 req-f981d8af-b32b-4b80-a2ca-8ce50e4e368b service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] No waiting events found dispatching network-vif-unplugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:16.115350 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5f655a80-b0bc-4efa-832f-db4d6d644222 req-f981d8af-b32b-4b80-a2ca-8ce50e4e368b service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Received event network-vif-unplugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:18:16.117353 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:16.158265 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.461s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:16.158748 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:18:16.251368 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:16.257269 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:16.276092 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999723746999734 future=<Future at 0x726e386c77d0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:16.279423 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Instance destroyed successfully.
May 27 23:18:16.279971 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lazy-loading 'resources' on Instance uuid e54d5157-0f40-462b-84c9-c6ac326ed182 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:16.597398 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Found WWN 330000000a51c1468 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:18:16.597593 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.027s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:16.597773 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== connect_volume: return (4027ms) {'type': 'block', 'scsi_wwn': '330000000a51c1468', 'path': '/dev/dm-0', 'multipath_id': '330000000a51c1468'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:16.597917 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a51c1468', 'path': '/dev/dm-0', 'multipath_id': '330000000a51c1468'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:18:16.598500 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.765s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:16.598919 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:18:16.599163 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:18:16.624977 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:16.624977 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:16.624977 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:16.624977 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:16.624977 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:16.624977 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:16.624977 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:16.624977 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:16.624977 np0000001565 nova-compute[98289]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:16.624977 np0000001565 nova-compute[98289]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:16.624977 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:16.625286 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:16.625286 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:16.625286 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:16.625286 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:16.625286 np0000001565 nova-compute[98289]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:16.625286 np0000001565 nova-compute[98289]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807 (non-flash)
May 27 23:18:16.625286 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:16.625286 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:16.625286 np0000001565 nova-compute[98289]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:16.625286 np0000001565 nova-compute[98289]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:16.625286 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:16.625486 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '186')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:18:16.625583 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', '181')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:16.626693 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807', '180')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:16.627540 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e601c5a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807'): ({'sdk'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:18:16.627736 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Removing multipathed devices sdk, sdl {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:18:16.627975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Flush multipath device 33000000018ee3933 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:18:16.663829 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:18:16.664071 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:18:16.664344 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:16.664597 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:16.666623 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:16.706783 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:16.727346 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b20fe60fc49e4fbeb9ea63bf3cf9e3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f40c2f26134e52b9d0ba5a2d3deb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:18:16.753694 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:18:16.753878 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:18:16.755174 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:18:16.766094 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:18:16.766519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:18:16.776901 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:16.783078 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-49678815',display_name='tempest-TestVolumeBootPatternV346-server-49678815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpatternv346-server-49678815',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPqq5vFG69+WQjViZG6CZ4+evGplG34z3VI84lRebsZ69u55zPq7fw3upGNPOmH6PRoJ4e3DSlGsIfwtP/rT7DNI5rpjYT2DZEN9rdU16t4cnnV7C510Ky1Ec5SU3xxmA==',key_name='tempest-keypair-1017057203',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:17:37Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d095aed76494dd7b4c64e9209c14483',ramdisk_id='',reservation_id='r-agsi33m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-405934088',owner_user_name='tempest-TestVolumeBootPatternV346-405934088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afdb0f7fb014ac993fc36395de07be6',uuid=e54d5157-0f40-462b-84c9-c6ac326ed182,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:18:16.783292 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converting VIF {"id": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "address": "fa:16:3e:18:c8:14", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37929967-bd", "ovs_interfaceid": "37929967-bd9f-4e8d-ae0e-c387494c50c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:16.783715 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=37929967-bd9f-4e8d-ae0e-c387494c50c1,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37929967-bd') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:16.783913 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=37929967-bd9f-4e8d-ae0e-c387494c50c1,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37929967-bd') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:18:16.784864 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:16.785008 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37929967-bd, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:16.785781 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:16.786521 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:16.786817 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:16.787296 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:16.787436 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=394b6c7e-e881-4db7-bedf-4fc22081f290) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:16.788140 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:16.788253 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:16.788540 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:16.789874 np0000001565 nova-compute[98289]: INFO os_vif [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=37929967-bd9f-4e8d-ae0e-c387494c50c1,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37929967-bd')
May 27 23:18:16.791181 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:18:16.791446 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d4bec6-c18c-4c78-ba4b-8451875747f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:16.791558 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:16.813516 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807, portal: 192.168.40.100,3260]
May 27 23:18:16.813516 np0000001565 nova-compute[98289]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807, portal: 192.168.40.100,3260] successful.
May 27 23:18:16.813516 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:16.830146 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:16.842888 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:16.880357 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 180, target: iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807, portal: 192.168.50.100,3260]
May 27 23:18:16.880357 np0000001565 nova-compute[98289]: Logout of [sid: 180, target: iqn.2023-03.storpool.com:os--volume-0329c084-0daf-4ac7-9cb6-e3ae3ed36807, portal: 192.168.50.100,3260] successful.
May 27 23:18:16.880357 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:16.896344 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:16.897388 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:16.897679 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] <== disconnect_volume: return (1064ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:16.897958 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:18:16.898413 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.107s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:16.898743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d4bec6-c18c-4c78-ba4b-8451875747f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:18:16.898881 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:18:16.899311 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Deleting instance files /opt/stack/data/nova/instances/2232483d-3400-4452-a398-d253b4f6cb88_del
May 27 23:18:16.900094 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Deletion of /opt/stack/data/nova/instances/2232483d-3400-4452-a398-d253b4f6cb88_del complete
May 27 23:18:16.923622 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:16.923622 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:16.923622 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:16.923622 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:16.923622 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:16.923622 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:16.923622 np0000001565 nova-compute[98289]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:16.923622 np0000001565 nova-compute[98289]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:16.923622 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:16.924113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:16.924113 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:16.924113 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:16.924113 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:16.924113 np0000001565 nova-compute[98289]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:16.924113 np0000001565 nova-compute[98289]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5 (non-flash)
May 27 23:18:16.924113 np0000001565 nova-compute[98289]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:16.924113 np0000001565 nova-compute[98289]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:16.924113 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:16.924113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '186')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:18:16.924113 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', '182')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:16.924819 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5', '183')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:16.925550 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e601c5a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5'): ({'sdn'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:18:16.925711 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Removing multipathed devices sdm, sdn {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:18:16.925909 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Flush multipath device 330000000593ce071 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:18:16.982502 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:17.038945 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:17.090704 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Checking to see if SCSI volumes sdm, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:18:17.090867 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] SCSI volumes sdm, sdn have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:18:17.092057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Checking to see if device paths {'sdm', 'sdn'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:18:17.103766 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1151699872',display_name='tempest-TestVolumeBootPattern-server-1151699872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1151699872',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrAVGTgm2VzIShXJzbfnm8BU22rDg/lkgw+oDhkdsWrFKf0925HUM6hZfOKvJiwz8AJs5At33nJv2EgruZOHIVLKt07xsBG0gcYb9z1nfWS45ND0vVM4HZYodJ6dw3i9Q==',key_name='tempest-keypair-1096794055',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:17:24Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-j3y0k0sb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=c5922e78-9736-4a78-88dd-e32d56e81658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:18:17.103989 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:17.104600 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:17.105289 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'pci_devices' on Instance uuid c5922e78-9736-4a78-88dd-e32d56e81658 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:17.107375 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Device paths {'sdm', 'sdn'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:18:17.107848 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:18:17.119476 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:17.142573 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Successfully created port: 3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:18:17.149758 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5, portal: 192.168.40.100,3260]
May 27 23:18:17.149758 np0000001565 nova-compute[98289]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5, portal: 192.168.40.100,3260] successful.
May 27 23:18:17.149758 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:17.165567 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:17.166477 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:18:17.177975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:17.208522 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 183, target: iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5, portal: 192.168.50.100,3260]
May 27 23:18:17.208522 np0000001565 nova-compute[98289]: Logout of [sid: 183, target: iqn.2023-03.storpool.com:os--volume-d2d4bec6-c18c-4c78-ba4b-8451875747f5, portal: 192.168.50.100,3260] successful.
May 27 23:18:17.208522 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:17.224070 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:17.224273 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:17.224421 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] <== disconnect_volume: return (432ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:17.224529 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:18:17.224747 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Deleting instance files /opt/stack/data/nova/instances/e54d5157-0f40-462b-84c9-c6ac326ed182_del
May 27 23:18:17.225183 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Deletion of /opt/stack/data/nova/instances/e54d5157-0f40-462b-84c9-c6ac326ed182_del complete
May 27 23:18:17.406849 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Took 2.40 seconds to destroy the instance on the hypervisor.
May 27 23:18:17.407548 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:18:17.407897 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:18:17.408072 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:18:17.408352 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:17.476312 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:17.594969 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Successfully updated port: 3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:18:17.608111 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Object Instance<c5922e78-9736-4a78-88dd-e32d56e81658> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:18:17.609968 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] End _get_guest_xml xml=<domain type="qemu">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <uuid>c5922e78-9736-4a78-88dd-e32d56e81658</uuid>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <name>instance-00000043</name>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPattern-server-1151699872</nova:name>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:18:11</nova:creationTime>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:user uuid="31823a44e786429f80ba607958f8b63e">tempest-TestVolumeBootPattern-314561297-project-member</nova:user>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:project uuid="5dda425dab8946dc926808806eeedced">tempest-TestVolumeBootPattern-314561297</nova:project>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         <nova:port uuid="f4cd13a8-b033-4d11-b8a3-586f1b916698">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <system>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <entry name="serial">c5922e78-9736-4a78-88dd-e32d56e81658</entry>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <entry name="uuid">c5922e78-9736-4a78-88dd-e32d56e81658</entry>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     </system>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <os>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   </os>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <features>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   </features>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   <devices>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/disk.config"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     </disk>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <alias name="ua-132d63da-df76-4b59-a7bf-f9f58ec107b1"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <serial>132d63da-df76-4b59-a7bf-f9f58ec107b1</serial>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     </disk>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ee:5c:c0"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <target dev="tapf4cd13a8-b0"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     </interface>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658/console.log" append="off"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     </serial>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <video>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     </video>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     </rng>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:   </devices>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]: </domain>
May 27 23:18:17.609968 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:18:17.612386 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:18:17.612386 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1151699872',display_name='tempest-TestVolumeBootPattern-server-1151699872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1151699872',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrAVGTgm2VzIShXJzbfnm8BU22rDg/lkgw+oDhkdsWrFKf0925HUM6hZfOKvJiwz8AJs5At33nJv2EgruZOHIVLKt07xsBG0gcYb9z1nfWS45ND0vVM4HZYodJ6dw3i9Q==',key_name='tempest-keypair-1096794055',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:17:24Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-j3y0k0sb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=c5922e78-9736-4a78-88dd-e32d56e81658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:18:17.612386 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:17.612386 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:17.612386 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:18:17.612693 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:17.612693 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:17.614028 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:18:17.614028 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:17.614028 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c0a7325-8cc5-5a8c-afe4-4c9babda4120', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:17.614028 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:17.614510 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:17.614763 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:17.616563 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:17.616685 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4cd13a8-b0, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:17.616906 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4cd13a8-b0, col_values=(('qos', UUID('b0ed031b-b57f-4300-8446-619d5ac9ccd1')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:17.617053 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4cd13a8-b0, col_values=(('external_ids', {'iface-id': 'f4cd13a8-b033-4d11-b8a3-586f1b916698', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:5c:c0', 'vm-uuid': 'c5922e78-9736-4a78-88dd-e32d56e81658'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:17.618223 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:17.620080 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:17.623038 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:17.623896 np0000001565 nova-compute[98289]: INFO os_vif [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0')
May 27 23:18:17.669568 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:18:17.730897 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Took 1.76 seconds to destroy the instance on the hypervisor.
May 27 23:18:17.731655 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:18:17.732345 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:18:17.732475 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:18:17.732670 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:17.838746 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:17.897882 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-97982deb-0264-4c38-9567-f670d23bb20b req-9f532791-fbf2-428d-9830-2d9b1402a378 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Received event network-vif-deleted-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:17.898063 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-97982deb-0264-4c38-9567-f670d23bb20b req-9f532791-fbf2-428d-9830-2d9b1402a378 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Neutron deleted interface f6f9a8b2-de44-424a-a7cc-b0c2204af066; detaching it from the instance and deleting it from the info cache
May 27 23:18:17.899907 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-97982deb-0264-4c38-9567-f670d23bb20b req-9f532791-fbf2-428d-9830-2d9b1402a378 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Detach interface failed, port_id=f6f9a8b2-de44-424a-a7cc-b0c2204af066, reason: Instance 2232483d-3400-4452-a398-d253b4f6cb88 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:18:18.019991 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:18.037657 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:18.040200 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:18.098429 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:18:18.098527 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquired lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:18:18.098584 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:18:18.138354 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:18.182402 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Received event network-vif-unplugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:18.182628 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Acquiring lock "2232483d-3400-4452-a398-d253b4f6cb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:18.182818 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:18.182818 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Lock "2232483d-3400-4452-a398-d253b4f6cb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:18.183039 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] No waiting events found dispatching network-vif-unplugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:18.183148 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Received event network-vif-unplugged-f6f9a8b2-de44-424a-a7cc-b0c2204af066 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:18:18.183241 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Received event network-vif-unplugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:18.186015 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Acquiring lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:18.186167 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:18.186275 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:18.187149 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] No waiting events found dispatching network-vif-unplugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:18.187658 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Received event network-vif-unplugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:18:18.187658 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Received event network-vif-unplugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:18.187821 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Acquiring lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:18.188011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:18.188153 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:18.189694 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] No waiting events found dispatching network-vif-unplugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:18.189864 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Received event network-vif-unplugged-37929967-bd9f-4e8d-ae0e-c387494c50c1 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:18:18.190028 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-changed-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:18.190137 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Refreshing instance network info cache due to event network-changed-3a8534ea-2385-42d1-b07b-b88cde28f054. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:18:18.190251 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Acquiring lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:18:18.251176 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3e9f03f3-3127-4f96-94f9-04306c716647 req-91310593-91c6-4e44-9c39-b648ee179f5f service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Received event network-vif-deleted-37929967-bd9f-4e8d-ae0e-c387494c50c1 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:18.251326 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-3e9f03f3-3127-4f96-94f9-04306c716647 req-91310593-91c6-4e44-9c39-b648ee179f5f service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Neutron deleted interface 37929967-bd9f-4e8d-ae0e-c387494c50c1; detaching it from the instance and deleting it from the info cache
May 27 23:18:18.254505 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3e9f03f3-3127-4f96-94f9-04306c716647 req-91310593-91c6-4e44-9c39-b648ee179f5f service nova] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Detach interface failed, port_id=37929967-bd9f-4e8d-ae0e-c387494c50c1, reason: Instance e54d5157-0f40-462b-84c9-c6ac326ed182 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:18:18.332585 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:18.335478 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:18.350001 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:18.352981 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:18.669255 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:18:18.679248 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:18:18.680119 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:18:18.680343 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Creating image(s)
May 27 23:18:18.680742 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:18.682686 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:18.683173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:18.683444 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "ed5893e19e3c076451a9673ced27eac57ccd9d9c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:18.683703 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "ed5893e19e3c076451a9673ced27eac57ccd9d9c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:18.700092 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:18.726143 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for c5922e78-9736-4a78-88dd-e32d56e81658 due to new event <LifecycleEvent: 1779923898.7258387, c5922e78-9736-4a78-88dd-e32d56e81658 => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:18:18.726378 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923898.7258387, c5922e78-9736-4a78-88dd-e32d56e81658 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:18.728351 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] VM Resumed (Lifecycle Event)
May 27 23:18:18.728519 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Instance event wait completed in 0 seconds for  {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:18:18.740027 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Instance rebooted successfully.
May 27 23:18:18.819606 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:18.852614 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Took 1.44 seconds to deallocate network for instance.
May 27 23:18:18.950065 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updating instance_info_cache with network_info: [{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:19.124053 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:18:19.126563 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:18:19.126827 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c.part --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:19.203269 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Took 1.47 seconds to deallocate network for instance.
May 27 23:18:19.220028 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c.part --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:19.220588 np0000001565 nova-compute[98289]: DEBUG nova.virt.images [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] 0d709826-92d6-40a7-96b7-fe7f073414b7 was qcow2, converting to raw {{(pid=98289) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 23:18:19.221246 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:18:19.221574 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c.part /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c.converted {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:19.239772 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:19.250311 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:18:19.364987 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:19.389528 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c.part /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c.converted" returned: 0 in 0.168s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:19.394355 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c.converted --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:19.415354 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Took 0.56 seconds to detach 1 volumes for instance.
May 27 23:18:19.452234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Releasing lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:18:19.452660 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Instance network_info: |[{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:18:19.453226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Acquired lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:18:19.453538 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Refreshing network info cache for port 3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:18:19.485945 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c.converted --force-share --output=json" returned: 0 in 0.091s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:19.486379 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "ed5893e19e3c076451a9673ced27eac57ccd9d9c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.803s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:19.487015 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:18:19.490193 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:18:19.491541 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:19.568566 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0005698730001313379 future=<Future at 0x726e604b16a0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:19.568711 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:19.568853 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.747351678000086 future=<Future at 0x726e583aa750 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:19.568956 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.74722259300006 future=<Future at 0x726e583aa750 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:19.581665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:19.582090 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "ed5893e19e3c076451a9673ced27eac57ccd9d9c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:19.582554 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "ed5893e19e3c076451a9673ced27eac57ccd9d9c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:19.582962 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:18:19.585442 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:18:19.585734 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:19.676235 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:19.676790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c,backing_fmt=raw /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:19.736303 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c,backing_fmt=raw /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk 1073741824" returned: 0 in 0.059s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:19.736826 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "ed5893e19e3c076451a9673ced27eac57ccd9d9c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:19.737398 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:19.752931 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Took 0.55 seconds to detach 1 volumes for instance.
May 27 23:18:19.761183 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 23:18:19.767363 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923899.7663033, c5922e78-9736-4a78-88dd-e32d56e81658 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:19.767363 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] VM Started (Lifecycle Event)
May 27 23:18:19.830684 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c --force-share --output=json" returned: 0 in 0.093s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:19.831185 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:18:19.831495 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:19.923144 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:19.926035 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:19.945351 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:19.945351 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Cannot resize image /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:18:19.945351 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:18:19.945351 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Ensure instance console log exists: /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:18:19.945586 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:19.945611 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:19.945804 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:19.948115 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Start _get_guest_xml network_info=[{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T23:18:10Z,direct_url=<?>,disk_format='qcow2',id=0d709826-92d6-40a7-96b7-fe7f073414b7,min_disk=0,min_ram=0,name='tempest-scenario-img--2097100782',owner='30f40c2f26134e52b9d0ba5a2d3deb91',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T23:18:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '0d709826-92d6-40a7-96b7-fe7f073414b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:18:19.952513 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:18:19.954230 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0d709826-92d6-40a7-96b7-fe7f073414b7', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1612446662', uuid='18a78f17-3543-48db-bb55-ec15bdf2b27a'), owner=OwnerMeta(userid='b20fe60fc49e4fbeb9ea63bf3cf9e3d4', username='tempest-TestMinimumBasicScenario-365514479-project-member', projectid='30f40c2f26134e52b9d0ba5a2d3deb91', projectname='tempest-TestMinimumBasicScenario-365514479'), image=ImageMeta(id='0d709826-92d6-40a7-96b7-fe7f073414b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923899.953759) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:18:19.956081 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:19.958511 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:18:19.958873 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:18:19.962883 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:18:19.962883 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:18:19.963295 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:18:19.963690 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T23:18:10Z,direct_url=<?>,disk_format='qcow2',id=0d709826-92d6-40a7-96b7-fe7f073414b7,min_disk=0,min_ram=0,name='tempest-scenario-img--2097100782',owner='30f40c2f26134e52b9d0ba5a2d3deb91',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T23:18:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:18:19.963855 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:18:19.963963 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:18:19.964112 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:18:19.964269 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:18:19.964417 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:18:19.964574 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:18:19.964710 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:18:19.964886 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:18:19.965045 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:18:19.965168 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:18:19.979599 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1612446662',display_name='tempest-TestMinimumBasicScenario-server-1612446662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testminimumbasicscenario-server-1612446662',id=70,image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAqCphSPb8XRQSNMvn5VDyF92O7glfyqAu1atC0yO/MGEBvwr/90xBlv1JaiMPLKd/mHIvWKYAHmabuV5K/EmJfu+SLGTxRIE3bQp2cOjH03EpIHHagChlrb8gkaDsmLg==',key_name='tempest-TestMinimumBasicScenario-1773724696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30f40c2f26134e52b9d0ba5a2d3deb91',ramdisk_id='',reservation_id='r-0d61ien3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-365514479',owner_user_name='tempest-TestMinimumBasicScenario-365514479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:18:18Z,user_data=None,user_id='b20fe60fc49e4fbeb9ea63bf3cf9e3d4',uuid=18a78f17-3543-48db-bb55-ec15bdf2b27a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:18:19.979796 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converting VIF {"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:19.980453 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:19.980996 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'pci_devices' on Instance uuid 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:20.251268 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8edb2613-5a58-4a41-bb5f-eb7bb4bd9b00 req-af726d73-1013-4724-86b1-30f2381da643 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:20.251268 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8edb2613-5a58-4a41-bb5f-eb7bb4bd9b00 req-af726d73-1013-4724-86b1-30f2381da643 service nova] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:20.251268 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8edb2613-5a58-4a41-bb5f-eb7bb4bd9b00 req-af726d73-1013-4724-86b1-30f2381da643 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:20.251268 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8edb2613-5a58-4a41-bb5f-eb7bb4bd9b00 req-af726d73-1013-4724-86b1-30f2381da643 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:20.251268 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8edb2613-5a58-4a41-bb5f-eb7bb4bd9b00 req-af726d73-1013-4724-86b1-30f2381da643 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] No waiting events found dispatching network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:20.251268 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-8edb2613-5a58-4a41-bb5f-eb7bb4bd9b00 req-af726d73-1013-4724-86b1-30f2381da643 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received unexpected event network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 for instance with vm_state stopped and task_state powering-on.
May 27 23:18:20.266105 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:18:20.266231 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:18:20.266358 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No VIF found with MAC fa:16:3e:ee:5c:c0, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:18:20.266714 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-10e89797-a807-4189-bac7-696483b1efca tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:20.273322 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:20.274823 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:20.281996 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:20.284030 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:18:20.351675 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:18:20.352253 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:18:20.424624 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updated VIF entry in instance network info cache for port 3a8534ea-2385-42d1-b07b-b88cde28f054. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:18:20.424906 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updating instance_info_cache with network_info: [{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:20.484119 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] End _get_guest_xml xml=<domain type="qemu">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <uuid>18a78f17-3543-48db-bb55-ec15bdf2b27a</uuid>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <name>instance-00000046</name>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestMinimumBasicScenario-server-1612446662</nova:name>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:18:19</nova:creationTime>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <nova:image uuid="0d709826-92d6-40a7-96b7-fe7f073414b7">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:properties/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:user uuid="b20fe60fc49e4fbeb9ea63bf3cf9e3d4">tempest-TestMinimumBasicScenario-365514479-project-member</nova:user>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:project uuid="30f40c2f26134e52b9d0ba5a2d3deb91">tempest-TestMinimumBasicScenario-365514479</nova:project>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="0d709826-92d6-40a7-96b7-fe7f073414b7"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         <nova:port uuid="3a8534ea-2385-42d1-b07b-b88cde28f054">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <system>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <entry name="serial">18a78f17-3543-48db-bb55-ec15bdf2b27a</entry>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <entry name="uuid">18a78f17-3543-48db-bb55-ec15bdf2b27a</entry>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     </system>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <os>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   </os>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <features>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   </features>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   <devices>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     </disk>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.config"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     </disk>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ec:cb:1f"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <target dev="tap3a8534ea-23"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     </interface>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/console.log" append="off"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     </serial>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <video>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     </video>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     </rng>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:   </devices>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]: </domain>
May 27 23:18:20.484119 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:18:20.485973 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Preparing to wait for external event network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:18:20.485973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:20.485973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:20.485973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:20.485973 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1612446662',display_name='tempest-TestMinimumBasicScenario-server-1612446662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testminimumbasicscenario-server-1612446662',id=70,image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAqCphSPb8XRQSNMvn5VDyF92O7glfyqAu1atC0yO/MGEBvwr/90xBlv1JaiMPLKd/mHIvWKYAHmabuV5K/EmJfu+SLGTxRIE3bQp2cOjH03EpIHHagChlrb8gkaDsmLg==',key_name='tempest-TestMinimumBasicScenario-1773724696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30f40c2f26134e52b9d0ba5a2d3deb91',ramdisk_id='',reservation_id='r-0d61ien3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-365514479',owner_user_name='tempest-TestMinimumBasicScenario-365514479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:18:18Z,user_data=None,user_id='b20fe60fc49e4fbeb9ea63bf3cf9e3d4',uuid=18a78f17-3543-48db-bb55-ec15bdf2b27a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:18:20.485973 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converting VIF {"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:20.486227 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:20.486599 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:18:20.486922 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:20.487207 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:20.487487 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:18:20.488166 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:20.488312 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4347c5a3-3e78-5fa8-8572-1cf2d0b0d67c', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:20.498495 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:20.499293 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:20.501435 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:20.501600 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a8534ea-23, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:20.502044 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a8534ea-23, col_values=(('qos', UUID('011de692-3eaa-4ba5-aff4-b0f19f17c02b')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:20.502197 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a8534ea-23, col_values=(('external_ids', {'iface-id': '3a8534ea-2385-42d1-b07b-b88cde28f054', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:cb:1f', 'vm-uuid': '18a78f17-3543-48db-bb55-ec15bdf2b27a'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:20.502955 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:20.504514 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:20.508178 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:20.508973 np0000001565 nova-compute[98289]: INFO os_vif [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23')
May 27 23:18:20.786247 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 23:18:20.855266 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:18:20.927172 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Releasing lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:18:20.927587 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:20.927587 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:20.927676 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:20.927792 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:20.927924 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] No waiting events found dispatching network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:20.928051 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-0c44be24-1354-4226-a3bb-27d54ec1dbb2 req-0a634db7-8549-4c06-9448-5620b9735bd9 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received unexpected event network-vif-plugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 for instance with vm_state stopped and task_state powering-on.
May 27 23:18:21.262555 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c81fcfde-a206-4bf9-9935-83025fef2723 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Get console output
May 27 23:18:21.266808 np0000001565 nova-compute[98289]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 27 23:18:21.362707 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.439s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:21.364642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.090s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:21.433741 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Deleted allocations for instance 2232483d-3400-4452-a398-d253b4f6cb88
May 27 23:18:21.672715 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:18:21.672961 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:18:22.024168 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:18:22.024552 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:18:22.024552 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No VIF found with MAC fa:16:3e:ec:cb:1f, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:18:22.024733 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Using config drive
May 27 23:18:22.175373 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:18:22.440935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cc865e30-c544-48f0-afa1-983ceb5135f5 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "2232483d-3400-4452-a398-d253b4f6cb88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.943s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:22.531827 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:22.645787 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Creating config drive at /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.config
May 27 23:18:22.648950 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp50_cfc5h {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:22.685312 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.322s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:22.708722 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp50_cfc5h" returned: 0 in 0.060s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:22.734593 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Deleted allocations for instance e54d5157-0f40-462b-84c9-c6ac326ed182
May 27 23:18:23.126167 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:23.150220 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:23.249980 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:23.360783 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-786d7ea4-e469-4ce8-ba5f-7ef8482ad670 req-3b007833-f17e-46bf-8e75-1f5076dc5c8a service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:23.360783 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-786d7ea4-e469-4ce8-ba5f-7ef8482ad670 req-3b007833-f17e-46bf-8e75-1f5076dc5c8a service nova] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:23.360783 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-786d7ea4-e469-4ce8-ba5f-7ef8482ad670 req-3b007833-f17e-46bf-8e75-1f5076dc5c8a service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:23.360783 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-786d7ea4-e469-4ce8-ba5f-7ef8482ad670 req-3b007833-f17e-46bf-8e75-1f5076dc5c8a service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:23.361089 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-786d7ea4-e469-4ce8-ba5f-7ef8482ad670 req-3b007833-f17e-46bf-8e75-1f5076dc5c8a service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Processing event network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:18:23.405604 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:23.405843 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "c5922e78-9736-4a78-88dd-e32d56e81658" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:23.406072 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:23.406232 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:23.406410 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:23.410819 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Terminating instance
May 27 23:18:23.504222 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:23.505269 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:23.510446 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:23.529409 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:23.743196 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d962da1-6810-41eb-a5b0-79db32089834 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "e54d5157-0f40-462b-84c9-c6ac326ed182" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.282s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:23.916126 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:18:23.929730 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:23.932196 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:23.948099 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:23.949882 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:23.954270 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923903.9539223, 18a78f17-3543-48db-bb55-ec15bdf2b27a => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:23.955025 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:18:23.955225 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] VM Started (Lifecycle Event)
May 27 23:18:23.957743 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:18:23.960652 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Instance spawned successfully.
May 27 23:18:23.961028 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:18:23.968421 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:24.054578 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-82b38206-3e1d-4a7e-8644-22d9cf7647b2 req-9d7e5696-d73a-47bf-a788-fac06c31021a service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:24.054765 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-82b38206-3e1d-4a7e-8644-22d9cf7647b2 req-9d7e5696-d73a-47bf-a788-fac06c31021a service nova] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:24.055010 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-82b38206-3e1d-4a7e-8644-22d9cf7647b2 req-9d7e5696-d73a-47bf-a788-fac06c31021a service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:24.055046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-82b38206-3e1d-4a7e-8644-22d9cf7647b2 req-9d7e5696-d73a-47bf-a788-fac06c31021a service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:24.055158 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-82b38206-3e1d-4a7e-8644-22d9cf7647b2 req-9d7e5696-d73a-47bf-a788-fac06c31021a service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] No waiting events found dispatching network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:24.055276 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-82b38206-3e1d-4a7e-8644-22d9cf7647b2 req-9d7e5696-d73a-47bf-a788-fac06c31021a service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:18:24.238080 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Instance destroyed successfully.
May 27 23:18:24.238920 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'resources' on Instance uuid c5922e78-9736-4a78-88dd-e32d56e81658 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:24.366749 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:24.458737 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:24.461323 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:18:24.467824 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:24.467997 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:24.468375 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:24.468711 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:24.469011 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:24.469325 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:24.742403 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1151699872',display_name='tempest-TestVolumeBootPattern-server-1151699872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1151699872',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrAVGTgm2VzIShXJzbfnm8BU22rDg/lkgw+oDhkdsWrFKf0925HUM6hZfOKvJiwz8AJs5At33nJv2EgruZOHIVLKt07xsBG0gcYb9z1nfWS45ND0vVM4HZYodJ6dw3i9Q==',key_name='tempest-keypair-1096794055',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:17:24Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-j3y0k0sb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=c5922e78-9736-4a78-88dd-e32d56e81658,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:18:24.742624 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "address": "fa:16:3e:ee:5c:c0", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4cd13a8-b0", "ovs_interfaceid": "f4cd13a8-b033-4d11-b8a3-586f1b916698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:24.743344 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:24.743613 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:18:24.745048 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:24.746075 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4cd13a8-b0, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:24.758273 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:24.759462 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:24.760155 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:24.760308 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0ed031b-b57f-4300-8446-619d5ac9ccd1) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:24.760763 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:24.761296 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:24.763218 np0000001565 nova-compute[98289]: INFO os_vif [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:c0,bridge_name='br-int',has_traffic_filtering=True,id=f4cd13a8-b033-4d11-b8a3-586f1b916698,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4cd13a8-b0')
May 27 23:18:24.764457 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:18:24.764818 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:24.764970 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:24.963612 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:18:24.963897 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923904.9636254, 18a78f17-3543-48db-bb55-ec15bdf2b27a => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:24.964059 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] VM Paused (Lifecycle Event)
May 27 23:18:24.974596 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Took 6.30 seconds to spawn the instance on the hypervisor.
May 27 23:18:24.974761 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:25.429471 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-36dbd2a0-e601-4cd1-8812-c0399839ef85 req-db00517f-08e4-43b6-9b79-20696b650db0 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:25.432141 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-36dbd2a0-e601-4cd1-8812-c0399839ef85 req-db00517f-08e4-43b6-9b79-20696b650db0 service nova] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:25.432291 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-36dbd2a0-e601-4cd1-8812-c0399839ef85 req-db00517f-08e4-43b6-9b79-20696b650db0 service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:25.432428 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-36dbd2a0-e601-4cd1-8812-c0399839ef85 req-db00517f-08e4-43b6-9b79-20696b650db0 service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:25.432557 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-36dbd2a0-e601-4cd1-8812-c0399839ef85 req-db00517f-08e4-43b6-9b79-20696b650db0 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] No waiting events found dispatching network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:25.432648 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-36dbd2a0-e601-4cd1-8812-c0399839ef85 req-db00517f-08e4-43b6-9b79-20696b650db0 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received unexpected event network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 for instance with vm_state active and task_state None.
May 27 23:18:25.467041 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:25.471496 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923905.4713016, 18a78f17-3543-48db-bb55-ec15bdf2b27a => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:25.471604 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] VM Resumed (Lifecycle Event)
May 27 23:18:25.483644 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Took 11.96 seconds to build instance.
May 27 23:18:25.617229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.852s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:25.619967 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '132d63da-df76-4b59-a7bf-f9f58ec107b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:18:25.619967 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:18:25.643380 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:25.643380 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:25.643380 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:25.643380 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:25.643380 np0000001565 nova-compute[98289]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:25.643380 np0000001565 nova-compute[98289]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:25.643380 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:25.643380 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:25.643380 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:25.643817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:25.643817 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:25.643817 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:25.643817 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:25.643817 np0000001565 nova-compute[98289]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:25.643817 np0000001565 nova-compute[98289]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1 (non-flash)
May 27 23:18:25.643817 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:25.643817 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:25.643817 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:25.643817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '188')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:18:25.644179 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '185')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:25.645494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1', '186')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:25.645825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e602b1300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'): ({'sdd'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:18:25.646049 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Removing multipathed devices sdd, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:18:25.646279 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flush multipath device 330000000a51c1468 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:18:25.708706 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:25.757855 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:25.799141 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:18:25.799395 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:18:25.800535 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:18:25.812571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:18:25.812571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:18:25.825722 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:25.856486 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 185, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.40.100,3260]
May 27 23:18:25.856486 np0000001565 nova-compute[98289]: Logout of [sid: 185, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.40.100,3260] successful.
May 27 23:18:25.856486 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:25.873844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:25.889707 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:25.924612 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 186, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.50.100,3260]
May 27 23:18:25.924612 np0000001565 nova-compute[98289]: Logout of [sid: 186, target: iqn.2023-03.storpool.com:os--volume-132d63da-df76-4b59-a7bf-f9f58ec107b1, portal: 192.168.50.100,3260] successful.
May 27 23:18:25.924612 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:25.940380 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:25.940620 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:25.940773 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== disconnect_volume: return (1176ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:25.940901 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:18:25.941173 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Deleting instance files /opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658_del
May 27 23:18:25.941691 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Deletion of /opt/stack/data/nova/instances/c5922e78-9736-4a78-88dd-e32d56e81658_del complete
May 27 23:18:25.974269 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:25.975876 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:18:25.985781 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.464s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:26.107600 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a15c7c07-4c5a-4870-bae2-cb0ccabeeb56 req-d956d763-1d03-4514-8475-be25c3c870f1 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:26.107787 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a15c7c07-4c5a-4870-bae2-cb0ccabeeb56 req-d956d763-1d03-4514-8475-be25c3c870f1 service nova] Acquiring lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:26.107957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a15c7c07-4c5a-4870-bae2-cb0ccabeeb56 req-d956d763-1d03-4514-8475-be25c3c870f1 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:26.108066 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a15c7c07-4c5a-4870-bae2-cb0ccabeeb56 req-d956d763-1d03-4514-8475-be25c3c870f1 service nova] Lock "c5922e78-9736-4a78-88dd-e32d56e81658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:26.108177 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a15c7c07-4c5a-4870-bae2-cb0ccabeeb56 req-d956d763-1d03-4514-8475-be25c3c870f1 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] No waiting events found dispatching network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:26.108277 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a15c7c07-4c5a-4870-bae2-cb0ccabeeb56 req-d956d763-1d03-4514-8475-be25c3c870f1 service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-vif-unplugged-f4cd13a8-b033-4d11-b8a3-586f1b916698 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:18:26.448099 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Took 2.53 seconds to destroy the instance on the hypervisor.
May 27 23:18:26.449270 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:18:26.449510 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:18:26.450126 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:18:26.450126 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:26.478457 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.9996865600001 future=<Future at 0x726e604b0a10 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:26.549527 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:27.045878 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2ce2a7b0-fe28-49fa-8da0-e3934f8ae023 req-26b163ec-a22b-466f-926b-489086236dad service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Received event network-vif-deleted-f4cd13a8-b033-4d11-b8a3-586f1b916698 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:27.046788 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-2ce2a7b0-fe28-49fa-8da0-e3934f8ae023 req-26b163ec-a22b-466f-926b-489086236dad service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Neutron deleted interface f4cd13a8-b033-4d11-b8a3-586f1b916698; detaching it from the instance and deleting it from the info cache
May 27 23:18:27.048515 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2ce2a7b0-fe28-49fa-8da0-e3934f8ae023 req-26b163ec-a22b-466f-926b-489086236dad service nova] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Detach interface failed, port_id=f4cd13a8-b033-4d11-b8a3-586f1b916698, reason: Instance c5922e78-9736-4a78-88dd-e32d56e81658 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:18:27.492344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "b0ad0e52-02bc-40ff-992e-64d9d660c266" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:27.492344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:27.492344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:27.492344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:27.492344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:27.493592 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Terminating instance
May 27 23:18:27.500023 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:27.923131 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:27.923299 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:27.997282 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:18:28.002181 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Took 1.55 seconds to deallocate network for instance.
May 27 23:18:28.016825 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.019284 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.037757 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.174883 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.178648 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.183949 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ab1a2a10-e693-4a2d-a168-a6c836c30e43 req-fc7e0331-b327-4b62-abe9-f68845ba2a92 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Received event network-vif-unplugged-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:28.187572 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ab1a2a10-e693-4a2d-a168-a6c836c30e43 req-fc7e0331-b327-4b62-abe9-f68845ba2a92 service nova] Acquiring lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:28.187719 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ab1a2a10-e693-4a2d-a168-a6c836c30e43 req-fc7e0331-b327-4b62-abe9-f68845ba2a92 service nova] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:28.187835 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ab1a2a10-e693-4a2d-a168-a6c836c30e43 req-fc7e0331-b327-4b62-abe9-f68845ba2a92 service nova] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:28.187952 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ab1a2a10-e693-4a2d-a168-a6c836c30e43 req-fc7e0331-b327-4b62-abe9-f68845ba2a92 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] No waiting events found dispatching network-vif-unplugged-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:28.188047 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ab1a2a10-e693-4a2d-a168-a6c836c30e43 req-fc7e0331-b327-4b62-abe9-f68845ba2a92 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Received event network-vif-unplugged-c8474dbe-3166-457b-b300-69d6a51095aa for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:18:28.284469 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.290776 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.309280 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999637330000041 future=<Future at 0x726e604eb4d0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:28.310738 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Instance destroyed successfully.
May 27 23:18:28.311149 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lazy-loading 'resources' on Instance uuid b0ad0e52-02bc-40ff-992e-64d9d660c266 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:28.427144 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'flavor' on Instance uuid 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:28.546830 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Took 0.54 seconds to detach 1 volumes for instance.
May 27 23:18:28.814632 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2028657933',display_name='tempest-TestVolumeBootPatternV346-server-2028657933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpatternv346-server-2028657933',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi7TE1EjOBXND3pNTLCOWOnGwv4c1ynF8I5Yqg53Mkbb+M+fP3FSCFtelDRDubDA8QBy1vGLL9MdJMbAwEASz8Jpdlh9yvDJA6qHG2cYEACTBtD/8CudU7oCY+KjoHH1A==',key_name='tempest-keypair-2032128959',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:16:36Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d095aed76494dd7b4c64e9209c14483',ramdisk_id='',reservation_id='r-ubaptd6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-405934088',owner_user_name='tempest-TestVolumeBootPatternV346-405934088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:16:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afdb0f7fb014ac993fc36395de07be6',uuid=b0ad0e52-02bc-40ff-992e-64d9d660c266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8474dbe-3166-457b-b300-69d6a51095aa", "address": "fa:16:3e:2e:16:40", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8474dbe-31", "ovs_interfaceid": "c8474dbe-3166-457b-b300-69d6a51095aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:18:28.814856 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converting VIF {"id": "c8474dbe-3166-457b-b300-69d6a51095aa", "address": "fa:16:3e:2e:16:40", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8474dbe-31", "ovs_interfaceid": "c8474dbe-3166-457b-b300-69d6a51095aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:28.815314 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=c8474dbe-3166-457b-b300-69d6a51095aa,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8474dbe-31') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:28.815568 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=c8474dbe-3166-457b-b300-69d6a51095aa,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8474dbe-31') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:18:28.816651 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.816867 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8474dbe-31, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:28.818427 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.818826 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:28.818886 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.819581 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.819731 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=671911a7-54f0-43d0-acc1-cb9606e5bfd0) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:28.820168 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.820793 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:28.820841 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:28.822839 np0000001565 nova-compute[98289]: INFO os_vif [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=c8474dbe-3166-457b-b300-69d6a51095aa,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8474dbe-31')
May 27 23:18:28.824269 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:18:28.824596 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2690aa32-d545-44c3-9b62-b6946fe6187f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:28.824735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:28.825000 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:28.825268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2690aa32-d545-44c3-9b62-b6946fe6187f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:18:28.825356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:18:28.855469 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:28.855469 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:28.855469 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:28.855469 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:28.855469 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:28.855469 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:28.855469 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:28.855747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:28.855747 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:28.855747 np0000001565 nova-compute[98289]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:28.855747 np0000001565 nova-compute[98289]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f (non-flash)
May 27 23:18:28.855747 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:28.855747 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:28.855747 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:28.855884 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '188')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:18:28.856036 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '169')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:28.857151 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f', '168')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:28.857903 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e602eb880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f'): ({'sdb'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:18:28.858131 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Removing multipathed devices sdb, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:18:28.858414 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Flush multipath device 330000000b4caae7a {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:18:28.917988 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:28.968575 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:29.013861 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Checking to see if SCSI volumes sdb, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:18:29.014090 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] SCSI volumes sdb, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:18:29.018347 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Checking to see if device paths {'sdb', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:18:29.026090 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Device paths {'sdb', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:18:29.026599 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:18:29.039324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:29.051887 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:29.052062 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:29.065487 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f, portal: 192.168.40.100,3260]
May 27 23:18:29.065487 np0000001565 nova-compute[98289]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f, portal: 192.168.40.100,3260] successful.
May 27 23:18:29.065487 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:29.081566 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:29.093102 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:29.122344 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 168, target: iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f, portal: 192.168.50.100,3260]
May 27 23:18:29.122344 np0000001565 nova-compute[98289]: Logout of [sid: 168, target: iqn.2023-03.storpool.com:os--volume-2690aa32-d545-44c3-9b62-b6946fe6187f, portal: 192.168.50.100,3260] successful.
May 27 23:18:29.122344 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:29.146614 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:29.146834 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:29.146953 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] <== disconnect_volume: return (322ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:29.147067 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:18:29.150190 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Deleting instance files /opt/stack/data/nova/instances/b0ad0e52-02bc-40ff-992e-64d9d660c266_del
May 27 23:18:29.150843 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Deletion of /opt/stack/data/nova/instances/b0ad0e52-02bc-40ff-992e-64d9d660c266_del complete
May 27 23:18:29.284471 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:18:29.284744 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:18:29.367545 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:29.433019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:29.656952 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Took 1.66 seconds to destroy the instance on the hypervisor.
May 27 23:18:29.657451 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:18:29.657628 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:18:29.657734 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:18:29.657956 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:29.745625 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:29.787354 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:18:30.149054 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-edf79ef9-ac1c-4356-8904-e22f0eae0c2b req-018f6f79-2113-44e1-ad91-924e42e2b295 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Received event network-vif-deleted-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:30.149234 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-edf79ef9-ac1c-4356-8904-e22f0eae0c2b req-018f6f79-2113-44e1-ad91-924e42e2b295 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Neutron deleted interface c8474dbe-3166-457b-b300-69d6a51095aa; detaching it from the instance and deleting it from the info cache
May 27 23:18:30.151654 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-edf79ef9-ac1c-4356-8904-e22f0eae0c2b req-018f6f79-2113-44e1-ad91-924e42e2b295 service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Detach interface failed, port_id=c8474dbe-3166-457b-b300-69d6a51095aa, reason: Instance b0ad0e52-02bc-40ff-992e-64d9d660c266 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:18:30.259425 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ad5bfd4-b748-4d16-b006-75409906e0d9 req-5222689c-e2d6-4f7b-a552-e2074f70317c service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Received event network-vif-unplugged-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:30.259875 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ad5bfd4-b748-4d16-b006-75409906e0d9 req-5222689c-e2d6-4f7b-a552-e2074f70317c service nova] Acquiring lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:30.260098 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ad5bfd4-b748-4d16-b006-75409906e0d9 req-5222689c-e2d6-4f7b-a552-e2074f70317c service nova] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:30.260286 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0ad5bfd4-b748-4d16-b006-75409906e0d9 req-5222689c-e2d6-4f7b-a552-e2074f70317c service nova] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:30.260548 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ad5bfd4-b748-4d16-b006-75409906e0d9 req-5222689c-e2d6-4f7b-a552-e2074f70317c service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] No waiting events found dispatching network-vif-unplugged-c8474dbe-3166-457b-b300-69d6a51095aa {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:30.260735 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0ad5bfd4-b748-4d16-b006-75409906e0d9 req-5222689c-e2d6-4f7b-a552-e2074f70317c service nova] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Received event network-vif-unplugged-c8474dbe-3166-457b-b300-69d6a51095aa for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:18:30.296362 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.244s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:30.316578 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00034491199994590716 future=<Future at 0x726e583aa750 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:30.317032 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Emitting event <LifecycleEvent: 1779923895.316111, 2232483d-3400-4452-a398-d253b4f6cb88 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:30.317213 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:30.317412 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] VM Stopped (Lifecycle Event)
May 27 23:18:30.317942 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.9578535440000451 future=<Future at 0x726e386c77d0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:30.318069 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=0.9577121769998485 future=<Future at 0x726e386c77d0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:30.355714 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deleted allocations for instance c5922e78-9736-4a78-88dd-e32d56e81658
May 27 23:18:30.590992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:30.591162 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:30.591396 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Attaching volume 093124a1-c06a-48c8-beae-c1acbdfa06c6 to /dev/vdb
May 27 23:18:30.594149 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:30.632497 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:30.646991 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:18:30.670492 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:30.725615 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:18:30.725868 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:18:30.734562 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:18:30.735674 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fece:a0a4', 'fe80::dcaa:c7ff:fef8:d23c', 'fe80::fc16:3eff:feec:cb1f', 'fe80::bc5c:41ff:fe41:ca69'] 
May 27 23:18:30.735786 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:18:30.735910 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:18:30.736127 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:30.736365 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updating existing volume attachment record: 2112b607-a509-4cf4-ad25-d5bb8fa6acd1 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:18:30.820252 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3340393c-7ca8-4386-b1a9-c29d9dbcca4e tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 2232483d-3400-4452-a398-d253b4f6cb88] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:31.096209 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Took 1.44 seconds to deallocate network for instance.
May 27 23:18:31.279214 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004337929999564949 future=<Future at 0x726e386c77d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:31.279214 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:31.279349 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.198826715999985 future=<Future at 0x726e604b0a10 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:31.279513 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.198728969000058 future=<Future at 0x726e604b0a10 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:31.281797 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Emitting event <LifecycleEvent: 1779923896.2757215, e54d5157-0f40-462b-84c9-c6ac326ed182 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:31.281797 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] VM Stopped (Lifecycle Event)
May 27 23:18:31.283997 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:18:31.285983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:31.285983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:31.285983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:31.285983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:18:31.299015 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:31.299771 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:31.300341 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:31.300657 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:18:31.301126 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:31.301270 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:18:31.318947 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:18:31.318947 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:31.325777 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:18:31.325777 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:31.333412 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6] added
May 27 23:18:31.333412 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:18:31.333412 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:31.333412 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:31.333412 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:31.333412 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:31.333412 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:31.333412 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:18:31.333412 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:18:31.333644 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:18:31.338639 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6] added
May 27 23:18:31.338639 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:18:31.338639 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:31.338639 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:31.338639 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:31.338639 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:31.338639 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:31.338802 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:18:31.338962 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0377(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:18:31.339111 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:18:31.364268 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-a2b53842-46fc-40bb-bf6f-7933847e3991 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "c5922e78-9736-4a78-88dd-e32d56e81658" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.958s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:31.644599 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Took 0.55 seconds to detach 1 volumes for instance.
May 27 23:18:31.784601 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: e54d5157-0f40-462b-84c9-c6ac326ed182] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:32.149512 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:32.149682 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:32.307678 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:18:32.307907 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:18:32.334099 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:18:32.342770 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:18:32.348746 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:18:32.348746 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:18:32.357436 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:18:32.357436 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:32.364091 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:32.370875 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:32.377770 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.377770 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.377770 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.377770 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.377770 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:32.377990 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.377990 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.377990 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.377990 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.377990 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:32.384632 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.384632 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.384632 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.384632 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.384632 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:32.384772 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.384772 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.384772 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.384772 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.384772 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:32.410742 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.40.100,3260]
May 27 23:18:32.410742 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.40.100,3260] successful.
May 27 23:18:32.410742 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:32.422598 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:32.435208 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.50.100,3260]
May 27 23:18:32.435208 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.50.100,3260] successful.
May 27 23:18:32.435208 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:32.436220 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.436220 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.436220 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.436220 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.436220 np0000001565 nova-compute[98289]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:32.436220 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:32.436220 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:32.436608 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.436608 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.436608 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.436608 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.436608 np0000001565 nova-compute[98289]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:32.436608 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:32.436608 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:32.436928 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:32.437045 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:18:32.437758 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] HCTL ('7', '-', '-', 0) found on session 189 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:18:32.437850 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:18:32.446547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:32.457107 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching for a device in session 189 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:18:32.457306 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:18:32.464493 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.464493 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.464493 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.464493 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.464493 np0000001565 nova-compute[98289]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:32.464493 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:32.464493 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:32.464693 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.464693 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:32.464693 np0000001565 nova-compute[98289]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.464693 np0000001565 nova-compute[98289]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:32.464693 np0000001565 nova-compute[98289]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:32.464693 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:32.464693 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:32.464927 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:32.465061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:18:32.465891 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] HCTL ('8', '-', '-', 0) found on session 190 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:18:32.466022 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:18:32.486793 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching for a device in session 190 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:18:32.486898 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:18:32.810299 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:18:33.300670 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:18:33.318296 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.169s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:33.359516 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Deleted allocations for instance b0ad0e52-02bc-40ff-992e-64d9d660c266
May 27 23:18:33.821883 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:34.320448 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Found WWN 3300000009f565901 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:18:34.320660 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:34.320819 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000009f565901', 'path': '/dev/dm-0', 'multipath_id': '3300000009f565901'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:34.320937 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009f565901', 'path': '/dev/dm-0', 'multipath_id': '3300000009f565901'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:18:34.323850 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'flavor' on Instance uuid 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:34.367929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-40f5272f-c3dd-459e-95a9-c952aa00a875 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "b0ad0e52-02bc-40ff-992e-64d9d660c266" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.877s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:34.368691 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:34.826529 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Attempting to attach volume 093124a1-c06a-48c8-beae-c1acbdfa06c6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:18:34.828104 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:18:34.828104 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:18:34.828104 np0000001565 nova-compute[98289]:   <alias name="ua-093124a1-c06a-48c8-beae-c1acbdfa06c6"/>
May 27 23:18:34.828104 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:18:34.828104 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:18:34.828104 np0000001565 nova-compute[98289]:   <serial>093124a1-c06a-48c8-beae-c1acbdfa06c6</serial>
May 27 23:18:34.828104 np0000001565 nova-compute[98289]: </disk>
May 27 23:18:34.828104 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:18:36.024713 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "31752c04-799d-4f35-ac81-a56af64fb42c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:36.025175 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "31752c04-799d-4f35-ac81-a56af64fb42c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:36.449080 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "38d82a63-9b1e-460d-b781-48d0d07ed207" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:36.449280 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:36.472013 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:18:36.472156 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:18:36.472274 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:18:36.472401 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No VIF found with MAC fa:16:3e:ec:cb:1f, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:18:36.526689 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:18:36.950901 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:18:37.077495 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:37.077847 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:37.080662 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:18:37.080821 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Claim successful on node np0000001565
May 27 23:18:37.112186 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "fa66e95f-2701-4fde-92d4-668f096aa9cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:37.112473 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:37.112723 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:37.112921 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:37.113094 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:37.115303 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Terminating instance
May 27 23:18:37.505270 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:37.619110 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:18:37.635638 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:37.639540 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:37.657936 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:37.660517 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:37.683639 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:37.684693 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:37.788531 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dd06bcdb-6b89-4e54-8fae-de3985f10f4f req-4b9e5884-d545-411e-ab4d-64b39435d8a4 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Received event network-vif-unplugged-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:37.788760 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd06bcdb-6b89-4e54-8fae-de3985f10f4f req-4b9e5884-d545-411e-ab4d-64b39435d8a4 service nova] Acquiring lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:37.789007 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd06bcdb-6b89-4e54-8fae-de3985f10f4f req-4b9e5884-d545-411e-ab4d-64b39435d8a4 service nova] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:37.789136 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dd06bcdb-6b89-4e54-8fae-de3985f10f4f req-4b9e5884-d545-411e-ab4d-64b39435d8a4 service nova] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:37.789262 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dd06bcdb-6b89-4e54-8fae-de3985f10f4f req-4b9e5884-d545-411e-ab4d-64b39435d8a4 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] No waiting events found dispatching network-vif-unplugged-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:37.789409 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dd06bcdb-6b89-4e54-8fae-de3985f10f4f req-4b9e5884-d545-411e-ab4d-64b39435d8a4 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Received event network-vif-unplugged-eaa7472e-c269-4bed-8789-3840483286fb for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:18:37.924386 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:37.929153 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:37.955612 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99972039100021 future=<Future at 0x726e58376570 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:37.957598 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Instance destroyed successfully.
May 27 23:18:37.958652 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lazy-loading 'resources' on Instance uuid fa66e95f-2701-4fde-92d4-668f096aa9cd {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:38.023487 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-722a1a1b-7778-489f-8439-29f4cf3cf848 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.432s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:38.281643 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:18:38.283270 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:18:38.461273 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-798326639',display_name='tempest-TestVolumeBootPatternV346-server-798326639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpatternv346-server-798326639',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaBevHOiNzMnLmMQNtJg/gbb7w9qhm2+awRSKgLI7QrEhHZBTl9koFvLcl68fqfetWyuyKaN5Wffj9Rb9hYScC29BJOU8w1rq0RRO0dKrrjN/ik22t7zOhqpvbKpDei7Q==',key_name='tempest-keypair-729427564',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:15:46Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d095aed76494dd7b4c64e9209c14483',ramdisk_id='',reservation_id='r-ugs9yon5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-405934088',owner_user_name='tempest-TestVolumeBootPatternV346-405934088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afdb0f7fb014ac993fc36395de07be6',uuid=fa66e95f-2701-4fde-92d4-668f096aa9cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaa7472e-c269-4bed-8789-3840483286fb", "address": "fa:16:3e:ce:a0:a4", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa7472e-c2", "ovs_interfaceid": "eaa7472e-c269-4bed-8789-3840483286fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:18:38.461560 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converting VIF {"id": "eaa7472e-c269-4bed-8789-3840483286fb", "address": "fa:16:3e:ce:a0:a4", "network": {"id": "03b18f1a-d023-401b-a3c1-51cff15b1e22", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1930814864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0d095aed76494dd7b4c64e9209c14483", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa7472e-c2", "ovs_interfaceid": "eaa7472e-c269-4bed-8789-3840483286fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:38.462217 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:a0:a4,bridge_name='br-int',has_traffic_filtering=True,id=eaa7472e-c269-4bed-8789-3840483286fb,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa7472e-c2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:38.462483 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:a0:a4,bridge_name='br-int',has_traffic_filtering=True,id=eaa7472e-c269-4bed-8789-3840483286fb,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa7472e-c2') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:18:38.464503 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:38.464503 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaa7472e-c2, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:38.481684 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:38.481805 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:38.482520 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:38.483128 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:38.483266 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3785fef5-0406-4177-b783-084840ce6864) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:38.483779 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:38.484220 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:38.485348 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:38.487166 np0000001565 nova-compute[98289]: INFO os_vif [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:a0:a4,bridge_name='br-int',has_traffic_filtering=True,id=eaa7472e-c269-4bed-8789-3840483286fb,network=Network(03b18f1a-d023-401b-a3c1-51cff15b1e22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa7472e-c2')
May 27 23:18:38.488594 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:18:38.488861 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e5da58cd-548a-47f0-a634-b1a4c13695fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:38.488973 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:38.489310 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:38.489591 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e5da58cd-548a-47f0-a634-b1a4c13695fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:18:38.489695 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:18:38.511525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:38.511525 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:38.511525 np0000001565 nova-compute[98289]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:38.511525 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:38.511525 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:38.511751 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:38.511751 np0000001565 nova-compute[98289]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa (non-flash)
May 27 23:18:38.511751 np0000001565 nova-compute[98289]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:38.511751 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:38.511751 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:38.511841 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '190')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:18:38.511905 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '161')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:38.512690 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa', '162')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:18:38.513389 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58178860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa'): ({'sdf'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:18:38.513562 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Removing multipathed devices sdf, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:18:38.513762 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Flush multipath device 33000000028294696 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:18:38.561645 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:38.609080 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:18:38.652781 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:18:38.652935 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:18:38.653612 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:18:38.666829 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:18:38.667007 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:18:38.677898 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:38.706883 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa, portal: 192.168.40.100,3260]
May 27 23:18:38.706883 np0000001565 nova-compute[98289]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa, portal: 192.168.40.100,3260] successful.
May 27 23:18:38.706883 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:38.723167 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:38.736282 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:38.768371 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa, portal: 192.168.50.100,3260]
May 27 23:18:38.768371 np0000001565 nova-compute[98289]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-e5da58cd-548a-47f0-a634-b1a4c13695fa, portal: 192.168.50.100,3260] successful.
May 27 23:18:38.768371 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:38.780180 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:38.780341 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:38.780482 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] <== disconnect_volume: return (291ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:38.780600 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:18:38.780855 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Deleting instance files /opt/stack/data/nova/instances/fa66e95f-2701-4fde-92d4-668f096aa9cd_del
May 27 23:18:38.781338 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Deletion of /opt/stack/data/nova/instances/fa66e95f-2701-4fde-92d4-668f096aa9cd_del complete
May 27 23:18:38.785199 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:18:39.286630 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Took 1.67 seconds to destroy the instance on the hypervisor.
May 27 23:18:39.287168 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:18:39.288052 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:18:39.288172 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:18:39.288414 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:39.290597 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.213s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:39.291212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.786s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:39.291447 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:18:39.296936 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:18:39.297051 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Claim successful on node np0000001565
May 27 23:18:39.345735 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:39.771661 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-df02e72e-6838-43f6-9180-17b7c87aa7a7 req-7d16724d-ab3e-4cda-bd64-fdaadab82730 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Received event network-vif-deleted-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:39.772051 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-df02e72e-6838-43f6-9180-17b7c87aa7a7 req-7d16724d-ab3e-4cda-bd64-fdaadab82730 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Neutron deleted interface eaa7472e-c269-4bed-8789-3840483286fb; detaching it from the instance and deleting it from the info cache
May 27 23:18:39.773517 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-df02e72e-6838-43f6-9180-17b7c87aa7a7 req-7d16724d-ab3e-4cda-bd64-fdaadab82730 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Detach interface failed, port_id=eaa7472e-c269-4bed-8789-3840483286fb, reason: Instance fa66e95f-2701-4fde-92d4-668f096aa9cd could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:18:39.797880 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:18:39.798067 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:18:39.798344 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:39.798602 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:39.867505 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c2a19a2d-b31f-4bcb-b6ab-0071209d8849 req-b4d7f75f-19d5-4899-aacb-fae971fa8f71 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Received event network-vif-unplugged-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:39.867505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c2a19a2d-b31f-4bcb-b6ab-0071209d8849 req-b4d7f75f-19d5-4899-aacb-fae971fa8f71 service nova] Acquiring lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:39.867505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c2a19a2d-b31f-4bcb-b6ab-0071209d8849 req-b4d7f75f-19d5-4899-aacb-fae971fa8f71 service nova] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:39.867505 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c2a19a2d-b31f-4bcb-b6ab-0071209d8849 req-b4d7f75f-19d5-4899-aacb-fae971fa8f71 service nova] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:39.867505 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c2a19a2d-b31f-4bcb-b6ab-0071209d8849 req-b4d7f75f-19d5-4899-aacb-fae971fa8f71 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] No waiting events found dispatching network-vif-unplugged-eaa7472e-c269-4bed-8789-3840483286fb {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:39.867505 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c2a19a2d-b31f-4bcb-b6ab-0071209d8849 req-b4d7f75f-19d5-4899-aacb-fae971fa8f71 service nova] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Received event network-vif-unplugged-eaa7472e-c269-4bed-8789-3840483286fb for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:18:39.887314 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6418d61428124c1c98659435dd6b8bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d4267649c9432993626e440932bf08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:18:40.232708 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:40.312159 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:18:40.409135 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Successfully created port: 5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:18:40.555171 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:18:40.555372 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:18:40.734602 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Took 1.45 seconds to deallocate network for instance.
May 27 23:18:40.816389 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:18:40.898421 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Successfully updated port: 5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:18:41.057786 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:18:41.285803 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Took 0.55 seconds to detach 1 volumes for instance.
May 27 23:18:41.321106 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Booting with volume 77d32c8c-b044-4dbf-a084-3adf2f3165a4 at /dev/vda
May 27 23:18:41.358209 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:41.368318 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:18:41.390661 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:41.403909 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "refresh_cache-31752c04-799d-4f35-ac81-a56af64fb42c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:18:41.404116 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquired lock "refresh_cache-31752c04-799d-4f35-ac81-a56af64fb42c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:18:41.404304 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:18:41.434465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:18:41.434753 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:18:41.443875 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:18:41.444624 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:feec:cb1f', 'fe80::bc5c:41ff:fe41:ca69'] 
May 27 23:18:41.444769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:18:41.444830 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:18:41.445064 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:41.445240 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Updating existing volume attachment record: 66592bf2-26d5-45a5-8b15-1be5cf8ca961 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:18:41.479300 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0011822780002148647 future=<Future at 0x726e604b0a10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:41.479421 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:41.479523 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=1.8293528119997973 future=<Future at 0x726e604eb4d0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:41.479595 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=1.8292678879997766 future=<Future at 0x726e604eb4d0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:41.480095 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Emitting event <LifecycleEvent: 1779923906.478022, c5922e78-9736-4a78-88dd-e32d56e81658 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:41.480511 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] VM Stopped (Lifecycle Event)
May 27 23:18:41.564580 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.274s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:41.564990 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:18:41.791992 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:41.792218 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:41.848581 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f390b128-432a-4330-9859-7ef084a7a53d req-c122778b-1130-4457-b6b8-19ff0f484ce7 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Received event network-changed-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:41.848911 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f390b128-432a-4330-9859-7ef084a7a53d req-c122778b-1130-4457-b6b8-19ff0f484ce7 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Refreshing instance network info cache due to event network-changed-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:18:41.849066 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f390b128-432a-4330-9859-7ef084a7a53d req-c122778b-1130-4457-b6b8-19ff0f484ce7 service nova] Acquiring lock "refresh_cache-31752c04-799d-4f35-ac81-a56af64fb42c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:18:41.924652 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1fc895e5-88e8-4732-ba8d-4e4c23055e45 req-7877d519-432b-444f-836d-8ae5ef970af5 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-changed-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:41.925049 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1fc895e5-88e8-4732-ba8d-4e4c23055e45 req-7877d519-432b-444f-836d-8ae5ef970af5 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Refreshing instance network info cache due to event network-changed-3a8534ea-2385-42d1-b07b-b88cde28f054. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:18:41.925226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1fc895e5-88e8-4732-ba8d-4e4c23055e45 req-7877d519-432b-444f-836d-8ae5ef970af5 service nova] Acquiring lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:18:41.925378 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1fc895e5-88e8-4732-ba8d-4e4c23055e45 req-7877d519-432b-444f-836d-8ae5ef970af5 service nova] Acquired lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:18:41.925548 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1fc895e5-88e8-4732-ba8d-4e4c23055e45 req-7877d519-432b-444f-836d-8ae5ef970af5 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Refreshing network info cache for port 3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:18:41.979413 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:18:41.982992 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: c5922e78-9736-4a78-88dd-e32d56e81658] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:42.038079 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:18:42.038297 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:18:42.071037 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:18:42.071195 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:18:42.071512 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:42.071772 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:42.149417 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31823a44e786429f80ba607958f8b63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda425dab8946dc926808806eeedced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:18:42.157797 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:42.325153 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Updating instance_info_cache with network_info: [{"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:42.427326 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-1fc895e5-88e8-4732-ba8d-4e4c23055e45 req-7877d519-432b-444f-836d-8ae5ef970af5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:42.541169 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:18:42.569550 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Successfully created port: 7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:18:42.575175 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:18:42.733101 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-1fc895e5-88e8-4732-ba8d-4e4c23055e45 req-7877d519-432b-444f-836d-8ae5ef970af5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:42.827362 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Releasing lock "refresh_cache-31752c04-799d-4f35-ac81-a56af64fb42c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:18:42.827851 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Instance network_info: |[{"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:18:42.827983 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f390b128-432a-4330-9859-7ef084a7a53d req-c122778b-1130-4457-b6b8-19ff0f484ce7 service nova] Acquired lock "refresh_cache-31752c04-799d-4f35-ac81-a56af64fb42c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:18:42.828098 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f390b128-432a-4330-9859-7ef084a7a53d req-c122778b-1130-4457-b6b8-19ff0f484ce7 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Refreshing network info cache for port 5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:18:42.849073 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1fc895e5-88e8-4732-ba8d-4e4c23055e45 req-7877d519-432b-444f-836d-8ae5ef970af5 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updated VIF entry in instance network info cache for port 3a8534ea-2385-42d1-b07b-b88cde28f054. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:18:42.849320 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1fc895e5-88e8-4732-ba8d-4e4c23055e45 req-7877d519-432b-444f-836d-8ae5ef970af5 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updating instance_info_cache with network_info: [{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:43.040960 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Successfully updated port: 7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:18:43.048586 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.256s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:43.078574 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:18:43.096327 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Deleted allocations for instance fa66e95f-2701-4fde-92d4-668f096aa9cd
May 27 23:18:43.309280 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003573290000531415 future=<Future at 0x726e604eb4d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:43.309595 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Emitting event <LifecycleEvent: 1779923908.30881, b0ad0e52-02bc-40ff-992e-64d9d660c266 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:43.309723 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:43.309883 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] VM Stopped (Lifecycle Event)
May 27 23:18:43.310812 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.644433936000041 future=<Future at 0x726e58376570 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:43.310930 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.644313467000302 future=<Future at 0x726e58376570 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:43.330153 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f390b128-432a-4330-9859-7ef084a7a53d req-c122778b-1130-4457-b6b8-19ff0f484ce7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:43.352074 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1fc895e5-88e8-4732-ba8d-4e4c23055e45 req-7877d519-432b-444f-836d-8ae5ef970af5 service nova] Releasing lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:18:43.485071 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:43.539761 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:18:43.540988 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:18:43.541179 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Creating image(s)
May 27 23:18:43.541520 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:18:43.541693 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Ensure instance console log exists: /opt/stack/data/nova/instances/31752c04-799d-4f35-ac81-a56af64fb42c/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:18:43.541947 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:43.542446 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "refresh_cache-38d82a63-9b1e-460d-b781-48d0d07ed207" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:18:43.542689 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:43.543069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquired lock "refresh_cache-38d82a63-9b1e-460d-b781-48d0d07ed207" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:18:43.543430 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:43.544026 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:18:43.544893 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Start _get_guest_xml network_info=[{"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '66592bf2-26d5-45a5-8b15-1be5cf8ca961', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '31752c04-799d-4f35-ac81-a56af64fb42c', 'attached_at': '', 'detached_at': '', 'volume_id': '77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'serial': '77d32c8c-b044-4dbf-a084-3adf2f3165a4'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:18:43.547430 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:18:43.548920 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1087899189', uuid='31752c04-799d-4f35-ac81-a56af64fb42c'), owner=OwnerMeta(userid='6418d61428124c1c98659435dd6b8bff', username='tempest-TestEncryptedCinderVolumes-274929604-project-member', projectid='e2d4267649c9432993626e440932bf08', projectname='tempest-TestEncryptedCinderVolumes-274929604'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923923.5484486) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:18:43.550319 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:18:43.550842 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:18:43.552973 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:18:43.553161 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:18:43.554131 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:18:43.554453 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:18:43.554632 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:18:43.554759 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:18:43.554940 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:18:43.555068 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:18:43.555215 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:18:43.555427 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:18:43.555564 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:18:43.555936 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:18:43.556059 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:18:43.556201 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:18:43.566538 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:18:43.568956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:43.569094 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:43.570093 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:43.570266 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:18:43.582650 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Booting with volume snapshot 81c3b1d3-e5e7-453f-9413-8dd92d95abfb at /dev/vda
May 27 23:18:43.585057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:43.585670 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:43.586434 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:43.586625 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:18:43.587167 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:43.587376 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:18:43.602852 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:18:43.602852 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:43.603320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:18:43.603320 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:43.617076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4] added
May 27 23:18:43.617076 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:18:43.617076 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:43.617076 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:43.617076 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:43.617076 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:43.617076 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:43.619207 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f390b128-432a-4330-9859-7ef084a7a53d req-c122778b-1130-4457-b6b8-19ff0f484ce7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:43.621263 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:18:43.621567 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:18:43.621722 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:18:43.623976 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4] added
May 27 23:18:43.623976 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:18:43.623976 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:43.623976 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:43.623976 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:43.623976 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:43.623976 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:43.623976 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:18:43.623976 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:18:43.624230 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:18:43.763303 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f390b128-432a-4330-9859-7ef084a7a53d req-c122778b-1130-4457-b6b8-19ff0f484ce7 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Updated VIF entry in instance network info cache for port 5273a52e-e20f-4f70-8f86-cf9d6f6e9b26. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:18:43.763472 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f390b128-432a-4330-9859-7ef084a7a53d req-c122778b-1130-4457-b6b8-19ff0f484ce7 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Updating instance_info_cache with network_info: [{"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:43.812344 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: b0ad0e52-02bc-40ff-992e-64d9d660c266] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:43.904585 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dca8cd0f-bc98-400d-b3d8-186b77037e57 req-feaf5b1f-9c43-4238-881c-fd66b086376d service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-changed-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:43.904700 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dca8cd0f-bc98-400d-b3d8-186b77037e57 req-feaf5b1f-9c43-4238-881c-fd66b086376d service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Refreshing instance network info cache due to event network-changed-3a8534ea-2385-42d1-b07b-b88cde28f054. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:18:43.905286 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dca8cd0f-bc98-400d-b3d8-186b77037e57 req-feaf5b1f-9c43-4238-881c-fd66b086376d service nova] Acquiring lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:18:43.905404 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dca8cd0f-bc98-400d-b3d8-186b77037e57 req-feaf5b1f-9c43-4238-881c-fd66b086376d service nova] Acquired lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:18:43.905511 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dca8cd0f-bc98-400d-b3d8-186b77037e57 req-feaf5b1f-9c43-4238-881c-fd66b086376d service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Refreshing network info cache for port 3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:18:43.979652 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8c4e7169-d00c-4ee0-acc2-3209a49edd7e req-2e741bcc-255d-443d-b0dd-cfc89f7b42d1 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Received event network-changed-7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:43.980252 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8c4e7169-d00c-4ee0-acc2-3209a49edd7e req-2e741bcc-255d-443d-b0dd-cfc89f7b42d1 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Refreshing instance network info cache due to event network-changed-7502bf84-2f97-4d1c-aff9-852200aac695. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:18:43.980252 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8c4e7169-d00c-4ee0-acc2-3209a49edd7e req-2e741bcc-255d-443d-b0dd-cfc89f7b42d1 service nova] Acquiring lock "refresh_cache-38d82a63-9b1e-460d-b781-48d0d07ed207" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:18:44.101470 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:18:44.108585 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f5328c61-cc21-4b61-8056-3de1e84af885 tempest-TestVolumeBootPatternV346-405934088 tempest-TestVolumeBootPatternV346-405934088-project-member] Lock "fa66e95f-2701-4fde-92d4-668f096aa9cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.996s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:44.235807 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:44.265665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f390b128-432a-4330-9859-7ef084a7a53d req-c122778b-1130-4457-b6b8-19ff0f484ce7 service nova] Releasing lock "refresh_cache-31752c04-799d-4f35-ac81-a56af64fb42c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:18:44.350909 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Updating instance_info_cache with network_info: [{"id": "7502bf84-2f97-4d1c-aff9-852200aac695", "address": "fa:16:3e:37:34:11", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7502bf84-2f", "ovs_interfaceid": "7502bf84-2f97-4d1c-aff9-852200aac695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:44.377678 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:44.407252 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-dca8cd0f-bc98-400d-b3d8-186b77037e57 req-feaf5b1f-9c43-4238-881c-fd66b086376d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:44.622232 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:18:44.624474 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:18:44.633817 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:18:44.633817 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:18:44.639720 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:18:44.639720 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:44.646467 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:44.653359 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:44.659698 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.659698 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.659698 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:44.659886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.659886 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.659886 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:44.670120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.670120 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.670120 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:44.670368 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.670368 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.670368 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:44.687298 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-dca8cd0f-bc98-400d-b3d8-186b77037e57 req-feaf5b1f-9c43-4238-881c-fd66b086376d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:44.695362 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4, portal: 192.168.40.100,3260]
May 27 23:18:44.695362 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4, portal: 192.168.40.100,3260] successful.
May 27 23:18:44.695362 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:44.707598 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:44.715730 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4, portal: 192.168.50.100,3260]
May 27 23:18:44.715730 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4, portal: 192.168.50.100,3260] successful.
May 27 23:18:44.715730 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:44.722692 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.722692 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.722692 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:44.722692 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:44.722692 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:44.722946 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.722946 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.722946 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:44.722946 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:44.722946 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:44.723212 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:44.723311 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:18:44.724197 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] HCTL ('9', '-', '-', 0) found on session 191 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:18:44.724368 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:18:44.730323 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:44.744646 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching for a device in session 191 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:18:44.744646 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:18:44.750488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.750488 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.750488 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:44.750488 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:44.750488 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:44.750653 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.750653 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:44.750653 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:44.750653 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:44.750653 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:44.750833 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:44.750957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:18:44.751485 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] HCTL ('10', '-', '-', 0) found on session 192 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:18:44.751600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:18:44.765992 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Searching for a device in session 192 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:18:44.766256 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:18:44.826577 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dca8cd0f-bc98-400d-b3d8-186b77037e57 req-feaf5b1f-9c43-4238-881c-fd66b086376d service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updated VIF entry in instance network info cache for port 3a8534ea-2385-42d1-b07b-b88cde28f054. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:18:44.827190 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-dca8cd0f-bc98-400d-b3d8-186b77037e57 req-feaf5b1f-9c43-4238-881c-fd66b086376d service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updating instance_info_cache with network_info: [{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:44.852754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Releasing lock "refresh_cache-38d82a63-9b1e-460d-b781-48d0d07ed207" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:18:44.853097 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Instance network_info: |[{"id": "7502bf84-2f97-4d1c-aff9-852200aac695", "address": "fa:16:3e:37:34:11", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7502bf84-2f", "ovs_interfaceid": "7502bf84-2f97-4d1c-aff9-852200aac695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:18:44.853636 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8c4e7169-d00c-4ee0-acc2-3209a49edd7e req-2e741bcc-255d-443d-b0dd-cfc89f7b42d1 service nova] Acquired lock "refresh_cache-38d82a63-9b1e-460d-b781-48d0d07ed207" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:18:44.853954 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8c4e7169-d00c-4ee0-acc2-3209a49edd7e req-2e741bcc-255d-443d-b0dd-cfc89f7b42d1 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Refreshing network info cache for port 7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:18:45.329170 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dca8cd0f-bc98-400d-b3d8-186b77037e57 req-feaf5b1f-9c43-4238-881c-fd66b086376d service nova] Releasing lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:18:45.358310 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8c4e7169-d00c-4ee0-acc2-3209a49edd7e req-2e741bcc-255d-443d-b0dd-cfc89f7b42d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:45.587074 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:18:45.605700 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-8c4e7169-d00c-4ee0-acc2-3209a49edd7e req-2e741bcc-255d-443d-b0dd-cfc89f7b42d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:45.727948 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8c4e7169-d00c-4ee0-acc2-3209a49edd7e req-2e741bcc-255d-443d-b0dd-cfc89f7b42d1 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Updated VIF entry in instance network info cache for port 7502bf84-2f97-4d1c-aff9-852200aac695. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:18:45.728163 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-8c4e7169-d00c-4ee0-acc2-3209a49edd7e req-2e741bcc-255d-443d-b0dd-cfc89f7b42d1 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Updating instance_info_cache with network_info: [{"id": "7502bf84-2f97-4d1c-aff9-852200aac695", "address": "fa:16:3e:37:34:11", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7502bf84-2f", "ovs_interfaceid": "7502bf84-2f97-4d1c-aff9-852200aac695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:46.229990 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8c4e7169-d00c-4ee0-acc2-3209a49edd7e req-2e741bcc-255d-443d-b0dd-cfc89f7b42d1 service nova] Releasing lock "refresh_cache-38d82a63-9b1e-460d-b781-48d0d07ed207" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:18:46.603182 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Found WWN 3300000006984545c for multipath device dm-1 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:18:46.603664 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:46.604626 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000006984545c', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000006984545c'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:46.604792 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006984545c', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000006984545c'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:18:46.633007 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '31752c04-799d-4f35-ac81-a56af64fb42c', 'attached_at': '', 'detached_at': '', 'volume_id': '77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'serial': '77d32c8c-b044-4dbf-a084-3adf2f3165a4'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:18:46.633548 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:18:46.633814 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:18:46.633968 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:18:46.648687 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 23:18:46.648687 np0000001565 nova-compute[98289]:   <usage type="volume">
May 27 23:18:46.648687 np0000001565 nova-compute[98289]:     <volume>77d32c8c-b044-4dbf-a084-3adf2f3165a4</volume>
May 27 23:18:46.648687 np0000001565 nova-compute[98289]:   </usage>
May 27 23:18:46.648687 np0000001565 nova-compute[98289]: </secret>
May 27 23:18:46.648687 np0000001565 nova-compute[98289]:  {{(pid=98289) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 23:18:47.014687 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:47.028083 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:18:47.050266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:47.102212 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:18:47.102565 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:18:47.111536 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:18:47.112491 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:feec:cb1f', 'fe80::bc5c:41ff:fe41:ca69'] 
May 27 23:18:47.112640 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:18:47.112718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:18:47.112993 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:47.113248 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Updating existing volume attachment record: 36f8b3f0-b8ac-41b5-81d1-c7148a5beb52 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:18:47.157518 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1087899189',display_name='tempest-TestEncryptedCinderVolumes-server-1087899189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1087899189',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwpLIDJzmmj8DOOIr1KJSEMd+lIpXx0aX3N2m8iUzldrJ/GuIUPYvReVhfmMiDVx83K1VHGQco6OTrLiBD8PtdDgFRaFsX4ihfkPtv7oJvf/xEiMdyvlvg2/fN1X+W+HA==',key_name='tempest-TestEncryptedCinderVolumes-418939601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d4267649c9432993626e440932bf08',ramdisk_id='',reservation_id='r-0bo0jw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-274929604',owner_user_name='tempest-TestEncryptedCinderVolumes-274929604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:18:41Z,user_data=None,user_id='6418d61428124c1c98659435dd6b8bff',uuid=31752c04-799d-4f35-ac81-a56af64fb42c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:18:47.157785 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converting VIF {"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:47.158452 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=5273a52e-e20f-4f70-8f86-cf9d6f6e9b26,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5273a52e-e2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:47.159784 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lazy-loading 'pci_devices' on Instance uuid 31752c04-799d-4f35-ac81-a56af64fb42c {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:47.664051 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] End _get_guest_xml xml=<domain type="qemu">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <uuid>31752c04-799d-4f35-ac81-a56af64fb42c</uuid>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <name>instance-00000047</name>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1087899189</nova:name>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:18:43</nova:creationTime>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:user uuid="6418d61428124c1c98659435dd6b8bff">tempest-TestEncryptedCinderVolumes-274929604-project-member</nova:user>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:project uuid="e2d4267649c9432993626e440932bf08">tempest-TestEncryptedCinderVolumes-274929604</nova:project>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <nova:port uuid="5273a52e-e20f-4f70-8f86-cf9d6f6e9b26">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <system>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <entry name="serial">31752c04-799d-4f35-ac81-a56af64fb42c</entry>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <entry name="uuid">31752c04-799d-4f35-ac81-a56af64fb42c</entry>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     </system>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <os>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   </os>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <features>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   </features>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   <devices>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/31752c04-799d-4f35-ac81-a56af64fb42c/disk.config"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     </disk>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <alias name="ua-77d32c8c-b044-4dbf-a084-3adf2f3165a4"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <serial>77d32c8c-b044-4dbf-a084-3adf2f3165a4</serial>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <encryption format="luks">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:         <secret type="passphrase" uuid="f1ab830c-9874-4cef-9744-d49308321d21"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       </encryption>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     </disk>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:66:22:0a"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <target dev="tap5273a52e-e2"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     </interface>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/31752c04-799d-4f35-ac81-a56af64fb42c/console.log" append="off"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     </serial>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <video>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     </video>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     </rng>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:   </devices>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]: </domain>
May 27 23:18:47.664051 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:18:47.666564 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Preparing to wait for external event network-vif-plugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:18:47.666564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:47.666564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:47.666564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:47.669966 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1087899189',display_name='tempest-TestEncryptedCinderVolumes-server-1087899189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1087899189',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwpLIDJzmmj8DOOIr1KJSEMd+lIpXx0aX3N2m8iUzldrJ/GuIUPYvReVhfmMiDVx83K1VHGQco6OTrLiBD8PtdDgFRaFsX4ihfkPtv7oJvf/xEiMdyvlvg2/fN1X+W+HA==',key_name='tempest-TestEncryptedCinderVolumes-418939601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2d4267649c9432993626e440932bf08',ramdisk_id='',reservation_id='r-0bo0jw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-274929604',owner_user_name='tempest-TestEncryptedCinderVolumes-274929604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:18:41Z,user_data=None,user_id='6418d61428124c1c98659435dd6b8bff',uuid=31752c04-799d-4f35-ac81-a56af64fb42c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:18:47.670256 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converting VIF {"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:47.670862 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=5273a52e-e20f-4f70-8f86-cf9d6f6e9b26,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5273a52e-e2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:47.671256 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=5273a52e-e20f-4f70-8f86-cf9d6f6e9b26,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5273a52e-e2') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:18:47.672587 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:47.674321 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:47.674823 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:18:47.675778 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:47.675961 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab3dc684-317b-584c-883d-a92743c3fb2e', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:47.677891 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:47.678166 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:47.679551 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:47.679758 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5273a52e-e2, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:47.680018 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5273a52e-e2, col_values=(('qos', UUID('39b9c758-a143-4e81-81e2-a1bfd82a986b')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:47.680177 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5273a52e-e2, col_values=(('external_ids', {'iface-id': '5273a52e-e20f-4f70-8f86-cf9d6f6e9b26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:22:0a', 'vm-uuid': '31752c04-799d-4f35-ac81-a56af64fb42c'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:47.682531 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:47.687013 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:47.687255 np0000001565 nova-compute[98289]: INFO os_vif [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=5273a52e-e20f-4f70-8f86-cf9d6f6e9b26,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5273a52e-e2')
May 27 23:18:48.080759 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:49.207992 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:18:49.208422 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:18:49.208422 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] No VIF found with MAC fa:16:3e:66:22:0a, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:18:49.208919 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Using config drive
May 27 23:18:49.220043 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:18:49.221563 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:18:49.221840 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Creating image(s)
May 27 23:18:49.222363 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:18:49.222363 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Ensure instance console log exists: /opt/stack/data/nova/instances/38d82a63-9b1e-460d-b781-48d0d07ed207/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:18:49.222595 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:49.223141 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:49.223141 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:49.223441 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Start _get_guest_xml network_info=[{"id": "7502bf84-2f97-4d1c-aff9-852200aac695", "address": "fa:16:3e:37:34:11", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7502bf84-2f", "ovs_interfaceid": "7502bf84-2f97-4d1c-aff9-852200aac695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '36f8b3f0-b8ac-41b5-81d1-c7148a5beb52', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '38d82a63-9b1e-460d-b781-48d0d07ed207', 'attached_at': '', 'detached_at': '', 'volume_id': '0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'serial': '0b4f9d23-2ff4-47bf-b0cb-52572c89107a'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:18:49.226197 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:18:49.227504 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1149607762', uuid='38d82a63-9b1e-460d-b781-48d0d07ed207'), owner=OwnerMeta(userid='31823a44e786429f80ba607958f8b63e', username='tempest-TestVolumeBootPattern-314561297-project-member', projectid='5dda425dab8946dc926808806eeedced', projectname='tempest-TestVolumeBootPattern-314561297'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7502bf84-2f97-4d1c-aff9-852200aac695", "address": "fa:16:3e:37:34:11", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7502bf84-2f", "ovs_interfaceid": "7502bf84-2f97-4d1c-aff9-852200aac695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923929.2270787) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:18:49.228678 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:18:49.228967 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:18:49.229705 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:18:49.229879 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:18:49.230880 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:18:49.231149 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:18:49.231305 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:18:49.231448 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:18:49.231584 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:18:49.231697 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:18:49.231809 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:18:49.231977 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:18:49.232092 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:18:49.232221 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:18:49.232369 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:18:49.232505 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:18:49.243047 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:18:49.243346 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:18:49.243553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:49.243915 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:49.244075 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:18:49.255287 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:49.255983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:18:49.256627 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:49.257061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:18:49.257323 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:18:49.257819 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:18:49.268933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:18:49.268933 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:49.269488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:18:49.269488 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:49.283055 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a] added
May 27 23:18:49.283055 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:18:49.283055 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:49.283055 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:49.283055 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:49.283055 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:49.283055 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:49.283220 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:18:49.283478 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:18:49.283788 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:18:49.286164 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a] added
May 27 23:18:49.286164 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:18:49.286164 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:49.286164 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:49.286164 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:18:49.286164 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:18:49.286164 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:49.286508 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:18:49.286508 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:18:49.286508 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:18:49.389325 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:49.716581 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:49.788693 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:49.850301 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Creating config drive at /opt/stack/data/nova/instances/31752c04-799d-4f35-ac81-a56af64fb42c/disk.config
May 27 23:18:49.854349 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/31752c04-799d-4f35-ac81-a56af64fb42c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprx9qdac2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:49.911508 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/31752c04-799d-4f35-ac81-a56af64fb42c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprx9qdac2" returned: 0 in 0.057s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:50.284285 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:18:50.287059 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:18:50.298259 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:18:50.298259 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:18:50.304550 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:18:50.304550 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:50.314733 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:50.315839 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:50.322835 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:50.341748 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.341748 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.341748 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.341748 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.341748 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:50.342056 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.342056 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.342056 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.342056 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.342056 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:50.348115 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:50.349064 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:50.351864 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.351864 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.351864 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.351864 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.351864 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:50.352080 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.352080 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.352080 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.352080 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.352080 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:50.385045 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a, portal: 192.168.50.100,3260]
May 27 23:18:50.385045 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a, portal: 192.168.50.100,3260] successful.
May 27 23:18:50.385045 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:50.398435 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:50.408369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a, portal: 192.168.40.100,3260]
May 27 23:18:50.408369 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a, portal: 192.168.40.100,3260] successful.
May 27 23:18:50.408369 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:50.418937 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.418937 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.418937 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.418937 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.418937 np0000001565 nova-compute[98289]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:18:50.418937 np0000001565 nova-compute[98289]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:18:50.418937 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:50.419153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.419153 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.419153 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.419153 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.419153 np0000001565 nova-compute[98289]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:18:50.419153 np0000001565 nova-compute[98289]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:18:50.419153 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:50.419444 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:50.419822 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:18:50.420382 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('11', '-', '-', 0) found on session 193 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:18:50.420494 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:18:50.426426 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:18:50.434386 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:50.501584 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.501584 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.501584 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.501584 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.501584 np0000001565 nova-compute[98289]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:18:50.501584 np0000001565 nova-compute[98289]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:18:50.501584 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:18:50.502568 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.502568 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:18:50.502568 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.502568 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:18:50.502568 np0000001565 nova-compute[98289]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:18:50.502568 np0000001565 nova-compute[98289]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:18:50.502568 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:18:50.502955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.246s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:50.503209 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:18:50.514087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('12', '-', '-', 0) found on session 194 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:18:50.514249 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:18:50.523167 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 193 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:18:50.523326 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:18:50.535242 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 194 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:18:50.535463 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:18:50.567671 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e1a4126e-8c80-4c18-ab50-f80e18259e15 req-e9e4b40e-4bdc-45be-b51d-5d0bbca88b06 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Received event network-vif-plugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:50.568048 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e1a4126e-8c80-4c18-ab50-f80e18259e15 req-e9e4b40e-4bdc-45be-b51d-5d0bbca88b06 service nova] Acquiring lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:50.568401 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e1a4126e-8c80-4c18-ab50-f80e18259e15 req-e9e4b40e-4bdc-45be-b51d-5d0bbca88b06 service nova] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:50.568491 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e1a4126e-8c80-4c18-ab50-f80e18259e15 req-e9e4b40e-4bdc-45be-b51d-5d0bbca88b06 service nova] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:50.568763 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e1a4126e-8c80-4c18-ab50-f80e18259e15 req-e9e4b40e-4bdc-45be-b51d-5d0bbca88b06 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Processing event network-vif-plugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:18:50.751251 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:50.756140 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:50.764276 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:50.782152 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:51.257923 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:18:52.128640 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:18:52.143821 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923932.143302, 31752c04-799d-4f35-ac81-a56af64fb42c => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:52.144059 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] VM Started (Lifecycle Event)
May 27 23:18:52.145480 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:18:52.148563 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:18:52.151608 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Instance spawned successfully.
May 27 23:18:52.151867 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:18:52.283172 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Found WWN 3300000001cb4d841 for multipath device dm-2 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:18:52.283570 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:18:52.283772 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000001cb4d841', 'path': '/dev/dm-2', 'multipath_id': '3300000001cb4d841'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:18:52.283951 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001cb4d841', 'path': '/dev/dm-2', 'multipath_id': '3300000001cb4d841'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:18:52.626878 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-30c12de0-0aa8-4497-a6d8-817a6ba5b925 req-e048e8b4-753e-427c-8afa-8fb257033625 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Received event network-vif-plugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:52.627346 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-30c12de0-0aa8-4497-a6d8-817a6ba5b925 req-e048e8b4-753e-427c-8afa-8fb257033625 service nova] Acquiring lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:52.627602 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-30c12de0-0aa8-4497-a6d8-817a6ba5b925 req-e048e8b4-753e-427c-8afa-8fb257033625 service nova] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:52.627750 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-30c12de0-0aa8-4497-a6d8-817a6ba5b925 req-e048e8b4-753e-427c-8afa-8fb257033625 service nova] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:52.627906 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-30c12de0-0aa8-4497-a6d8-817a6ba5b925 req-e048e8b4-753e-427c-8afa-8fb257033625 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] No waiting events found dispatching network-vif-plugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:52.630885 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-30c12de0-0aa8-4497-a6d8-817a6ba5b925 req-e048e8b4-753e-427c-8afa-8fb257033625 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Received unexpected event network-vif-plugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 for instance with vm_state building and task_state spawning.
May 27 23:18:52.634846 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:52.635428 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:52.635649 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:52.635794 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:18:52.646455 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:52.648444 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:18:52.658439 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:52.658643 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:52.658891 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:52.659133 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:52.659431 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:52.659728 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:52.682845 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:52.791119 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1149607762',display_name='tempest-TestVolumeBootPattern-server-1149607762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1149607762',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-hv72bnae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:18:43Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=38d82a63-9b1e-460d-b781-48d0d07ed207,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7502bf84-2f97-4d1c-aff9-852200aac695", "address": "fa:16:3e:37:34:11", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7502bf84-2f", "ovs_interfaceid": "7502bf84-2f97-4d1c-aff9-852200aac695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:18:52.791531 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "7502bf84-2f97-4d1c-aff9-852200aac695", "address": "fa:16:3e:37:34:11", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7502bf84-2f", "ovs_interfaceid": "7502bf84-2f97-4d1c-aff9-852200aac695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:52.792533 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:34:11,bridge_name='br-int',has_traffic_filtering=True,id=7502bf84-2f97-4d1c-aff9-852200aac695,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7502bf84-2f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:52.793227 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'pci_devices' on Instance uuid 38d82a63-9b1e-460d-b781-48d0d07ed207 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:18:52.955764 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00046752799971727654 future=<Future at 0x726e58376570 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:52.956271 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] Emitting event <LifecycleEvent: 1779923917.9551704, fa66e95f-2701-4fde-92d4-668f096aa9cd => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:52.956435 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:18:52.956615 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] VM Stopped (Lifecycle Event)
May 27 23:18:53.151642 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:18:53.151642 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923933.150619, 31752c04-799d-4f35-ac81-a56af64fb42c => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:53.151642 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] VM Paused (Lifecycle Event)
May 27 23:18:53.165296 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Took 9.63 seconds to spawn the instance on the hypervisor.
May 27 23:18:53.165609 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:53.296130 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] End _get_guest_xml xml=<domain type="qemu">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <uuid>38d82a63-9b1e-460d-b781-48d0d07ed207</uuid>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <name>instance-00000048</name>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPattern-server-1149607762</nova:name>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:18:49</nova:creationTime>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:user uuid="31823a44e786429f80ba607958f8b63e">tempest-TestVolumeBootPattern-314561297-project-member</nova:user>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:project uuid="5dda425dab8946dc926808806eeedced">tempest-TestVolumeBootPattern-314561297</nova:project>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         <nova:port uuid="7502bf84-2f97-4d1c-aff9-852200aac695">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <system>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <entry name="serial">38d82a63-9b1e-460d-b781-48d0d07ed207</entry>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <entry name="uuid">38d82a63-9b1e-460d-b781-48d0d07ed207</entry>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     </system>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <os>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   </os>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <features>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   </features>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   <devices>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/38d82a63-9b1e-460d-b781-48d0d07ed207/disk.config"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     </disk>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <alias name="ua-0b4f9d23-2ff4-47bf-b0cb-52572c89107a"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-2"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <serial>0b4f9d23-2ff4-47bf-b0cb-52572c89107a</serial>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     </disk>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:37:34:11"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <target dev="tap7502bf84-2f"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     </interface>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/38d82a63-9b1e-460d-b781-48d0d07ed207/console.log" append="off"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     </serial>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <video>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     </video>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     </rng>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:   </devices>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]: </domain>
May 27 23:18:53.296130 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:18:53.300496 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Preparing to wait for external event network-vif-plugged-7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:18:53.300496 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:53.300496 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:53.300496 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:53.300496 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1149607762',display_name='tempest-TestVolumeBootPattern-server-1149607762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1149607762',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-hv72bnae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:18:43Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=38d82a63-9b1e-460d-b781-48d0d07ed207,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7502bf84-2f97-4d1c-aff9-852200aac695", "address": "fa:16:3e:37:34:11", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7502bf84-2f", "ovs_interfaceid": "7502bf84-2f97-4d1c-aff9-852200aac695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:18:53.300496 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "7502bf84-2f97-4d1c-aff9-852200aac695", "address": "fa:16:3e:37:34:11", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7502bf84-2f", "ovs_interfaceid": "7502bf84-2f97-4d1c-aff9-852200aac695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:18:53.300496 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:34:11,bridge_name='br-int',has_traffic_filtering=True,id=7502bf84-2f97-4d1c-aff9-852200aac695,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7502bf84-2f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:18:53.300496 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:34:11,bridge_name='br-int',has_traffic_filtering=True,id=7502bf84-2f97-4d1c-aff9-852200aac695,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7502bf84-2f') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:18:53.300496 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:53.300496 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:53.300496 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:18:53.301213 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:53.301213 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f19a7283-f9b8-556c-b635-c0b0694235aa', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:53.301835 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:53.302566 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:53.302779 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:53.304557 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:53.304735 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7502bf84-2f, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:53.305060 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7502bf84-2f, col_values=(('qos', UUID('de847ada-dad0-4400-a21e-ba8103661ba6')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:53.305285 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7502bf84-2f, col_values=(('external_ids', {'iface-id': '7502bf84-2f97-4d1c-aff9-852200aac695', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:34:11', 'vm-uuid': '38d82a63-9b1e-460d-b781-48d0d07ed207'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:18:53.306051 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:53.307145 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:18:53.312438 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:53.312646 np0000001565 nova-compute[98289]: INFO os_vif [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:34:11,bridge_name='br-int',has_traffic_filtering=True,id=7502bf84-2f97-4d1c-aff9-852200aac695,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7502bf84-2f')
May 27 23:18:53.459133 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-a4709264-5457-405b-8f79-2855459b017c tempest-VolumesBackupsTest-188258886 tempest-VolumesBackupsTest-188258886-project-member] [instance: fa66e95f-2701-4fde-92d4-668f096aa9cd] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:53.654623 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:53.657502 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:53.658432 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923933.6580389, 31752c04-799d-4f35-ac81-a56af64fb42c => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:53.670417 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] VM Resumed (Lifecycle Event)
May 27 23:18:53.681810 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Took 16.65 seconds to build instance.
May 27 23:18:53.748305 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:53.748909 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:53.844548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:53.844935 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:18:53.848803 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:18:53.850619 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:18:53.851914 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:53.899137 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:53.899715 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13427MB free_disk=72.69160461425781GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:18:53.900266 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:53.900665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:54.181723 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:54.185687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "31752c04-799d-4f35-ac81-a56af64fb42c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.159s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:54.185687 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:18:54.389748 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:54.833521 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:18:54.833676 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:18:54.833794 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No VIF found with MAC fa:16:3e:37:34:11, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:18:54.834349 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Using config drive
May 27 23:18:54.961151 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 18a78f17-3543-48db-bb55-ec15bdf2b27a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:18:54.961256 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 31752c04-799d-4f35-ac81-a56af64fb42c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:18:54.961322 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 38d82a63-9b1e-460d-b781-48d0d07ed207 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:18:54.961505 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:18:54.961628 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:18:53 up 47 min,  2 users,  load average: 3.29, 4.05, 4.04\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_30f40c2f26134e52b9d0ba5a2d3deb91': '1', 'io_workload': '1', 'num_proj_e2d4267649c9432993626e440932bf08': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_5dda425dab8946dc926808806eeedced': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:18:55.173064 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:18:55.173279 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:18:55.340133 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:55.459957 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Creating config drive at /opt/stack/data/nova/instances/38d82a63-9b1e-460d-b781-48d0d07ed207/disk.config
May 27 23:18:55.465765 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/38d82a63-9b1e-460d-b781-48d0d07ed207/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt_3zymda {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:18:55.538742 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/38d82a63-9b1e-460d-b781-48d0d07ed207/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt_3zymda" returned: 0 in 0.073s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:18:55.676539 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:18:55.715142 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7ffbe5fb-d6eb-4a77-81d1-f1e6e337337c req-89e57a24-50be-406a-823b-235ecf5a162f service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Received event network-changed-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:55.715523 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7ffbe5fb-d6eb-4a77-81d1-f1e6e337337c req-89e57a24-50be-406a-823b-235ecf5a162f service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Refreshing instance network info cache due to event network-changed-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:18:55.715751 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7ffbe5fb-d6eb-4a77-81d1-f1e6e337337c req-89e57a24-50be-406a-823b-235ecf5a162f service nova] Acquiring lock "refresh_cache-31752c04-799d-4f35-ac81-a56af64fb42c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:18:55.715842 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7ffbe5fb-d6eb-4a77-81d1-f1e6e337337c req-89e57a24-50be-406a-823b-235ecf5a162f service nova] Acquired lock "refresh_cache-31752c04-799d-4f35-ac81-a56af64fb42c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:18:55.716028 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7ffbe5fb-d6eb-4a77-81d1-f1e6e337337c req-89e57a24-50be-406a-823b-235ecf5a162f service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Refreshing network info cache for port 5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:18:56.008509 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:56.028505 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:56.110614 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:56.184395 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:18:56.184578 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.284s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:56.185323 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 8.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:18:56.191431 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-518001fb-c9fc-4ed1-b3fe-f70ef1237a4b req-37a86ba0-ac44-49ca-9705-b05da54db8c4 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Received event network-vif-plugged-7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:56.191644 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-518001fb-c9fc-4ed1-b3fe-f70ef1237a4b req-37a86ba0-ac44-49ca-9705-b05da54db8c4 service nova] Acquiring lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:56.191790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-518001fb-c9fc-4ed1-b3fe-f70ef1237a4b req-37a86ba0-ac44-49ca-9705-b05da54db8c4 service nova] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:56.191910 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-518001fb-c9fc-4ed1-b3fe-f70ef1237a4b req-37a86ba0-ac44-49ca-9705-b05da54db8c4 service nova] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:56.192014 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-518001fb-c9fc-4ed1-b3fe-f70ef1237a4b req-37a86ba0-ac44-49ca-9705-b05da54db8c4 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Processing event network-vif-plugged-7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:18:56.218261 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7ffbe5fb-d6eb-4a77-81d1-f1e6e337337c req-89e57a24-50be-406a-823b-235ecf5a162f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:56.382618 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:56.384632 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:56.386629 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:56.404661 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:56.407546 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:56.572120 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-7ffbe5fb-d6eb-4a77-81d1-f1e6e337337c req-89e57a24-50be-406a-823b-235ecf5a162f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:18:56.697216 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7ffbe5fb-d6eb-4a77-81d1-f1e6e337337c req-89e57a24-50be-406a-823b-235ecf5a162f service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Updated VIF entry in instance network info cache for port 5273a52e-e20f-4f70-8f86-cf9d6f6e9b26. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:18:56.697519 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-7ffbe5fb-d6eb-4a77-81d1-f1e6e337337c req-89e57a24-50be-406a-823b-235ecf5a162f service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Updating instance_info_cache with network_info: [{"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:18:56.763046 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923936.7622082, 38d82a63-9b1e-460d-b781-48d0d07ed207 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:56.763428 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:18:56.763561 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] VM Started (Lifecycle Event)
May 27 23:18:56.766784 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:18:56.768203 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Instance spawned successfully.
May 27 23:18:56.768203 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:18:57.199575 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7ffbe5fb-d6eb-4a77-81d1-f1e6e337337c req-89e57a24-50be-406a-823b-235ecf5a162f service nova] Releasing lock "refresh_cache-31752c04-799d-4f35-ac81-a56af64fb42c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:18:57.265886 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:57.267922 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:18:57.275411 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:57.275411 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:57.275411 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:57.275411 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:57.275736 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:57.275957 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:18:57.770213 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:18:57.770589 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923937.7703474, 38d82a63-9b1e-460d-b781-48d0d07ed207 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:57.770722 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] VM Paused (Lifecycle Event)
May 27 23:18:57.781507 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Took 8.56 seconds to spawn the instance on the hypervisor.
May 27 23:18:57.781687 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:58.250592 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8fa5a2a4-49a3-4c3b-9328-c5770238787f req-23e86258-9131-43ca-84ae-814cef7de54a service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Received event network-vif-plugged-7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:18:58.250989 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8fa5a2a4-49a3-4c3b-9328-c5770238787f req-23e86258-9131-43ca-84ae-814cef7de54a service nova] Acquiring lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:58.251399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8fa5a2a4-49a3-4c3b-9328-c5770238787f req-23e86258-9131-43ca-84ae-814cef7de54a service nova] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:58.251399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8fa5a2a4-49a3-4c3b-9328-c5770238787f req-23e86258-9131-43ca-84ae-814cef7de54a service nova] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:58.251530 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8fa5a2a4-49a3-4c3b-9328-c5770238787f req-23e86258-9131-43ca-84ae-814cef7de54a service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] No waiting events found dispatching network-vif-plugged-7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:18:58.251663 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-8fa5a2a4-49a3-4c3b-9328-c5770238787f req-23e86258-9131-43ca-84ae-814cef7de54a service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Received unexpected event network-vif-plugged-7502bf84-2f97-4d1c-aff9-852200aac695 for instance with vm_state active and task_state None.
May 27 23:18:58.273134 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:58.275429 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923938.2748568, 38d82a63-9b1e-460d-b781-48d0d07ed207 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:18:58.275429 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] VM Resumed (Lifecycle Event)
May 27 23:18:58.294417 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Took 20.84 seconds to build instance.
May 27 23:18:58.307849 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:58.778439 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:18:58.784785 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:18:58.795935 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7356d8a6-2a7a-49ba-a243-2c3a1a46618e tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.347s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:59.353785 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "38d82a63-9b1e-460d-b781-48d0d07ed207" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:59.353999 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:59.354186 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:18:59.354338 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:18:59.354463 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:18:59.356225 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Terminating instance
May 27 23:18:59.391431 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:59.859112 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:18:59.875196 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:59.878148 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:59.897129 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:59.899289 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:18:59.920111 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:00.080722 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:00.188455 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999650514000223 future=<Future at 0x726e387c7170 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:00.188844 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999235990000216 future=<Future at 0x726e387c7170 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:00.189045 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999025316999905 future=<Future at 0x726e387c7170 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:00.190347 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Instance destroyed successfully.
May 27 23:19:00.190683 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'resources' on Instance uuid 38d82a63-9b1e-460d-b781-48d0d07ed207 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:19:00.304361 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Received event network-vif-unplugged-7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:00.304361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] Acquiring lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:00.304361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:00.304361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:00.304361 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] No waiting events found dispatching network-vif-unplugged-7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:19:00.304361 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Received event network-vif-unplugged-7502bf84-2f97-4d1c-aff9-852200aac695 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:19:00.304361 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Received event network-vif-unplugged-7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:00.304361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] Acquiring lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:00.304361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:00.307664 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:00.308092 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] No waiting events found dispatching network-vif-unplugged-7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:19:00.308289 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d10db2aa-9255-4f71-9950-eaef6e94375d req-c2e86292-b787-4f84-ab60-0ebd53ee49c4 service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Received event network-vif-unplugged-7502bf84-2f97-4d1c-aff9-852200aac695 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:19:00.692934 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1149607762',display_name='tempest-TestVolumeBootPattern-server-1149607762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-1149607762',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:18:57Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-hv72bnae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:18:58Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=38d82a63-9b1e-460d-b781-48d0d07ed207,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7502bf84-2f97-4d1c-aff9-852200aac695", "address": "fa:16:3e:37:34:11", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7502bf84-2f", "ovs_interfaceid": "7502bf84-2f97-4d1c-aff9-852200aac695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:19:00.693187 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "7502bf84-2f97-4d1c-aff9-852200aac695", "address": "fa:16:3e:37:34:11", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7502bf84-2f", "ovs_interfaceid": "7502bf84-2f97-4d1c-aff9-852200aac695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:19:00.693877 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:34:11,bridge_name='br-int',has_traffic_filtering=True,id=7502bf84-2f97-4d1c-aff9-852200aac695,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7502bf84-2f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:19:00.694141 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:34:11,bridge_name='br-int',has_traffic_filtering=True,id=7502bf84-2f97-4d1c-aff9-852200aac695,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7502bf84-2f') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:19:00.695303 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:00.695541 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7502bf84-2f, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:00.696617 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:00.697301 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:00.697736 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:00.698600 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:00.698798 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de847ada-dad0-4400-a21e-ba8103661ba6) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:00.699296 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:00.699778 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:00.699940 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:00.701712 np0000001565 nova-compute[98289]: INFO os_vif [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:34:11,bridge_name='br-int',has_traffic_filtering=True,id=7502bf84-2f97-4d1c-aff9-852200aac695,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7502bf84-2f')
May 27 23:19:00.703110 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:19:00.703425 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:19:00.703577 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:19:00.703924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:19:00.704217 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:19:00.704370 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:19:00.727953 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:00.727953 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:00.727953 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:00.727953 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:00.727953 np0000001565 nova-compute[98289]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:19:00.727953 np0000001565 nova-compute[98289]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:19:00.727953 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:00.728237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:00.728237 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:00.728237 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:00.728237 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:00.728237 np0000001565 nova-compute[98289]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:19:00.728237 np0000001565 nova-compute[98289]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a (non-flash)
May 27 23:19:00.728237 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:00.728237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '191'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '192'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', '194')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:19:00.728237 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', '194')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:19:00.729025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a', '193')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:19:00.729722 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58179da0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a'): ({'sdf'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:19:00.729900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:19:00.730080 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flush multipath device 3300000001cb4d841 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:19:00.778915 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:19:00.821682 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:19:00.859643 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:19:00.859966 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:19:00.860659 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:19:00.872570 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:19:00.872570 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:19:00.888716 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:00.926770 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a, portal: 192.168.40.100,3260]
May 27 23:19:00.926770 np0000001565 nova-compute[98289]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a, portal: 192.168.40.100,3260] successful.
May 27 23:19:00.926770 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:00.943145 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:00.953476 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:00.980613 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a, portal: 192.168.50.100,3260]
May 27 23:19:00.980613 np0000001565 nova-compute[98289]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-0b4f9d23-2ff4-47bf-b0cb-52572c89107a, portal: 192.168.50.100,3260] successful.
May 27 23:19:00.980613 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:00.997312 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:00.997554 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:19:00.997707 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== disconnect_volume: return (294ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:19:00.997854 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:19:00.998203 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Deleting instance files /opt/stack/data/nova/instances/38d82a63-9b1e-460d-b781-48d0d07ed207_del
May 27 23:19:00.998753 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Deletion of /opt/stack/data/nova/instances/38d82a63-9b1e-460d-b781-48d0d07ed207_del complete
May 27 23:19:01.505353 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Took 1.65 seconds to destroy the instance on the hypervisor.
May 27 23:19:01.506594 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:19:01.506854 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:19:01.506997 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:19:01.507232 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:01.563434 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:01.811717 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-47c7c397-e967-4d89-b4b5-deff6ed52b2a req-cb2cfeef-a510-4839-a5e7-97e8a909cd6b service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Received event network-vif-deleted-7502bf84-2f97-4d1c-aff9-852200aac695 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:01.812052 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-47c7c397-e967-4d89-b4b5-deff6ed52b2a req-cb2cfeef-a510-4839-a5e7-97e8a909cd6b service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Neutron deleted interface 7502bf84-2f97-4d1c-aff9-852200aac695; detaching it from the instance and deleting it from the info cache
May 27 23:19:01.813576 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-47c7c397-e967-4d89-b4b5-deff6ed52b2a req-cb2cfeef-a510-4839-a5e7-97e8a909cd6b service nova] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Detach interface failed, port_id=7502bf84-2f97-4d1c-aff9-852200aac695, reason: Instance 38d82a63-9b1e-460d-b781-48d0d07ed207 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:19:02.260187 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:19:02.762268 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Took 1.26 seconds to deallocate network for instance.
May 27 23:19:03.310033 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Took 0.55 seconds to detach 1 volumes for instance.
May 27 23:19:03.311830 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Deleting volume: 0b4f9d23-2ff4-47bf-b0cb-52572c89107a {{(pid=98289) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 23:19:03.851542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:03.851727 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:04.028120 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:19:04.028337 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:19:04.395669 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:04.530756 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:19:05.037236 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.185s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:05.096151 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deleted allocations for instance 38d82a63-9b1e-460d-b781-48d0d07ed207
May 27 23:19:05.180543 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:19:05.180807 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:19:05.181018 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:19:05.181216 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:19:05.181438 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:19:05.181689 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.94 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:19:05.700191 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:06.108889 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2e5a3e05-139a-491f-b789-238a121c94be tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "38d82a63-9b1e-460d-b781-48d0d07ed207" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.755s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:06.123693 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:19:06.124057 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:19:06.124124 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:19:06.124546 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.11 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:19:06.671537 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:06.671714 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:06.671792 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Rebooting instance
May 27 23:19:07.230511 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:19:07.230881 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquired lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:19:07.230881 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:19:07.734031 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:08.059595 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:08.202846 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updating instance_info_cache with network_info: [{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:19:08.704959 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Releasing lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:19:09.208499 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:19:09.394177 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:10.232395 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:19:10.235764 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:10.237625 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:10.254544 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:10.258050 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:10.279950 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:10.385122 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7c45ee66-c5e1-4aed-807d-6f90ed65bf5d req-dcf54869-d705-44fe-8825-d4a3aa0896a6 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:10.385375 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7c45ee66-c5e1-4aed-807d-6f90ed65bf5d req-dcf54869-d705-44fe-8825-d4a3aa0896a6 service nova] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:10.387252 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7c45ee66-c5e1-4aed-807d-6f90ed65bf5d req-dcf54869-d705-44fe-8825-d4a3aa0896a6 service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:10.387479 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7c45ee66-c5e1-4aed-807d-6f90ed65bf5d req-dcf54869-d705-44fe-8825-d4a3aa0896a6 service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:10.387668 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7c45ee66-c5e1-4aed-807d-6f90ed65bf5d req-dcf54869-d705-44fe-8825-d4a3aa0896a6 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] No waiting events found dispatching network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:19:10.387843 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-7c45ee66-c5e1-4aed-807d-6f90ed65bf5d req-dcf54869-d705-44fe-8825-d4a3aa0896a6 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received unexpected event network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 for instance with vm_state active and task_state reboot_started_hard.
May 27 23:19:10.544777 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99891896500003 future=<Future at 0x726e38749eb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:10.545803 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Instance destroyed successfully.
May 27 23:19:10.546441 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'resources' on Instance uuid 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:19:10.713323 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:10.736397 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Triggering sync for uuid 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 23:19:10.736587 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Triggering sync for uuid 31752c04-799d-4f35-ac81-a56af64fb42c {{(pid=98289) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 23:19:10.737151 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:10.737508 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "31752c04-799d-4f35-ac81-a56af64fb42c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:10.737758 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.39 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:19:10.737921 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "31752c04-799d-4f35-ac81-a56af64fb42c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:11.049517 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1612446662',display_name='tempest-TestMinimumBasicScenario-server-1612446662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testminimumbasicscenario-server-1612446662',id=70,image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAqCphSPb8XRQSNMvn5VDyF92O7glfyqAu1atC0yO/MGEBvwr/90xBlv1JaiMPLKd/mHIvWKYAHmabuV5K/EmJfu+SLGTxRIE3bQp2cOjH03EpIHHagChlrb8gkaDsmLg==',key_name='tempest-TestMinimumBasicScenario-1773724696',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:18:24Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30f40c2f26134e52b9d0ba5a2d3deb91',ramdisk_id='',reservation_id='r-0d61ien3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-365514479',owner_user_name='tempest-TestMinimumBasicScenario-365514479-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:19:09Z,user_data=None,user_id='b20fe60fc49e4fbeb9ea63bf3cf9e3d4',uuid=18a78f17-3543-48db-bb55-ec15bdf2b27a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:19:11.049755 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converting VIF {"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:19:11.050416 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:19:11.050690 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:19:11.051797 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:11.052567 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a8534ea-23, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:11.053506 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:11.054201 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:11.054735 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:11.055452 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:11.055586 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=011de692-3eaa-4ba5-aff4-b0f19f17c02b) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:11.056052 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:11.056532 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:11.056883 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:11.057147 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:11.059687 np0000001565 nova-compute[98289]: INFO os_vif [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23')
May 27 23:19:11.061162 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:19:11.061462 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:19:11.061585 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:19:11.061942 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:19:11.062204 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:19:11.062339 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:19:11.087255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:11.087255 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:11.087255 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:11.087255 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:11.087255 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:11.087508 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:11.087508 np0000001565 nova-compute[98289]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:11.087508 np0000001565 nova-compute[98289]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:11.087508 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:11.087508 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:11.087632 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '191'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '192')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:19:11.087720 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '189')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:19:11.088768 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '190')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:19:11.089454 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3879d620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'): ({'sdc'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:19:11.089644 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:19:11.089905 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Flush multipath device 3300000009f565901 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:19:11.123661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:19:11.182690 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:19:11.235632 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:19:11.236037 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:19:11.236467 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:19:11.242046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "31752c04-799d-4f35-ac81-a56af64fb42c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:11.247262 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:19:11.247393 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:19:11.258553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:11.293393 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.40.100,3260]
May 27 23:19:11.293393 np0000001565 nova-compute[98289]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.40.100,3260] successful.
May 27 23:19:11.293393 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:11.306628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:11.317801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:11.349283 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.50.100,3260]
May 27 23:19:11.349283 np0000001565 nova-compute[98289]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.50.100,3260] successful.
May 27 23:19:11.349283 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:11.361046 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:11.361231 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:19:11.361377 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] <== disconnect_volume: return (299ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:19:11.361487 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:19:11.366155 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Start _get_guest_xml network_info=[{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0d709826-92d6-40a7-96b7-fe7f073414b7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '0d709826-92d6-40a7-96b7-fe7f073414b7'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2112b607-a509-4cf4-ad25-d5bb8fa6acd1', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '18a78f17-3543-48db-bb55-ec15bdf2b27a', 'attached_at': '', 'detached_at': '', 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'serial': '093124a1-c06a-48c8-beae-c1acbdfa06c6'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:19:11.367981 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:19:11.368955 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0d709826-92d6-40a7-96b7-fe7f073414b7', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1612446662', uuid='18a78f17-3543-48db-bb55-ec15bdf2b27a'), owner=OwnerMeta(userid='b20fe60fc49e4fbeb9ea63bf3cf9e3d4', username='tempest-TestMinimumBasicScenario-365514479-project-member', projectid='30f40c2f26134e52b9d0ba5a2d3deb91', projectname='tempest-TestMinimumBasicScenario-365514479'), image=ImageMeta(id='0d709826-92d6-40a7-96b7-fe7f073414b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923951.3686626) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:19:11.370317 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:19:11.370646 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:19:11.371696 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:19:11.371993 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:19:11.372925 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:19:11.373175 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0d709826-92d6-40a7-96b7-fe7f073414b7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:19:11.373307 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:19:11.373436 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:19:11.373628 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:19:11.373735 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:19:11.373919 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:19:11.374101 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:19:11.374210 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:19:11.374368 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:19:11.374506 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:19:11.374628 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:19:11.374766 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'vcpu_model' on Instance uuid 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:19:11.669031 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:11.669474 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:11.876839 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Object Instance<18a78f17-3543-48db-bb55-ec15bdf2b27a> lazy-loaded attributes: resources,vcpu_model {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:19:11.889358 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.config --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:19:11.973097 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.config --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:19:11.973556 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:11.973824 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:11.974388 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:11.974809 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:19:11.975163 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:19:11.975301 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:19:11.975638 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:19:11.975862 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:19:11.987210 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:19:11.987844 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:19:11.988310 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:19:11.988547 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:19:11.989125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:19:11.989387 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:19:11.999729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:19:11.999729 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:12.004447 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:19:12.004447 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:12.011425 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6] added
May 27 23:19:12.011425 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:19:12.011425 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:19:12.011425 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:19:12.011425 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:19:12.011425 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:19:12.011425 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:12.011685 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:19:12.011772 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:19:12.011925 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:19:12.015991 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6] added
May 27 23:19:12.015991 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:19:12.015991 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:19:12.015991 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:19:12.015991 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:19:12.015991 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:19:12.015991 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:12.016200 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:19:12.016427 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:19:12.016604 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:19:12.172098 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:19:12.440426 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-85107027-f4f4-4764-99f9-aba5ff72b7d5 req-a86bd4a5-de3e-4a85-ae39-0955d450b4ad service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:12.440891 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-85107027-f4f4-4764-99f9-aba5ff72b7d5 req-a86bd4a5-de3e-4a85-ae39-0955d450b4ad service nova] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:12.441084 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-85107027-f4f4-4764-99f9-aba5ff72b7d5 req-a86bd4a5-de3e-4a85-ae39-0955d450b4ad service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:12.441250 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-85107027-f4f4-4764-99f9-aba5ff72b7d5 req-a86bd4a5-de3e-4a85-ae39-0955d450b4ad service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:12.441437 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-85107027-f4f4-4764-99f9-aba5ff72b7d5 req-a86bd4a5-de3e-4a85-ae39-0955d450b4ad service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] No waiting events found dispatching network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:19:12.441616 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-85107027-f4f4-4764-99f9-aba5ff72b7d5 req-a86bd4a5-de3e-4a85-ae39-0955d450b4ad service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received unexpected event network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 for instance with vm_state active and task_state reboot_started_hard.
May 27 23:19:12.718446 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:12.718446 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:12.723380 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:19:12.723564 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Claim successful on node np0000001565
May 27 23:19:13.012421 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:19:13.017034 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:19:13.025569 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:19:13.025569 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:19:13.030345 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:19:13.030345 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:13.036687 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:13.042297 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:13.047958 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.047958 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.047958 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:13.048117 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.048117 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.048117 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:13.053627 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.053627 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.053627 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:13.053750 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.053750 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.053750 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:13.079480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.50.100,3260]
May 27 23:19:13.079480 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.50.100,3260] successful.
May 27 23:19:13.079480 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:13.090974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:13.103549 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.40.100,3260]
May 27 23:19:13.103549 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.40.100,3260] successful.
May 27 23:19:13.103549 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:13.104052 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.104052 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.104052 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:13.104052 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:13.104052 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:13.104188 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.104188 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.104188 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:13.104188 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:13.104188 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:13.104581 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.116s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:19:13.104694 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:19:13.105255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] HCTL ('7', '-', '-', 0) found on session 195 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:19:13.105421 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:19:13.113825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:13.119489 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching for a device in session 195 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:19:13.119489 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:19:13.128220 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.128220 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.128220 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:13.128220 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:13.128220 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:13.128412 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.128412 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:13.128412 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:13.128412 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:13.128412 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:13.128586 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:19:13.128708 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:19:13.129235 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] HCTL ('8', '-', '-', 0) found on session 196 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:19:13.129348 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:19:13.141351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching for a device in session 196 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:19:13.141351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:19:13.884719 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:19:13.885071 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:19:13.990211 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:19:14.387551 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:19:14.394954 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:14.893308 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:14.893807 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:19:15.004767 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Found WWN 3300000009f565901 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:19:15.005007 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:19:15.005162 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000009f565901', 'path': '/dev/dm-0', 'multipath_id': '3300000009f565901'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:19:15.005273 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009f565901', 'path': '/dev/dm-0', 'multipath_id': '3300000009f565901'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:19:15.188647 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00044998099974691286 future=<Future at 0x726e387c7170 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:15.189139 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Emitting event <LifecycleEvent: 1779923940.1879807, 38d82a63-9b1e-460d-b781-48d0d07ed207 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:19:15.189269 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:15.189444 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] VM Stopped (Lifecycle Event)
May 27 23:19:15.190327 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.353291806000016 future=<Future at 0x726e38749eb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:15.190412 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=10.353168210999684 future=<Future at 0x726e38749eb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:15.398675 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:19:15.399382 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:19:15.399382 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:15.399578 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:15.460019 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31823a44e786429f80ba607958f8b63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda425dab8946dc926808806eeedced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:19:15.511926 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1612446662',display_name='tempest-TestMinimumBasicScenario-server-1612446662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testminimumbasicscenario-server-1612446662',id=70,image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAqCphSPb8XRQSNMvn5VDyF92O7glfyqAu1atC0yO/MGEBvwr/90xBlv1JaiMPLKd/mHIvWKYAHmabuV5K/EmJfu+SLGTxRIE3bQp2cOjH03EpIHHagChlrb8gkaDsmLg==',key_name='tempest-TestMinimumBasicScenario-1773724696',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:18:24Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30f40c2f26134e52b9d0ba5a2d3deb91',ramdisk_id='',reservation_id='r-0d61ien3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-365514479',owner_user_name='tempest-TestMinimumBasicScenario-365514479-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:19:09Z,user_data=None,user_id='b20fe60fc49e4fbeb9ea63bf3cf9e3d4',uuid=18a78f17-3543-48db-bb55-ec15bdf2b27a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:19:15.512299 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converting VIF {"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:19:15.513182 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:19:15.514433 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'pci_devices' on Instance uuid 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:19:15.691842 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-00281111-7d75-4a38-8ff7-394ee516d13e tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 38d82a63-9b1e-460d-b781-48d0d07ed207] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:19:15.839028 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Successfully created port: 963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:19:15.902326 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:19:16.016214 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Object Instance<18a78f17-3543-48db-bb55-ec15bdf2b27a> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:19:16.017714 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] End _get_guest_xml xml=<domain type="qemu">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <uuid>18a78f17-3543-48db-bb55-ec15bdf2b27a</uuid>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <name>instance-00000046</name>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestMinimumBasicScenario-server-1612446662</nova:name>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:19:11</nova:creationTime>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <nova:image uuid="0d709826-92d6-40a7-96b7-fe7f073414b7">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:user uuid="b20fe60fc49e4fbeb9ea63bf3cf9e3d4">tempest-TestMinimumBasicScenario-365514479-project-member</nova:user>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:project uuid="30f40c2f26134e52b9d0ba5a2d3deb91">tempest-TestMinimumBasicScenario-365514479</nova:project>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="0d709826-92d6-40a7-96b7-fe7f073414b7"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         <nova:port uuid="3a8534ea-2385-42d1-b07b-b88cde28f054">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <system>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <entry name="serial">18a78f17-3543-48db-bb55-ec15bdf2b27a</entry>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <entry name="uuid">18a78f17-3543-48db-bb55-ec15bdf2b27a</entry>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     </system>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <os>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   </os>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <features>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   </features>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   <devices>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     </disk>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk.config"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     </disk>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <alias name="ua-093124a1-c06a-48c8-beae-c1acbdfa06c6"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <serial>093124a1-c06a-48c8-beae-c1acbdfa06c6</serial>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     </disk>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:ec:cb:1f"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <target dev="tap3a8534ea-23"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     </interface>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/console.log" append="off"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     </serial>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <video>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     </video>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     </rng>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:   </devices>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]: </domain>
May 27 23:19:16.017714 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:19:16.019804 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:19:16.066416 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:16.107090 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:19:16.107563 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:19:16.192566 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:19:16.193057 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:19:16.193707 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'trusted_certs' on Instance uuid 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:19:16.250359 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Successfully updated port: 963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:19:16.291399 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-49ede768-22f2-4606-a38d-0f67e00e247c req-72cc7676-eded-4c99-bf9d-5ae5262aa713 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Received event network-changed-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:16.291729 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-49ede768-22f2-4606-a38d-0f67e00e247c req-72cc7676-eded-4c99-bf9d-5ae5262aa713 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Refreshing instance network info cache due to event network-changed-963e49c4-9f06-4d28-8cde-3f893d9301b7. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:19:16.291936 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-49ede768-22f2-4606-a38d-0f67e00e247c req-72cc7676-eded-4c99-bf9d-5ae5262aa713 service nova] Acquiring lock "refresh_cache-5d91bc7d-00a1-44ff-9387-7fad59dc5679" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:19:16.292062 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-49ede768-22f2-4606-a38d-0f67e00e247c req-72cc7676-eded-4c99-bf9d-5ae5262aa713 service nova] Acquired lock "refresh_cache-5d91bc7d-00a1-44ff-9387-7fad59dc5679" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:19:16.292154 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-49ede768-22f2-4606-a38d-0f67e00e247c req-72cc7676-eded-4c99-bf9d-5ae5262aa713 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Refreshing network info cache for port 963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:19:16.405007 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:19:16.696008 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Object Instance<18a78f17-3543-48db-bb55-ec15bdf2b27a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:19:16.696545 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:19:16.753106 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "refresh_cache-5d91bc7d-00a1-44ff-9387-7fad59dc5679" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:19:16.783465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed5893e19e3c076451a9673ced27eac57ccd9d9c --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:19:16.783840 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:19:16.784056 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:19:16.795866 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-49ede768-22f2-4606-a38d-0f67e00e247c req-72cc7676-eded-4c99-bf9d-5ae5262aa713 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:16.853993 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-49ede768-22f2-4606-a38d-0f67e00e247c req-72cc7676-eded-4c99-bf9d-5ae5262aa713 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:19:16.869512 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:19:16.869841 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Cannot resize image /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:19:16.870048 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'migration_context' on Instance uuid 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:19:16.909500 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Booting with volume 054283ea-2baf-4704-ad7d-6b2dd3091391 at /dev/vda
May 27 23:19:16.945618 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:19:16.955561 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:19:16.974017 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-49ede768-22f2-4606-a38d-0f67e00e247c req-72cc7676-eded-4c99-bf9d-5ae5262aa713 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:19:16.975157 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:19:17.017444 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:19:17.018164 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:19:17.026153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:19:17.027115 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe66:220a', 'fe80::cc06:4bff:fe3b:6e14'] 
May 27 23:19:17.027449 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:19:17.027449 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:19:17.027671 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:19:17.027882 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Updating existing volume attachment record: 34413995-75ce-45b3-a29e-06470cf9c9ab {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:19:17.372596 np0000001565 nova-compute[98289]: DEBUG nova.objects.base [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Object Instance<18a78f17-3543-48db-bb55-ec15bdf2b27a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98289) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 23:19:17.373688 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1612446662',display_name='tempest-TestMinimumBasicScenario-server-1612446662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testminimumbasicscenario-server-1612446662',id=70,image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAqCphSPb8XRQSNMvn5VDyF92O7glfyqAu1atC0yO/MGEBvwr/90xBlv1JaiMPLKd/mHIvWKYAHmabuV5K/EmJfu+SLGTxRIE3bQp2cOjH03EpIHHagChlrb8gkaDsmLg==',key_name='tempest-TestMinimumBasicScenario-1773724696',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:18:24Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='30f40c2f26134e52b9d0ba5a2d3deb91',ramdisk_id='',reservation_id='r-0d61ien3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-365514479',owner_user_name='tempest-TestMinimumBasicScenario-365514479-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:19:09Z,user_data=None,user_id='b20fe60fc49e4fbeb9ea63bf3cf9e3d4',uuid=18a78f17-3543-48db-bb55-ec15bdf2b27a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:19:17.373925 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converting VIF {"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:19:17.374568 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:19:17.374799 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:19:17.375248 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:17.375647 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:17.375940 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:19:17.376645 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:17.376809 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4347c5a3-3e78-5fa8-8572-1cf2d0b0d67c', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:17.383929 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:17.384757 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:17.386815 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:17.386964 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a8534ea-23, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:17.387279 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a8534ea-23, col_values=(('qos', UUID('24eb48e7-8693-46f8-aa4d-3b795aad5760')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:17.387481 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a8534ea-23, col_values=(('external_ids', {'iface-id': '3a8534ea-2385-42d1-b07b-b88cde28f054', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:cb:1f', 'vm-uuid': '18a78f17-3543-48db-bb55-ec15bdf2b27a'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:17.390324 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:17.391267 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:17.395618 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:17.396291 np0000001565 nova-compute[98289]: INFO os_vif [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23')
May 27 23:19:17.476132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-49ede768-22f2-4606-a38d-0f67e00e247c req-72cc7676-eded-4c99-bf9d-5ae5262aa713 service nova] Releasing lock "refresh_cache-5d91bc7d-00a1-44ff-9387-7fad59dc5679" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:19:17.477388 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquired lock "refresh_cache-5d91bc7d-00a1-44ff-9387-7fad59dc5679" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:19:17.477388 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:19:17.760620 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:17.783926 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:17.867541 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:18.037511 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:19:18.068280 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:18.070225 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:18.072957 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:18.089788 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:18.175825 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:18.302929 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Updating instance_info_cache with network_info: [{"id": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "address": "fa:16:3e:35:d3:cc", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963e49c4-9f", "ovs_interfaceid": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:19:18.342028 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:18.342263 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:18.344023 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:18.344185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:18.344360 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] No waiting events found dispatching network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:19:18.344554 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received unexpected event network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 for instance with vm_state active and task_state reboot_started_hard.
May 27 23:19:18.344940 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:18.345129 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:18.345211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:18.345329 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:18.345485 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] No waiting events found dispatching network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:19:18.345594 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-564522bd-8cf5-4099-8a81-e2a238a14e43 req-e52009e2-bb12-437e-adea-518902e6a48f service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received unexpected event network-vif-plugged-3a8534ea-2385-42d1-b07b-b88cde28f054 for instance with vm_state active and task_state reboot_started_hard.
May 27 23:19:18.442942 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for 18a78f17-3543-48db-bb55-ec15bdf2b27a due to new event <LifecycleEvent: 1779923958.4425755, 18a78f17-3543-48db-bb55-ec15bdf2b27a => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:19:18.443062 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923958.4425755, 18a78f17-3543-48db-bb55-ec15bdf2b27a => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:19:18.443175 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] VM Resumed (Lifecycle Event)
May 27 23:19:18.444615 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Instance event wait completed in 0 seconds for  {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:19:18.447127 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Instance rebooted successfully.
May 27 23:19:18.804714 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Releasing lock "refresh_cache-5d91bc7d-00a1-44ff-9387-7fad59dc5679" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:19:18.804967 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Instance network_info: |[{"id": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "address": "fa:16:3e:35:d3:cc", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963e49c4-9f", "ovs_interfaceid": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:19:18.946143 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:19:18.951125 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:19:19.119933 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:19:19.120976 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:19:19.121197 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Creating image(s)
May 27 23:19:19.121488 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:19:19.121603 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Ensure instance console log exists: /opt/stack/data/nova/instances/5d91bc7d-00a1-44ff-9387-7fad59dc5679/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:19:19.121809 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:19.121946 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:19.122058 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:19.122730 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Start _get_guest_xml network_info=[{"id": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "address": "fa:16:3e:35:d3:cc", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963e49c4-9f", "ovs_interfaceid": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '34413995-75ce-45b3-a29e-06470cf9c9ab', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '054283ea-2baf-4704-ad7d-6b2dd3091391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5d91bc7d-00a1-44ff-9387-7fad59dc5679', 'attached_at': '', 'detached_at': '', 'volume_id': '054283ea-2baf-4704-ad7d-6b2dd3091391', 'serial': '054283ea-2baf-4704-ad7d-6b2dd3091391'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:19:19.125133 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:19:19.126798 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-2111509405', uuid='5d91bc7d-00a1-44ff-9387-7fad59dc5679'), owner=OwnerMeta(userid='31823a44e786429f80ba607958f8b63e', username='tempest-TestVolumeBootPattern-314561297-project-member', projectid='5dda425dab8946dc926808806eeedced', projectname='tempest-TestVolumeBootPattern-314561297'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "address": "fa:16:3e:35:d3:cc", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963e49c4-9f", "ovs_interfaceid": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779923959.1263874) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:19:19.127975 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:19:19.128289 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:19:19.129356 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:19:19.129676 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:19:19.130485 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:19:19.130952 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:19:19.131179 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:19:19.131438 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:19:19.131729 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:19:19.131897 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:19:19.132144 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:19:19.132347 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:19:19.132503 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:19:19.132655 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:19:19.132851 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:19:19.133151 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:19:19.142997 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:19:19.143423 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '054283ea-2baf-4704-ad7d-6b2dd3091391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:19:19.143718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:19:19.144076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:19:19.144350 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '054283ea-2baf-4704-ad7d-6b2dd3091391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:19:19.155816 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:19:19.156470 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:19:19.156957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:19:19.157160 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:19:19.157597 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:19:19.157792 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:19:19.168393 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:19:19.168393 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:19.173737 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:19:19.173737 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:19.180383 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391] added
May 27 23:19:19.180383 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:19:19.180383 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:19:19.180383 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:19:19.180383 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:19:19.180383 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:19:19.180383 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:19.180566 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:19:19.180687 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:19:19.180829 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:19:19.184280 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391] added
May 27 23:19:19.184280 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:19:19.184280 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:19:19.184280 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:19:19.184280 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:19:19.184280 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:19:19.184280 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:19.184484 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:19:19.184599 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:19:19.184722 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:19:19.396122 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:19.453382 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 27 23:19:19.453730 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923959.453492, 18a78f17-3543-48db-bb55-ec15bdf2b27a => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:19:19.453839 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] VM Started (Lifecycle Event)
May 27 23:19:19.958810 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:19:19.958810 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:19:19.958810 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:19:19.958810 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:19:19.958810 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No VIF found with MAC fa:16:3e:ec:cb:1f, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:19:19.958810 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:19:19.958810 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:19:20.181344 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:19:20.185658 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:19:20.196500 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:19:20.196500 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:19:20.205688 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:19:20.205688 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:20.213653 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:20.219111 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:20.228520 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.228520 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.228520 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.228520 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.228520 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:20.228855 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.228855 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.228855 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.228855 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.228855 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:20.238812 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.238812 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.238812 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.238812 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.238812 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:20.238812 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.238812 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.238812 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.238812 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.238812 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:20.265680 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391, portal: 192.168.40.100,3260]
May 27 23:19:20.265680 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391, portal: 192.168.40.100,3260] successful.
May 27 23:19:20.265680 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:20.277465 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:20.281979 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391, portal: 192.168.50.100,3260]
May 27 23:19:20.281979 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391, portal: 192.168.50.100,3260] successful.
May 27 23:19:20.281979 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:20.293761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.293761 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.293761 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.293761 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.293761 np0000001565 nova-compute[98289]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:20.293761 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:20.293761 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:20.294070 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.294070 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.294070 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.294070 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.294070 np0000001565 nova-compute[98289]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:20.294070 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:20.294070 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:20.294225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:19:20.294465 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:19:20.295217 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('11', '-', '-', 0) found on session 197 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:19:20.295385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:19:20.297159 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:20.315550 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 197 and hctl ['11', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:19:20.318190 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.318190 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.318190 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.318190 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.318190 np0000001565 nova-compute[98289]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:20.318190 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:20.318190 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:20.318388 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.318388 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:20.318388 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.318388 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:20.318388 np0000001565 nova-compute[98289]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:20.318388 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:20.318388 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:20.318674 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:19:20.318789 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:19:20.319492 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('12', '-', '-', 0) found on session 198 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:19:20.319600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:19:20.333683 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 198 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:19:20.333683 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '054283ea-2baf-4704-ad7d-6b2dd3091391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:19:20.468648 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 27 23:19:20.470199 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f59892b9-b947-4481-80b9-90c756e68715 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 13.798s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:20.471735 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.734s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:20.471735 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 27 23:19:20.471735 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:21.315282 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 197 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:19:21.315675 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '054283ea-2baf-4704-ad7d-6b2dd3091391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:19:22.174103 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Found WWN 3300000000a24b912 for multipath device dm-2 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:19:22.174418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:19:22.174620 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000000a24b912', 'path': '/dev/dm-2', 'multipath_id': '3300000000a24b912'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:19:22.174780 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000a24b912', 'path': '/dev/dm-2', 'multipath_id': '3300000000a24b912'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:19:22.404878 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:22.681865 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:19:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2111509405',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2111509405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-volume-backed-server-2111509405',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGQ3MPwMGxYUyT0JgiARgDoGN5oz+i9FHLGJ9Qy0KgLZ+/39YOyfz46aoi1b8Sz0s6T0uZfkLv4fmndKlJ/u66L51szi3/PjHF30SRUFzHqmlxrs0AhvrHQaLMyv3agUQ==',key_name='tempest-keypair-916219044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-ypp39boq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:19:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=5d91bc7d-00a1-44ff-9387-7fad59dc5679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "address": "fa:16:3e:35:d3:cc", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963e49c4-9f", "ovs_interfaceid": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:19:22.682146 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "address": "fa:16:3e:35:d3:cc", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963e49c4-9f", "ovs_interfaceid": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:19:22.682459 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=963e49c4-9f06-4d28-8cde-3f893d9301b7,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963e49c4-9f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:19:22.682973 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d91bc7d-00a1-44ff-9387-7fad59dc5679 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:19:23.185413 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] End _get_guest_xml xml=<domain type="qemu">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <uuid>5d91bc7d-00a1-44ff-9387-7fad59dc5679</uuid>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <name>instance-00000049</name>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2111509405</nova:name>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:19:19</nova:creationTime>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:user uuid="31823a44e786429f80ba607958f8b63e">tempest-TestVolumeBootPattern-314561297-project-member</nova:user>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:project uuid="5dda425dab8946dc926808806eeedced">tempest-TestVolumeBootPattern-314561297</nova:project>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         <nova:port uuid="963e49c4-9f06-4d28-8cde-3f893d9301b7">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <system>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <entry name="serial">5d91bc7d-00a1-44ff-9387-7fad59dc5679</entry>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <entry name="uuid">5d91bc7d-00a1-44ff-9387-7fad59dc5679</entry>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     </system>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <os>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   </os>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <features>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   </features>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   <devices>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/5d91bc7d-00a1-44ff-9387-7fad59dc5679/disk.config"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     </disk>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <alias name="ua-054283ea-2baf-4704-ad7d-6b2dd3091391"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-2"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <serial>054283ea-2baf-4704-ad7d-6b2dd3091391</serial>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     </disk>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:35:d3:cc"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <target dev="tap963e49c4-9f"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     </interface>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/5d91bc7d-00a1-44ff-9387-7fad59dc5679/console.log" append="off"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     </serial>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <video>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     </video>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     </rng>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:   </devices>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]: </domain>
May 27 23:19:23.185413 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Preparing to wait for external event network-vif-plugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:19:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2111509405',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2111509405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-volume-backed-server-2111509405',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGQ3MPwMGxYUyT0JgiARgDoGN5oz+i9FHLGJ9Qy0KgLZ+/39YOyfz46aoi1b8Sz0s6T0uZfkLv4fmndKlJ/u66L51szi3/PjHF30SRUFzHqmlxrs0AhvrHQaLMyv3agUQ==',key_name='tempest-keypair-916219044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-ypp39boq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:19:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=5d91bc7d-00a1-44ff-9387-7fad59dc5679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "address": "fa:16:3e:35:d3:cc", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963e49c4-9f", "ovs_interfaceid": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "address": "fa:16:3e:35:d3:cc", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963e49c4-9f", "ovs_interfaceid": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=963e49c4-9f06-4d28-8cde-3f893d9301b7,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963e49c4-9f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=963e49c4-9f06-4d28-8cde-3f893d9301b7,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963e49c4-9f') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:23.189023 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56b6c5a7-dd05-5848-a391-f38f2ba9276e', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:23.189759 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:23.189759 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:23.190800 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:23.191861 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:23.191972 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap963e49c4-9f, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:23.192231 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap963e49c4-9f, col_values=(('qos', UUID('914e6421-c1ef-40d2-a2dd-7b2ee642d4ae')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:23.192372 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap963e49c4-9f, col_values=(('external_ids', {'iface-id': '963e49c4-9f06-4d28-8cde-3f893d9301b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:d3:cc', 'vm-uuid': '5d91bc7d-00a1-44ff-9387-7fad59dc5679'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:23.192942 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:23.194644 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:23.198894 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:23.199048 np0000001565 nova-compute[98289]: INFO os_vif [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=963e49c4-9f06-4d28-8cde-3f893d9301b7,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963e49c4-9f')
May 27 23:19:24.398365 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:24.713554 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:19:24.713554 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:19:24.713737 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No VIF found with MAC fa:16:3e:35:d3:cc, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:19:24.713961 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Using config drive
May 27 23:19:25.218398 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:25.322318 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Creating config drive at /opt/stack/data/nova/instances/5d91bc7d-00a1-44ff-9387-7fad59dc5679/disk.config
May 27 23:19:25.325889 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5d91bc7d-00a1-44ff-9387-7fad59dc5679/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp558hodpm {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:19:25.382237 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5d91bc7d-00a1-44ff-9387-7fad59dc5679/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp558hodpm" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:19:25.544141 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00037755199991806876 future=<Future at 0x726e38749eb0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:25.544141 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:25.747749 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:25.768773 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:25.856123 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:25.913841 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-14eb34ea-5446-4fc5-90c4-07fef6409152 req-dd26bfb2-d018-49ef-9b5d-d2aa7307b1d4 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Received event network-vif-plugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:25.914323 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-14eb34ea-5446-4fc5-90c4-07fef6409152 req-dd26bfb2-d018-49ef-9b5d-d2aa7307b1d4 service nova] Acquiring lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:25.914520 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-14eb34ea-5446-4fc5-90c4-07fef6409152 req-dd26bfb2-d018-49ef-9b5d-d2aa7307b1d4 service nova] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:25.914649 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-14eb34ea-5446-4fc5-90c4-07fef6409152 req-dd26bfb2-d018-49ef-9b5d-d2aa7307b1d4 service nova] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:25.914763 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-14eb34ea-5446-4fc5-90c4-07fef6409152 req-dd26bfb2-d018-49ef-9b5d-d2aa7307b1d4 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Processing event network-vif-plugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:19:26.788924 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:26.788924 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:26.788924 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923966.4476874, 5d91bc7d-00a1-44ff-9387-7fad59dc5679 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:19:26.788924 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:19:26.788924 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] VM Started (Lifecycle Event)
May 27 23:19:26.788924 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:19:26.788924 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Instance spawned successfully.
May 27 23:19:26.788924 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:19:26.951963 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:19:26.953692 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:19:26.960554 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:19:26.960698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:19:26.960963 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:19:26.961203 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:19:26.961488 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:19:26.961750 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:19:27.455731 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:19:27.455986 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923967.4558134, 5d91bc7d-00a1-44ff-9387-7fad59dc5679 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:19:27.456136 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] VM Paused (Lifecycle Event)
May 27 23:19:27.465873 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Took 8.35 seconds to spawn the instance on the hypervisor.
May 27 23:19:27.465975 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:19:27.958426 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:19:27.960610 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779923967.9603462, 5d91bc7d-00a1-44ff-9387-7fad59dc5679 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:19:27.960761 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] VM Resumed (Lifecycle Event)
May 27 23:19:27.973923 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-20881119-1ac1-4f70-a09b-ce42f8471f51 req-f6695cae-19cf-4277-b385-ae5b1c9a285e service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Received event network-vif-plugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:27.973923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-20881119-1ac1-4f70-a09b-ce42f8471f51 req-f6695cae-19cf-4277-b385-ae5b1c9a285e service nova] Acquiring lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:27.973923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-20881119-1ac1-4f70-a09b-ce42f8471f51 req-f6695cae-19cf-4277-b385-ae5b1c9a285e service nova] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:27.973923 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-20881119-1ac1-4f70-a09b-ce42f8471f51 req-f6695cae-19cf-4277-b385-ae5b1c9a285e service nova] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:27.973923 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-20881119-1ac1-4f70-a09b-ce42f8471f51 req-f6695cae-19cf-4277-b385-ae5b1c9a285e service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] No waiting events found dispatching network-vif-plugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:19:27.973923 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-20881119-1ac1-4f70-a09b-ce42f8471f51 req-f6695cae-19cf-4277-b385-ae5b1c9a285e service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Received unexpected event network-vif-plugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 for instance with vm_state active and task_state None.
May 27 23:19:27.977507 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Took 15.30 seconds to build instance.
May 27 23:19:28.195148 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:28.463861 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:19:28.465664 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:19:28.479002 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.809s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:29.398596 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:30.025363 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-23bdbb59-4b69-4079-b4ec-0de095ba8cb6 req-1db1b275-d1ab-41b1-960c-7244803199a0 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Received event network-changed-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:30.025512 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-23bdbb59-4b69-4079-b4ec-0de095ba8cb6 req-1db1b275-d1ab-41b1-960c-7244803199a0 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Refreshing instance network info cache due to event network-changed-963e49c4-9f06-4d28-8cde-3f893d9301b7. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:19:30.025660 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-23bdbb59-4b69-4079-b4ec-0de095ba8cb6 req-1db1b275-d1ab-41b1-960c-7244803199a0 service nova] Acquiring lock "refresh_cache-5d91bc7d-00a1-44ff-9387-7fad59dc5679" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:19:30.025749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-23bdbb59-4b69-4079-b4ec-0de095ba8cb6 req-1db1b275-d1ab-41b1-960c-7244803199a0 service nova] Acquired lock "refresh_cache-5d91bc7d-00a1-44ff-9387-7fad59dc5679" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:19:30.025884 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-23bdbb59-4b69-4079-b4ec-0de095ba8cb6 req-1db1b275-d1ab-41b1-960c-7244803199a0 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Refreshing network info cache for port 963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:19:30.530023 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-23bdbb59-4b69-4079-b4ec-0de095ba8cb6 req-1db1b275-d1ab-41b1-960c-7244803199a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:30.812498 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-23bdbb59-4b69-4079-b4ec-0de095ba8cb6 req-1db1b275-d1ab-41b1-960c-7244803199a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:30.928033 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-23bdbb59-4b69-4079-b4ec-0de095ba8cb6 req-1db1b275-d1ab-41b1-960c-7244803199a0 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Updated VIF entry in instance network info cache for port 963e49c4-9f06-4d28-8cde-3f893d9301b7. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:19:30.928324 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-23bdbb59-4b69-4079-b4ec-0de095ba8cb6 req-1db1b275-d1ab-41b1-960c-7244803199a0 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Updating instance_info_cache with network_info: [{"id": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "address": "fa:16:3e:35:d3:cc", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963e49c4-9f", "ovs_interfaceid": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:19:31.430351 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-23bdbb59-4b69-4079-b4ec-0de095ba8cb6 req-1db1b275-d1ab-41b1-960c-7244803199a0 service nova] Releasing lock "refresh_cache-5d91bc7d-00a1-44ff-9387-7fad59dc5679" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:19:32.448439 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "31752c04-799d-4f35-ac81-a56af64fb42c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:32.448833 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "31752c04-799d-4f35-ac81-a56af64fb42c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:32.448833 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:32.448890 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:32.448991 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:32.450910 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Terminating instance
May 27 23:19:32.955347 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:19:32.969825 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:32.971913 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:32.986481 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:32.992254 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:33.006668 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:33.011204 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:33.107880 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-431b962f-1ee9-4313-aac1-8ac968fd392d req-1025d48d-72db-4708-a984-6da02b816be8 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Received event network-vif-unplugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:33.108054 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-431b962f-1ee9-4313-aac1-8ac968fd392d req-1025d48d-72db-4708-a984-6da02b816be8 service nova] Acquiring lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:33.108137 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-431b962f-1ee9-4313-aac1-8ac968fd392d req-1025d48d-72db-4708-a984-6da02b816be8 service nova] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:33.108239 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-431b962f-1ee9-4313-aac1-8ac968fd392d req-1025d48d-72db-4708-a984-6da02b816be8 service nova] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:33.108360 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-431b962f-1ee9-4313-aac1-8ac968fd392d req-1025d48d-72db-4708-a984-6da02b816be8 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] No waiting events found dispatching network-vif-unplugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:19:33.108490 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-431b962f-1ee9-4313-aac1-8ac968fd392d req-1025d48d-72db-4708-a984-6da02b816be8 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Received event network-vif-unplugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:19:33.199405 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:33.259646 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999652419000086 future=<Future at 0x726e386c7710 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:33.260010 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999259664999954 future=<Future at 0x726e386c7710 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:33.260102 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999153841999942 future=<Future at 0x726e386c7710 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:33.262779 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Instance destroyed successfully.
May 27 23:19:33.263154 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lazy-loading 'resources' on Instance uuid 31752c04-799d-4f35-ac81-a56af64fb42c {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:19:33.765466 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1087899189',display_name='tempest-TestEncryptedCinderVolumes-server-1087899189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testencryptedcindervolumes-server-1087899189',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwpLIDJzmmj8DOOIr1KJSEMd+lIpXx0aX3N2m8iUzldrJ/GuIUPYvReVhfmMiDVx83K1VHGQco6OTrLiBD8PtdDgFRaFsX4ihfkPtv7oJvf/xEiMdyvlvg2/fN1X+W+HA==',key_name='tempest-TestEncryptedCinderVolumes-418939601',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:18:53Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2d4267649c9432993626e440932bf08',ramdisk_id='',reservation_id='r-0bo0jw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-274929604',owner_user_name='tempest-TestEncryptedCinderVolumes-274929604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:18:53Z,user_data=None,user_id='6418d61428124c1c98659435dd6b8bff',uuid=31752c04-799d-4f35-ac81-a56af64fb42c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:19:33.765925 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converting VIF {"id": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "address": "fa:16:3e:66:22:0a", "network": {"id": "328ce487-55fb-4384-80d2-6369fe387e60", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1467629086-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e2d4267649c9432993626e440932bf08", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5273a52e-e2", "ovs_interfaceid": "5273a52e-e20f-4f70-8f86-cf9d6f6e9b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:19:33.766260 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=5273a52e-e20f-4f70-8f86-cf9d6f6e9b26,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5273a52e-e2') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:19:33.766504 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=5273a52e-e20f-4f70-8f86-cf9d6f6e9b26,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5273a52e-e2') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:19:33.768309 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:33.768514 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5273a52e-e2, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:33.770567 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:33.770915 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:33.771350 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:33.771472 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39b9c758-a143-4e81-81e2-a1bfd82a986b) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:33.772710 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:33.774106 np0000001565 nova-compute[98289]: INFO os_vif [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=5273a52e-e20f-4f70-8f86-cf9d6f6e9b26,network=Network(328ce487-55fb-4384-80d2-6369fe387e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5273a52e-e2')
May 27 23:19:33.776649 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:19:33.776993 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:19:33.777127 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:19:33.777460 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:19:33.777774 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77d32c8c-b044-4dbf-a084-3adf2f3165a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:19:33.777906 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:19:33.805803 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:33.805803 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:33.805803 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:33.805803 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:33.805803 np0000001565 nova-compute[98289]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:33.805803 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:33.805803 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:33.806001 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsi session list stdout=tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:33.806001 np0000001565 nova-compute[98289]: tcp: [192] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4 (non-flash)
May 27 23:19:33.806001 np0000001565 nova-compute[98289]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:33.806001 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:33.806001 np0000001565 nova-compute[98289]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:33.806001 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:33.806001 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:33.806001 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '191'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '192'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', '198')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:19:33.806206 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '191')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:19:33.806979 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4', '192')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:19:33.807804 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e601c4720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:19:33.808000 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Removing multipathed devices sdd, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:19:33.808233 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Flush multipath device 3300000006984545c {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:19:33.838301 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:19:33.889855 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:19:33.926700 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:19:33.926874 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:19:33.927753 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:19:33.938422 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:19:33.938638 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:19:33.949193 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:33.978651 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 191, target: iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4, portal: 192.168.40.100,3260]
May 27 23:19:33.978651 np0000001565 nova-compute[98289]: Logout of [sid: 191, target: iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4, portal: 192.168.40.100,3260] successful.
May 27 23:19:33.978651 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:33.992635 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:34.003520 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:34.041363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4, portal: 192.168.50.100,3260]
May 27 23:19:34.041363 np0000001565 nova-compute[98289]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-77d32c8c-b044-4dbf-a084-3adf2f3165a4, portal: 192.168.50.100,3260] successful.
May 27 23:19:34.041363 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:34.055519 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:34.056447 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:19:34.056548 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] <== disconnect_volume: return (279ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:19:34.056655 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:19:34.056912 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Deleting instance files /opt/stack/data/nova/instances/31752c04-799d-4f35-ac81-a56af64fb42c_del
May 27 23:19:34.057377 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Deletion of /opt/stack/data/nova/instances/31752c04-799d-4f35-ac81-a56af64fb42c_del complete
May 27 23:19:34.399831 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:34.563247 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Took 1.61 seconds to destroy the instance on the hypervisor.
May 27 23:19:34.563916 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:19:34.564257 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:19:34.564390 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:19:34.564607 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:34.617471 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:34.980015 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0548f2a5-3a9b-4050-82bf-7a95b4cd89db req-d1546553-9e7a-45d6-ad01-7bcd19b31a03 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Received event network-vif-deleted-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:34.980434 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-0548f2a5-3a9b-4050-82bf-7a95b4cd89db req-d1546553-9e7a-45d6-ad01-7bcd19b31a03 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Neutron deleted interface 5273a52e-e20f-4f70-8f86-cf9d6f6e9b26; detaching it from the instance and deleting it from the info cache
May 27 23:19:34.981816 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0548f2a5-3a9b-4050-82bf-7a95b4cd89db req-d1546553-9e7a-45d6-ad01-7bcd19b31a03 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Detach interface failed, port_id=5273a52e-e20f-4f70-8f86-cf9d6f6e9b26, reason: Instance 31752c04-799d-4f35-ac81-a56af64fb42c could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:19:35.169476 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0141ef4a-06dc-4bd9-9f26-2f5b49192405 req-c8ba9304-504f-4ed8-9881-af7c39bc0930 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Received event network-vif-unplugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:35.169665 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0141ef4a-06dc-4bd9-9f26-2f5b49192405 req-c8ba9304-504f-4ed8-9881-af7c39bc0930 service nova] Acquiring lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:35.169827 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0141ef4a-06dc-4bd9-9f26-2f5b49192405 req-c8ba9304-504f-4ed8-9881-af7c39bc0930 service nova] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:35.169937 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0141ef4a-06dc-4bd9-9f26-2f5b49192405 req-c8ba9304-504f-4ed8-9881-af7c39bc0930 service nova] Lock "31752c04-799d-4f35-ac81-a56af64fb42c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:35.170301 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0141ef4a-06dc-4bd9-9f26-2f5b49192405 req-c8ba9304-504f-4ed8-9881-af7c39bc0930 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] No waiting events found dispatching network-vif-unplugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:19:35.170457 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0141ef4a-06dc-4bd9-9f26-2f5b49192405 req-c8ba9304-504f-4ed8-9881-af7c39bc0930 service nova] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Received event network-vif-unplugged-5273a52e-e20f-4f70-8f86-cf9d6f6e9b26 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:19:35.436639 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:19:35.938788 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Took 1.37 seconds to deallocate network for instance.
May 27 23:19:36.485508 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Took 0.55 seconds to detach 1 volumes for instance.
May 27 23:19:36.991690 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:36.991924 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:37.164298 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:19:37.164552 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:19:37.666905 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:19:38.175364 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.181s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:38.225737 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Deleted allocations for instance 31752c04-799d-4f35-ac81-a56af64fb42c
May 27 23:19:38.772556 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:39.231679 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c586336f-4fa8-4b33-8aa8-e84f9d23d616 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Lock "31752c04-799d-4f35-ac81-a56af64fb42c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.782s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:39.401322 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:42.038936 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1935d2a6-c9b4-4fcc-8ac4-8a3c4746b1d5 req-fe1d2747-cd24-4346-b380-068b63212fd5 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-changed-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:42.039275 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1935d2a6-c9b4-4fcc-8ac4-8a3c4746b1d5 req-fe1d2747-cd24-4346-b380-068b63212fd5 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Refreshing instance network info cache due to event network-changed-3a8534ea-2385-42d1-b07b-b88cde28f054. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:19:42.039486 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1935d2a6-c9b4-4fcc-8ac4-8a3c4746b1d5 req-fe1d2747-cd24-4346-b380-068b63212fd5 service nova] Acquiring lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:19:42.039579 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1935d2a6-c9b4-4fcc-8ac4-8a3c4746b1d5 req-fe1d2747-cd24-4346-b380-068b63212fd5 service nova] Acquired lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:19:42.039690 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1935d2a6-c9b4-4fcc-8ac4-8a3c4746b1d5 req-fe1d2747-cd24-4346-b380-068b63212fd5 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Refreshing network info cache for port 3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:19:42.541472 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-1935d2a6-c9b4-4fcc-8ac4-8a3c4746b1d5 req-fe1d2747-cd24-4346-b380-068b63212fd5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:42.804260 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-1935d2a6-c9b4-4fcc-8ac4-8a3c4746b1d5 req-fe1d2747-cd24-4346-b380-068b63212fd5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:42.936837 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1935d2a6-c9b4-4fcc-8ac4-8a3c4746b1d5 req-fe1d2747-cd24-4346-b380-068b63212fd5 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updated VIF entry in instance network info cache for port 3a8534ea-2385-42d1-b07b-b88cde28f054. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:19:42.937129 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-1935d2a6-c9b4-4fcc-8ac4-8a3c4746b1d5 req-fe1d2747-cd24-4346-b380-068b63212fd5 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updating instance_info_cache with network_info: [{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:19:43.052710 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:43.053046 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:43.170151 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:43.439044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1935d2a6-c9b4-4fcc-8ac4-8a3c4746b1d5 req-fe1d2747-cd24-4346-b380-068b63212fd5 service nova] Releasing lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:19:43.555651 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Detaching volume 093124a1-c06a-48c8-beae-c1acbdfa06c6
May 27 23:19:43.593134 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Attempting to driver detach volume 093124a1-c06a-48c8-beae-c1acbdfa06c6 from mountpoint /dev/vdb
May 27 23:19:43.597801 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Found disk vdb by alias ua-093124a1-c06a-48c8-beae-c1acbdfa06c6 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:19:43.599284 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Found disk vdb by alias ua-093124a1-c06a-48c8-beae-c1acbdfa06c6 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:19:43.599449 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Attempting to detach device vdb from instance 18a78f17-3543-48db-bb55-ec15bdf2b27a from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:19:43.599691 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:19:43.599691 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:19:43.599691 np0000001565 nova-compute[98289]:   <alias name="ua-093124a1-c06a-48c8-beae-c1acbdfa06c6"/>
May 27 23:19:43.599691 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:19:43.599691 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:19:43.599691 np0000001565 nova-compute[98289]:   <serial>093124a1-c06a-48c8-beae-c1acbdfa06c6</serial>
May 27 23:19:43.599691 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:19:43.599691 np0000001565 nova-compute[98289]: </disk>
May 27 23:19:43.599691 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:19:43.605252 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Successfully detached device vdb from instance 18a78f17-3543-48db-bb55-ec15bdf2b27a from the persistent domain config.
May 27 23:19:43.605579 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] (1/8): Attempting to detach device vdb with device alias ua-093124a1-c06a-48c8-beae-c1acbdfa06c6 from instance 18a78f17-3543-48db-bb55-ec15bdf2b27a from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:19:43.606112 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:19:43.606112 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:19:43.606112 np0000001565 nova-compute[98289]:   <alias name="ua-093124a1-c06a-48c8-beae-c1acbdfa06c6"/>
May 27 23:19:43.606112 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:19:43.606112 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:19:43.606112 np0000001565 nova-compute[98289]:   <serial>093124a1-c06a-48c8-beae-c1acbdfa06c6</serial>
May 27 23:19:43.606112 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 23:19:43.606112 np0000001565 nova-compute[98289]: </disk>
May 27 23:19:43.606112 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:19:43.773088 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:44.089998 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fdbde513-c8a1-44ae-84d3-aa5ea9782719 req-14de2071-3521-4a68-9dac-47c3417ede55 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-changed-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:44.090382 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fdbde513-c8a1-44ae-84d3-aa5ea9782719 req-14de2071-3521-4a68-9dac-47c3417ede55 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Refreshing instance network info cache due to event network-changed-3a8534ea-2385-42d1-b07b-b88cde28f054. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:19:44.090382 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fdbde513-c8a1-44ae-84d3-aa5ea9782719 req-14de2071-3521-4a68-9dac-47c3417ede55 service nova] Acquiring lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:19:44.090382 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fdbde513-c8a1-44ae-84d3-aa5ea9782719 req-14de2071-3521-4a68-9dac-47c3417ede55 service nova] Acquired lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:19:44.090504 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fdbde513-c8a1-44ae-84d3-aa5ea9782719 req-14de2071-3521-4a68-9dac-47c3417ede55 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Refreshing network info cache for port 3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:19:44.110362 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779923984.1100647, 18a78f17-3543-48db-bb55-ec15bdf2b27a => ua-093124a1-c06a-48c8-beae-c1acbdfa06c6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:19:44.112605 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-093124a1-c06a-48c8-beae-c1acbdfa06c6 for instance 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:19:44.115041 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Successfully detached device vdb from instance 18a78f17-3543-48db-bb55-ec15bdf2b27a from the live domain config.
May 27 23:19:44.115966 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:19:44.116386 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:19:44.116465 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:19:44.116748 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:19:44.117011 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '093124a1-c06a-48c8-beae-c1acbdfa06c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:19:44.117148 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:19:44.144718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:44.144718 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:44.144718 np0000001565 nova-compute[98289]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:44.144718 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:44.144718 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:19:44.145004 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:44.145004 np0000001565 nova-compute[98289]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6 (non-flash)
May 27 23:19:44.145004 np0000001565 nova-compute[98289]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:44.145004 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:19:44.145004 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:19:44.145177 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', '198')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:19:44.145299 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '196')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:19:44.146388 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6', '195')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:19:44.147052 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e581787c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'): ({'sdb'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:19:44.147220 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:19:44.147502 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Flush multipath device 3300000009f565901 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:19:44.182505 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:19:44.237054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:19:44.282652 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:19:44.282816 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:19:44.283778 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:19:44.294857 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:19:44.295011 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:19:44.305697 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:44.331274 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 196, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.40.100,3260]
May 27 23:19:44.331274 np0000001565 nova-compute[98289]: Logout of [sid: 196, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.40.100,3260] successful.
May 27 23:19:44.331274 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:44.344428 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:44.353853 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:44.383122 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.50.100,3260]
May 27 23:19:44.383122 np0000001565 nova-compute[98289]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-093124a1-c06a-48c8-beae-c1acbdfa06c6, portal: 192.168.50.100,3260] successful.
May 27 23:19:44.383122 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:44.395128 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:19:44.395376 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:19:44.395527 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] <== disconnect_volume: return (278ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:19:44.395585 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:19:44.419676 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:44.592203 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-fdbde513-c8a1-44ae-84d3-aa5ea9782719 req-14de2071-3521-4a68-9dac-47c3417ede55 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:44.733517 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:44.848729 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-fdbde513-c8a1-44ae-84d3-aa5ea9782719 req-14de2071-3521-4a68-9dac-47c3417ede55 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:44.941745 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'flavor' on Instance uuid 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:19:44.961298 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fdbde513-c8a1-44ae-84d3-aa5ea9782719 req-14de2071-3521-4a68-9dac-47c3417ede55 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updated VIF entry in instance network info cache for port 3a8534ea-2385-42d1-b07b-b88cde28f054. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:19:44.961543 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-fdbde513-c8a1-44ae-84d3-aa5ea9782719 req-14de2071-3521-4a68-9dac-47c3417ede55 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updating instance_info_cache with network_info: [{"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:19:45.463361 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-fdbde513-c8a1-44ae-84d3-aa5ea9782719 req-14de2071-3521-4a68-9dac-47c3417ede55 service nova] Releasing lock "refresh_cache-18a78f17-3543-48db-bb55-ec15bdf2b27a" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:19:45.946951 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-09fae9e7-a5d2-4bce-86f3-baf288f19d9c tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.894s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:47.368777 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:47.369180 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:47.369180 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:47.369251 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:47.369372 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:47.371162 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Terminating instance
May 27 23:19:47.873743 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:19:47.886134 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:47.887759 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:47.902451 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:47.903987 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:47.924120 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:48.007938 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e93276bf-e840-4a26-9f64-4813111d5c69 req-497dd715-2423-40d2-8a42-08aa8ada8080 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:48.008473 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e93276bf-e840-4a26-9f64-4813111d5c69 req-497dd715-2423-40d2-8a42-08aa8ada8080 service nova] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:48.008675 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e93276bf-e840-4a26-9f64-4813111d5c69 req-497dd715-2423-40d2-8a42-08aa8ada8080 service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:48.008840 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e93276bf-e840-4a26-9f64-4813111d5c69 req-497dd715-2423-40d2-8a42-08aa8ada8080 service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:48.008931 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e93276bf-e840-4a26-9f64-4813111d5c69 req-497dd715-2423-40d2-8a42-08aa8ada8080 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] No waiting events found dispatching network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:19:48.009038 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e93276bf-e840-4a26-9f64-4813111d5c69 req-497dd715-2423-40d2-8a42-08aa8ada8080 service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:19:48.190217 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999135778999971 future=<Future at 0x726e58601430 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:48.192079 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Instance destroyed successfully.
May 27 23:19:48.192559 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'resources' on Instance uuid 18a78f17-3543-48db-bb55-ec15bdf2b27a {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:19:48.259764 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004469219998100016 future=<Future at 0x726e386c7710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:48.260301 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Emitting event <LifecycleEvent: 1779923973.2592025, 31752c04-799d-4f35-ac81-a56af64fb42c => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:19:48.260487 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:48.260668 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] VM Stopped (Lifecycle Event)
May 27 23:19:48.260767 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.928552808999939 future=<Future at 0x726e58601430 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:48.261752 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.927573428999949 future=<Future at 0x726e58601430 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:19:48.694700 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:18:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1612446662',display_name='tempest-TestMinimumBasicScenario-server-1612446662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testminimumbasicscenario-server-1612446662',id=70,image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAqCphSPb8XRQSNMvn5VDyF92O7glfyqAu1atC0yO/MGEBvwr/90xBlv1JaiMPLKd/mHIvWKYAHmabuV5K/EmJfu+SLGTxRIE3bQp2cOjH03EpIHHagChlrb8gkaDsmLg==',key_name='tempest-TestMinimumBasicScenario-1773724696',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:18:24Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30f40c2f26134e52b9d0ba5a2d3deb91',ramdisk_id='',reservation_id='r-0d61ien3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d709826-92d6-40a7-96b7-fe7f073414b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-365514479',owner_user_name='tempest-TestMinimumBasicScenario-365514479-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:19:20Z,user_data=None,user_id='b20fe60fc49e4fbeb9ea63bf3cf9e3d4',uuid=18a78f17-3543-48db-bb55-ec15bdf2b27a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:19:48.695170 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converting VIF {"id": "3a8534ea-2385-42d1-b07b-b88cde28f054", "address": "fa:16:3e:ec:cb:1f", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8534ea-23", "ovs_interfaceid": "3a8534ea-2385-42d1-b07b-b88cde28f054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:19:48.695368 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:19:48.695495 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:19:48.696176 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:48.696344 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a8534ea-23, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:48.710612 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:48.711231 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:48.712856 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:48.713345 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:48.713459 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24eb48e7-8693-46f8-aa4d-3b795aad5760) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:19:48.713812 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:48.714230 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:19:48.714855 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:48.716056 np0000001565 nova-compute[98289]: INFO os_vif [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:1f,bridge_name='br-int',has_traffic_filtering=True,id=3a8534ea-2385-42d1-b07b-b88cde28f054,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8534ea-23')
May 27 23:19:48.716264 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Deleting instance files /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a_del
May 27 23:19:48.716897 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Deletion of /opt/stack/data/nova/instances/18a78f17-3543-48db-bb55-ec15bdf2b27a_del complete
May 27 23:19:48.763347 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-2b255ba3-5643-464c-9308-ac32b16d9b39 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 31752c04-799d-4f35-ac81-a56af64fb42c] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:19:49.222170 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Took 1.35 seconds to destroy the instance on the hypervisor.
May 27 23:19:49.222724 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:19:49.223125 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:19:49.223230 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:19:49.223461 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:49.312280 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:19:49.419632 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:49.568054 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-01915700-3011-4ec6-8749-f83dbf2fcc6a req-72c1b15f-b719-45f3-b531-60e1428572cd service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-vif-deleted-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:49.568242 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-01915700-3011-4ec6-8749-f83dbf2fcc6a req-72c1b15f-b719-45f3-b531-60e1428572cd service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Neutron deleted interface 3a8534ea-2385-42d1-b07b-b88cde28f054; detaching it from the instance and deleting it from the info cache
May 27 23:19:49.569515 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-01915700-3011-4ec6-8749-f83dbf2fcc6a req-72c1b15f-b719-45f3-b531-60e1428572cd service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Detach interface failed, port_id=3a8534ea-2385-42d1-b07b-b88cde28f054, reason: Instance 18a78f17-3543-48db-bb55-ec15bdf2b27a could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:19:50.021788 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:19:50.060764 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7d36ecaf-1803-4e95-83f9-e6c083e8a4f9 req-4bab7249-7d86-4d4e-9b46-658ef5cbc69c service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:19:50.061095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7d36ecaf-1803-4e95-83f9-e6c083e8a4f9 req-4bab7249-7d86-4d4e-9b46-658ef5cbc69c service nova] Acquiring lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:50.061178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7d36ecaf-1803-4e95-83f9-e6c083e8a4f9 req-4bab7249-7d86-4d4e-9b46-658ef5cbc69c service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:50.061290 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7d36ecaf-1803-4e95-83f9-e6c083e8a4f9 req-4bab7249-7d86-4d4e-9b46-658ef5cbc69c service nova] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:50.061436 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7d36ecaf-1803-4e95-83f9-e6c083e8a4f9 req-4bab7249-7d86-4d4e-9b46-658ef5cbc69c service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] No waiting events found dispatching network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:19:50.061553 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7d36ecaf-1803-4e95-83f9-e6c083e8a4f9 req-4bab7249-7d86-4d4e-9b46-658ef5cbc69c service nova] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Received event network-vif-unplugged-3a8534ea-2385-42d1-b07b-b88cde28f054 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:19:50.524292 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Took 1.30 seconds to deallocate network for instance.
May 27 23:19:51.031003 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:51.031440 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:51.148980 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:19:51.149177 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:19:51.651640 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:19:52.124252 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:19:52.158458 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.127s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:52.199933 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Deleted allocations for instance 18a78f17-3543-48db-bb55-ec15bdf2b27a
May 27 23:19:52.628741 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:52.628943 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:52.629059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:52.629187 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:19:53.207002 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8e82c3cc-cf3a-4221-b1b8-9792de884473 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "18a78f17-3543-48db-bb55-ec15bdf2b27a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.838s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:53.645505 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:19:53.646947 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:19:53.647647 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:19:53.691537 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:19:53.691928 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13648MB free_disk=72.70391464233398GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:19:53.692077 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:53.692340 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:53.726418 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:54.421421 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:54.741851 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 5d91bc7d-00a1-44ff-9387-7fad59dc5679 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:19:54.741892 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:19:54.742056 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:19:53 up 48 min,  2 users,  load average: 2.52, 3.73, 3.93\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_5dda425dab8946dc926808806eeedced': '1', 'io_workload': '0'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:19:54.824655 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:19:54.825184 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:19:55.327574 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:19:55.833878 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:19:55.834224 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.142s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:55.834398 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:19:56.740035 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:56.740697 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:57.241941 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:19:57.787008 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:57.787396 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:57.790978 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:19:57.791455 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Claim successful on node np0000001565
May 27 23:19:58.740085 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:58.913415 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:19:58.913671 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:19:59.370553 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:19:59.370740 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:19:59.416048 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:19:59.423504 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:19:59.872225 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:19:59.923554 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.136s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:19:59.923953 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:20:00.413813 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:00.413995 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:00.416795 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:20:00.416914 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Claim successful on node np0000001565
May 27 23:20:00.428847 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:20:00.429497 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:20:00.429497 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:00.429497 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:00.496242 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b20fe60fc49e4fbeb9ea63bf3cf9e3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f40c2f26134e52b9d0ba5a2d3deb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:20:00.883571 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Successfully created port: fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:20:00.932040 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:20:01.095253 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:01.390542 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Successfully updated port: fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:20:01.434807 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:20:01.452640 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-03af5335-8c56-4729-a55c-0d7a87872d15 req-c66ca75c-c6a8-4212-9790-3f72a3184d78 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-changed-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:01.452735 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-03af5335-8c56-4729-a55c-0d7a87872d15 req-c66ca75c-c6a8-4212-9790-3f72a3184d78 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Refreshing instance network info cache due to event network-changed-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:20:01.452900 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-03af5335-8c56-4729-a55c-0d7a87872d15 req-c66ca75c-c6a8-4212-9790-3f72a3184d78 service nova] Acquiring lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:20:01.452994 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-03af5335-8c56-4729-a55c-0d7a87872d15 req-c66ca75c-c6a8-4212-9790-3f72a3184d78 service nova] Acquired lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:20:01.453111 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-03af5335-8c56-4729-a55c-0d7a87872d15 req-c66ca75c-c6a8-4212-9790-3f72a3184d78 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Refreshing network info cache for port fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:20:01.588243 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:20:01.588533 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:20:01.893410 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:20:01.955078 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-03af5335-8c56-4729-a55c-0d7a87872d15 req-c66ca75c-c6a8-4212-9790-3f72a3184d78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:02.017488 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-03af5335-8c56-4729-a55c-0d7a87872d15 req-c66ca75c-c6a8-4212-9790-3f72a3184d78 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:20:02.090839 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:20:02.146643 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-03af5335-8c56-4729-a55c-0d7a87872d15 req-c66ca75c-c6a8-4212-9790-3f72a3184d78 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:20:02.443747 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:20:02.444578 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:20:02.444778 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Creating image(s)
May 27 23:20:02.445153 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:02.445288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "/opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:02.445735 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "/opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:02.446017 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "8cbeb428711abbe0968b23a4e38c5b9520f0d5b3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:02.446310 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "8cbeb428711abbe0968b23a4e38c5b9520f0d5b3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:02.599080 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.185s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:02.599615 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:20:02.648899 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-03af5335-8c56-4729-a55c-0d7a87872d15 req-c66ca75c-c6a8-4212-9790-3f72a3184d78 service nova] Releasing lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:20:02.650762 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquired lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:20:02.650991 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:20:02.834901 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:20:02.837391 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:20:02.837702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3.part --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:02.929807 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3.part --force-share --output=json" returned: 0 in 0.092s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:02.930368 np0000001565 nova-compute[98289]: DEBUG nova.virt.images [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] 8516b847-9fd9-48c2-b837-bba3c5960969 was qcow2, converting to raw {{(pid=98289) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 23:20:02.930994 np0000001565 nova-compute[98289]: DEBUG nova.privsep.utils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98289) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 23:20:02.931279 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3.part /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3.converted {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:03.077465 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3.part /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3.converted" returned: 0 in 0.146s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:03.082199 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3.converted --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:03.107076 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:20:03.111755 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:20:03.111929 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:20:03.112551 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:03.112882 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:03.165842 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3.converted --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:03.166761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "8cbeb428711abbe0968b23a4e38c5b9520f0d5b3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.720s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:03.168067 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:20:03.170762 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:20:03.174234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:03.175750 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31823a44e786429f80ba607958f8b63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda425dab8946dc926808806eeedced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:20:03.193200 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0037330269997255527 future=<Future at 0x726e58601430 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:20:03.193400 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:20:03.194061 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Emitting event <LifecycleEvent: 1779923988.189259, 18a78f17-3543-48db-bb55-ec15bdf2b27a => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:20:03.194304 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] VM Stopped (Lifecycle Event)
May 27 23:20:03.234597 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:20:03.262568 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3 --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:03.263493 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "8cbeb428711abbe0968b23a4e38c5b9520f0d5b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:03.263493 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "8cbeb428711abbe0968b23a4e38c5b9520f0d5b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:03.264166 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:20:03.266913 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:20:03.267203 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:03.353634 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3 --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:03.357855 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3,backing_fmt=raw /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:03.418141 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:03.420491 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3,backing_fmt=raw /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk 1073741824" returned: 0 in 0.063s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:03.420980 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "8cbeb428711abbe0968b23a4e38c5b9520f0d5b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:03.421313 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3 --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:03.509237 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cbeb428711abbe0968b23a4e38c5b9520f0d5b3 --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:03.509662 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:20:03.509889 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:03.600974 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updating instance_info_cache with network_info: [{"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:20:03.606513 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:03.607139 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Cannot resize image /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:20:03.607230 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:20:03.607490 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Ensure instance console log exists: /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:20:03.607737 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:03.607959 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:03.608085 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:03.617561 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:20:03.624015 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Successfully created port: 2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:20:03.699675 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 18a78f17-3543-48db-bb55-ec15bdf2b27a] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:03.741007 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:04.076519 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Successfully updated port: 2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:20:04.103233 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Releasing lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:20:04.103574 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Instance network_info: |[{"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:20:04.105181 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Start _get_guest_xml network_info=[{"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T23:19:54Z,direct_url=<?>,disk_format='qcow2',id=8516b847-9fd9-48c2-b837-bba3c5960969,min_disk=0,min_ram=0,name='tempest-scenario-img--540013014',owner='30f40c2f26134e52b9d0ba5a2d3deb91',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T23:19:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '8516b847-9fd9-48c2-b837-bba3c5960969'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:20:04.107542 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:20:04.108950 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='8516b847-9fd9-48c2-b837-bba3c5960969', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1880108774', uuid='b4624032-0f35-4cef-90c7-fe07cd5f79ca'), owner=OwnerMeta(userid='b20fe60fc49e4fbeb9ea63bf3cf9e3d4', username='tempest-TestMinimumBasicScenario-365514479-project-member', projectid='30f40c2f26134e52b9d0ba5a2d3deb91', projectname='tempest-TestMinimumBasicScenario-365514479'), image=ImageMeta(id='8516b847-9fd9-48c2-b837-bba3c5960969', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779924004.1084285) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:20:04.109990 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:20:04.110301 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:20:04.111163 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:20:04.111561 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:20:04.112559 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:20:04.112884 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T23:19:54Z,direct_url=<?>,disk_format='qcow2',id=8516b847-9fd9-48c2-b837-bba3c5960969,min_disk=0,min_ram=0,name='tempest-scenario-img--540013014',owner='30f40c2f26134e52b9d0ba5a2d3deb91',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T23:19:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:20:04.113055 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:20:04.113165 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:20:04.113320 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:20:04.113462 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:20:04.113599 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:20:04.113796 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:20:04.113923 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:20:04.114070 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:20:04.114204 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:20:04.114379 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:20:04.123396 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Booting with volume snapshot 1aff24dd-4d2f-4b39-96bf-940b26952b43 at /dev/vda
May 27 23:20:04.129483 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d3468991-08dd-41cd-b5b3-57d6caa82775 req-a1f0f180-14cb-477a-b3e3-970c506883d7 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-changed-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:04.129655 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d3468991-08dd-41cd-b5b3-57d6caa82775 req-a1f0f180-14cb-477a-b3e3-970c506883d7 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Refreshing instance network info cache due to event network-changed-2f6f5eca-5af4-4876-9168-9ec33e015e84. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:20:04.129806 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d3468991-08dd-41cd-b5b3-57d6caa82775 req-a1f0f180-14cb-477a-b3e3-970c506883d7 service nova] Acquiring lock "refresh_cache-71eb1efd-6e32-40a5-bf36-9032930485b3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:20:04.129898 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d3468991-08dd-41cd-b5b3-57d6caa82775 req-a1f0f180-14cb-477a-b3e3-970c506883d7 service nova] Acquired lock "refresh_cache-71eb1efd-6e32-40a5-bf36-9032930485b3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:20:04.130019 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d3468991-08dd-41cd-b5b3-57d6caa82775 req-a1f0f180-14cb-477a-b3e3-970c506883d7 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Refreshing network info cache for port 2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:20:04.133751 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1880108774',display_name='tempest-TestMinimumBasicScenario-server-1880108774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testminimumbasicscenario-server-1880108774',id=74,image_ref='8516b847-9fd9-48c2-b837-bba3c5960969',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKZW0X7xH53FcY48Jp6l2IzGomeruRGVzt5oEHORxpHRwKNmBLJY3C0W/NixoN7X9cnD/GXNk/22w7zFffd2aVoqks0M7AYbdUb5Me51wfzhvp0ZV5D+U7tNyt9Hv0okg==',key_name='tempest-TestMinimumBasicScenario-926744344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30f40c2f26134e52b9d0ba5a2d3deb91',ramdisk_id='',reservation_id='r-soy00l0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8516b847-9fd9-48c2-b837-bba3c5960969',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-365514479',owner_user_name='tempest-TestMinimumBasicScenario-365514479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:20:01Z,user_data=None,user_id='b20fe60fc49e4fbeb9ea63bf3cf9e3d4',uuid=b4624032-0f35-4cef-90c7-fe07cd5f79ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:20:04.134517 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converting VIF {"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:20:04.135185 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ed:5e,bridge_name='br-int',has_traffic_filtering=True,id=fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4342c7-ea') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:20:04.135845 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'pci_devices' on Instance uuid b4624032-0f35-4cef-90c7-fe07cd5f79ca {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:20:04.578300 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "refresh_cache-71eb1efd-6e32-40a5-bf36-9032930485b3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:20:04.633197 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-d3468991-08dd-41cd-b5b3-57d6caa82775 req-a1f0f180-14cb-477a-b3e3-970c506883d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:04.638525 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] End _get_guest_xml xml=<domain type="qemu">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <uuid>b4624032-0f35-4cef-90c7-fe07cd5f79ca</uuid>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <name>instance-0000004a</name>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestMinimumBasicScenario-server-1880108774</nova:name>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:20:04</nova:creationTime>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <nova:image uuid="8516b847-9fd9-48c2-b837-bba3c5960969">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:properties/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:user uuid="b20fe60fc49e4fbeb9ea63bf3cf9e3d4">tempest-TestMinimumBasicScenario-365514479-project-member</nova:user>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:project uuid="30f40c2f26134e52b9d0ba5a2d3deb91">tempest-TestMinimumBasicScenario-365514479</nova:project>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="8516b847-9fd9-48c2-b837-bba3c5960969"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         <nova:port uuid="fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <system>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <entry name="serial">b4624032-0f35-4cef-90c7-fe07cd5f79ca</entry>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <entry name="uuid">b4624032-0f35-4cef-90c7-fe07cd5f79ca</entry>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     </system>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <os>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   </os>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <features>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   </features>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   <devices>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     </disk>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk.config"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     </disk>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:83:ed:5e"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <target dev="tapfa4342c7-ea"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     </interface>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/console.log" append="off"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     </serial>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <video>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     </video>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     </rng>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:   </devices>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]: </domain>
May 27 23:20:04.638525 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:20:04.640294 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Preparing to wait for external event network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:20:04.640294 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:04.640294 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:04.640294 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:04.640294 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1880108774',display_name='tempest-TestMinimumBasicScenario-server-1880108774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testminimumbasicscenario-server-1880108774',id=74,image_ref='8516b847-9fd9-48c2-b837-bba3c5960969',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKZW0X7xH53FcY48Jp6l2IzGomeruRGVzt5oEHORxpHRwKNmBLJY3C0W/NixoN7X9cnD/GXNk/22w7zFffd2aVoqks0M7AYbdUb5Me51wfzhvp0ZV5D+U7tNyt9Hv0okg==',key_name='tempest-TestMinimumBasicScenario-926744344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30f40c2f26134e52b9d0ba5a2d3deb91',ramdisk_id='',reservation_id='r-soy00l0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8516b847-9fd9-48c2-b837-bba3c5960969',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-365514479',owner_user_name='tempest-TestMinimumBasicScenario-365514479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:20:01Z,user_data=None,user_id='b20fe60fc49e4fbeb9ea63bf3cf9e3d4',uuid=b4624032-0f35-4cef-90c7-fe07cd5f79ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:20:04.640294 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converting VIF {"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:20:04.640737 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ed:5e,bridge_name='br-int',has_traffic_filtering=True,id=fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4342c7-ea') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:20:04.641015 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ed:5e,bridge_name='br-int',has_traffic_filtering=True,id=fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4342c7-ea') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:20:04.641298 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:04.641667 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:04.642014 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:20:04.642631 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:04.642816 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fbd637c-c74d-5946-aad8-68a278846c91', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:04.649743 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:04.650834 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:20:04.652303 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:04.652473 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa4342c7-ea, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:04.652813 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa4342c7-ea, col_values=(('qos', UUID('c27c4e4c-9ec2-47ea-9b70-e0e0496c80df')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:04.653001 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa4342c7-ea, col_values=(('external_ids', {'iface-id': 'fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:ed:5e', 'vm-uuid': 'b4624032-0f35-4cef-90c7-fe07cd5f79ca'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:04.653754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:04.655144 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:20:04.658826 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:04.659609 np0000001565 nova-compute[98289]: INFO os_vif [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ed:5e,bridge_name='br-int',has_traffic_filtering=True,id=fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4342c7-ea')
May 27 23:20:04.687749 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d3468991-08dd-41cd-b5b3-57d6caa82775 req-a1f0f180-14cb-477a-b3e3-970c506883d7 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:20:04.796410 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-d3468991-08dd-41cd-b5b3-57d6caa82775 req-a1f0f180-14cb-477a-b3e3-970c506883d7 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:20:05.298141 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d3468991-08dd-41cd-b5b3-57d6caa82775 req-a1f0f180-14cb-477a-b3e3-970c506883d7 service nova] Releasing lock "refresh_cache-71eb1efd-6e32-40a5-bf36-9032930485b3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:20:05.298687 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquired lock "refresh_cache-71eb1efd-6e32-40a5-bf36-9032930485b3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:20:05.298900 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:20:05.834730 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:20:05.835018 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:20:05.835287 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:20:05.835529 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:20:05.835877 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.29 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:20:05.861003 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:20:05.994082 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:06.109738 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Updating instance_info_cache with network_info: [{"id": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "address": "fa:16:3e:da:2f:e4", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f6f5eca-5a", "ovs_interfaceid": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:20:06.123865 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:20:06.124466 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:20:06.124749 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:20:06.125037 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:20:06.173491 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:20:06.173607 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:20:06.173696 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No VIF found with MAC fa:16:3e:83:ed:5e, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:20:06.174075 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Using config drive
May 27 23:20:06.611565 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Releasing lock "refresh_cache-71eb1efd-6e32-40a5-bf36-9032930485b3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:20:06.611984 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Instance network_info: |[{"id": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "address": "fa:16:3e:da:2f:e4", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f6f5eca-5a", "ovs_interfaceid": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:20:06.678636 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:06.785975 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Creating config drive at /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk.config
May 27 23:20:06.789066 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3wys4kdb {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:06.848069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3wys4kdb" returned: 0 in 0.059s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:07.229069 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:07.248043 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:07.249083 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:07.346936 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:07.386192 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e6de5645-753a-4f84-b8b3-2335cad02461 req-c5280c39-a6bf-4995-bfac-7cdd8dd61cc6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:07.386679 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e6de5645-753a-4f84-b8b3-2335cad02461 req-c5280c39-a6bf-4995-bfac-7cdd8dd61cc6 service nova] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:07.386877 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e6de5645-753a-4f84-b8b3-2335cad02461 req-c5280c39-a6bf-4995-bfac-7cdd8dd61cc6 service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:07.387012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e6de5645-753a-4f84-b8b3-2335cad02461 req-c5280c39-a6bf-4995-bfac-7cdd8dd61cc6 service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:07.387146 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e6de5645-753a-4f84-b8b3-2335cad02461 req-c5280c39-a6bf-4995-bfac-7cdd8dd61cc6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Processing event network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:20:07.547294 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:07.548630 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:07.550408 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:07.558054 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:20:07.569076 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:20:07.569352 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:07.588309 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:07.633295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:20:07.633771 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:20:07.642908 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:20:07.644609 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe35:d3cc', 'fe80::b098:84ff:fe18:24bd', 'fe80::fc16:3eff:fe83:ed5e', 'fe80::bc5c:41ff:fe41:ca69'] 
May 27 23:20:07.644737 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:20:07.644849 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:20:07.645075 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:20:07.645320 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Updating existing volume attachment record: 0989a984-8570-4bda-a600-61f1b64a925c {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:20:07.956381 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924007.955851, b4624032-0f35-4cef-90c7-fe07cd5f79ca => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:20:07.956381 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] VM Started (Lifecycle Event)
May 27 23:20:07.958358 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:20:07.961286 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:20:07.963990 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Instance spawned successfully.
May 27 23:20:07.964744 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:20:08.123985 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:20:08.124093 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:20:08.124370 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:20:08.462458 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:08.463991 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:20:08.473036 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:20:08.473191 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:20:08.473449 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:20:08.473662 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:20:08.473921 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:20:08.474172 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:20:08.757382 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:20:08.966106 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:20:08.966412 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924008.9662116, b4624032-0f35-4cef-90c7-fe07cd5f79ca => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:20:08.966523 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] VM Paused (Lifecycle Event)
May 27 23:20:08.978551 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Took 6.53 seconds to spawn the instance on the hypervisor.
May 27 23:20:08.978713 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:09.426364 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:09.439248 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0548eef1-8226-4c4e-ab22-25be62554dfa req-88e157de-69e3-4979-a9fa-44037673a25e service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:09.439718 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0548eef1-8226-4c4e-ab22-25be62554dfa req-88e157de-69e3-4979-a9fa-44037673a25e service nova] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:09.439907 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0548eef1-8226-4c4e-ab22-25be62554dfa req-88e157de-69e3-4979-a9fa-44037673a25e service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:09.440034 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0548eef1-8226-4c4e-ab22-25be62554dfa req-88e157de-69e3-4979-a9fa-44037673a25e service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:09.440178 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0548eef1-8226-4c4e-ab22-25be62554dfa req-88e157de-69e3-4979-a9fa-44037673a25e service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] No waiting events found dispatching network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:09.440301 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-0548eef1-8226-4c4e-ab22-25be62554dfa req-88e157de-69e3-4979-a9fa-44037673a25e service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received unexpected event network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 for instance with vm_state active and task_state None.
May 27 23:20:09.468701 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:09.470583 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924009.470364, b4624032-0f35-4cef-90c7-fe07cd5f79ca => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:20:09.470812 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] VM Resumed (Lifecycle Event)
May 27 23:20:09.487347 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Took 11.74 seconds to build instance.
May 27 23:20:09.654862 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:09.733604 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:20:09.734467 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:20:09.734675 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Creating image(s)
May 27 23:20:09.734988 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:20:09.735112 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Ensure instance console log exists: /opt/stack/data/nova/instances/71eb1efd-6e32-40a5-bf36-9032930485b3/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:20:09.735322 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:09.735486 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:09.735603 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:09.736035 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Start _get_guest_xml network_info=[{"id": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "address": "fa:16:3e:da:2f:e4", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f6f5eca-5a", "ovs_interfaceid": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-27T23:19:56Z,direct_url=<?>,disk_format='raw',id=b20271a2-eae6-4802-b5f9-7ca14958a89d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-618869829',owner='5dda425dab8946dc926808806eeedced',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-27T23:19:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0989a984-8570-4bda-a600-61f1b64a925c', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92a1d44-754f-420d-b365-586328b93551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '71eb1efd-6e32-40a5-bf36-9032930485b3', 'attached_at': '', 'detached_at': '', 'volume_id': 'd92a1d44-754f-420d-b365-586328b93551', 'serial': 'd92a1d44-754f-420d-b365-586328b93551'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:20:09.738074 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:20:09.739033 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-1996360308', uuid='71eb1efd-6e32-40a5-bf36-9032930485b3'), owner=OwnerMeta(userid='31823a44e786429f80ba607958f8b63e', username='tempest-TestVolumeBootPattern-314561297-project-member', projectid='5dda425dab8946dc926808806eeedced', projectname='tempest-TestVolumeBootPattern-314561297'), image=ImageMeta(id='b20271a2-eae6-4802-b5f9-7ca14958a89d', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "address": "fa:16:3e:da:2f:e4", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f6f5eca-5a", "ovs_interfaceid": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779924009.738754) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:20:09.739983 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:20:09.740265 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:20:09.741077 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:20:09.741239 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:20:09.742110 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:20:09.742386 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-27T23:19:56Z,direct_url=<?>,disk_format='raw',id=b20271a2-eae6-4802-b5f9-7ca14958a89d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-618869829',owner='5dda425dab8946dc926808806eeedced',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-27T23:19:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:20:09.742517 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:20:09.742614 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:20:09.742819 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:20:09.742904 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:20:09.742997 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:20:09.743143 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:20:09.743237 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:20:09.743362 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:20:09.743462 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:20:09.743573 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:20:09.752496 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:20:09.752780 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92a1d44-754f-420d-b365-586328b93551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:20:09.752960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:20:09.753376 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:20:09.753549 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92a1d44-754f-420d-b365-586328b93551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:20:09.765768 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:20:09.766364 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:20:09.766752 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:20:09.766971 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:20:09.767270 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:20:09.767462 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:20:09.777480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:20:09.777480 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:09.780977 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:20:09.780977 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:09.787022 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551] added
May 27 23:20:09.787022 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:20:09.787022 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:20:09.787022 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:20:09.787022 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:20:09.787022 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:20:09.787022 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:09.787206 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:20:09.787429 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0204(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:20:09.787603 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:20:09.792405 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551] added
May 27 23:20:09.792405 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:20:09.792405 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:20:09.792405 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:20:09.792405 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:20:09.792405 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:20:09.792405 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:09.792658 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:20:09.792718 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:20:09.792816 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:20:09.973001 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:09.974743 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:20:09.988642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.248s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:10.788046 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:20:10.793407 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:20:10.800728 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:20:10.800728 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:20:10.807397 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:20:10.807397 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:10.812171 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:10.818828 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:10.824352 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.824352 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.824352 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:20:10.824557 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.824557 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.824557 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:20:10.831440 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.831440 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.831440 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:20:10.831659 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.831659 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.831659 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:20:10.856428 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551, portal: 192.168.40.100,3260]
May 27 23:20:10.856428 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551, portal: 192.168.40.100,3260] successful.
May 27 23:20:10.856428 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:10.869125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:10.873905 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551, portal: 192.168.50.100,3260]
May 27 23:20:10.873905 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551, portal: 192.168.50.100,3260] successful.
May 27 23:20:10.873905 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:10.882701 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.882701 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.882701 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:10.882701 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:10.882701 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:20:10.882891 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.882891 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.882891 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:10.882891 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:10.882891 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:20:10.883126 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.116s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:20:10.883225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:20:10.884186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:10.884469 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('7', '-', '-', 0) found on session 199 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:20:10.884590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:20:10.895438 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.895438 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.895438 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:10.895438 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:10.895438 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:20:10.895758 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.895758 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:10.895758 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:10.895758 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:10.895758 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:20:10.896115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:20:10.896239 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:20:10.896768 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('8', '-', '-', 0) found on session 200 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:20:10.896866 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:20:10.903703 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 199 and hctl ['7', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:20:10.913853 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 200 and hctl ['8', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:20:11.802763 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:11.803319 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:11.901835 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 199 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:20:11.901948 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92a1d44-754f-420d-b365-586328b93551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:20:11.911787 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 200 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:20:11.912037 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd92a1d44-754f-420d-b365-586328b93551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:20:12.306183 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'flavor' on Instance uuid b4624032-0f35-4cef-90c7-fe07cd5f79ca {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:20:12.767607 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:20:13.311202 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:13.792000 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Found WWN 330000000022cdf60 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:20:13.792307 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.039s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:20:13.792522 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== connect_volume: return (4039ms) {'type': 'block', 'scsi_wwn': '330000000022cdf60', 'path': '/dev/dm-0', 'multipath_id': '330000000022cdf60'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:20:13.792665 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000022cdf60', 'path': '/dev/dm-0', 'multipath_id': '330000000022cdf60'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:20:14.297573 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1996360308',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1996360308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-image-snapshot-server-1996360308',id=75,image_ref='b20271a2-eae6-4802-b5f9-7ca14958a89d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+OBzWhuGKgvUDQY50JETEMqK21nDeNgrxCT6uoewn48NEtZGGa+onqx2CGiyyewyByPiXjEqhiw5Nnr0Xl8qH/kfRVm7OWA4Thv6Bzy9M9cLAIhknU8abqFFP+b1oPeg==',key_name='tempest-keypair-1782601871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-yaiqw3or',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-314561297',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=71eb1efd-6e32-40a5-bf36-9032930485b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "address": "fa:16:3e:da:2f:e4", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f6f5eca-5a", "ovs_interfaceid": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:20:14.297809 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "address": "fa:16:3e:da:2f:e4", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f6f5eca-5a", "ovs_interfaceid": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:20:14.298434 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f6f5eca-5af4-4876-9168-9ec33e015e84,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f6f5eca-5a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:20:14.298990 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'pci_devices' on Instance uuid 71eb1efd-6e32-40a5-bf36-9032930485b3 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:20:14.387184 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:14.388917 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:14.388917 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Attaching volume 6a861557-799c-4558-8349-f8b87f6c1b6f to /dev/vdb
May 27 23:20:14.424345 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:20:14.429186 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:14.436612 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:20:14.461733 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:14.517627 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:20:14.518162 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:20:14.526659 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:20:14.527788 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe35:d3cc', 'fe80::b098:84ff:fe18:24bd', 'fe80::fc16:3eff:fe83:ed5e', 'fe80::bc5c:41ff:fe41:ca69'] 
May 27 23:20:14.528087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:20:14.528292 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:20:14.528651 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:20:14.529023 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updating existing volume attachment record: 91986c53-f59a-4e42-8a76-b2a79fe87c33 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:20:14.655479 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:14.802391 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] End _get_guest_xml xml=<domain type="qemu">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <uuid>71eb1efd-6e32-40a5-bf36-9032930485b3</uuid>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <name>instance-0000004b</name>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1996360308</nova:name>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:20:09</nova:creationTime>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:diskFormat>raw</nova:diskFormat>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:           <nova:property name="img_bdm_v2">True</nova:property>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:user uuid="31823a44e786429f80ba607958f8b63e">tempest-TestVolumeBootPattern-314561297-project-member</nova:user>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:project uuid="5dda425dab8946dc926808806eeedced">tempest-TestVolumeBootPattern-314561297</nova:project>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid=""/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         <nova:port uuid="2f6f5eca-5af4-4876-9168-9ec33e015e84">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <system>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <entry name="serial">71eb1efd-6e32-40a5-bf36-9032930485b3</entry>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <entry name="uuid">71eb1efd-6e32-40a5-bf36-9032930485b3</entry>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     </system>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <os>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   </os>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <features>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   </features>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   <devices>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/71eb1efd-6e32-40a5-bf36-9032930485b3/disk.config"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     </disk>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <alias name="ua-d92a1d44-754f-420d-b365-586328b93551"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <serial>d92a1d44-754f-420d-b365-586328b93551</serial>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     </disk>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:da:2f:e4"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <target dev="tap2f6f5eca-5a"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     </interface>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/71eb1efd-6e32-40a5-bf36-9032930485b3/console.log" append="off"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     </serial>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <video>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     </video>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     </rng>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:   </devices>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]: </domain>
May 27 23:20:14.802391 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:20:14.805920 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Preparing to wait for external event network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:20:14.805920 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:14.805920 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:14.805920 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:14.805920 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1996360308',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1996360308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-image-snapshot-server-1996360308',id=75,image_ref='b20271a2-eae6-4802-b5f9-7ca14958a89d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+OBzWhuGKgvUDQY50JETEMqK21nDeNgrxCT6uoewn48NEtZGGa+onqx2CGiyyewyByPiXjEqhiw5Nnr0Xl8qH/kfRVm7OWA4Thv6Bzy9M9cLAIhknU8abqFFP+b1oPeg==',key_name='tempest-keypair-1782601871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-yaiqw3or',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-314561297',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=71eb1efd-6e32-40a5-bf36-9032930485b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "address": "fa:16:3e:da:2f:e4", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f6f5eca-5a", "ovs_interfaceid": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:20:14.805920 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "address": "fa:16:3e:da:2f:e4", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f6f5eca-5a", "ovs_interfaceid": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:20:14.805920 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f6f5eca-5af4-4876-9168-9ec33e015e84,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f6f5eca-5a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:20:14.806289 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f6f5eca-5af4-4876-9168-9ec33e015e84,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f6f5eca-5a') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:20:14.806633 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:14.806784 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:14.807117 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:20:14.807811 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:14.808052 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7128bc99-6467-5beb-bf96-39ed88565e3b', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:14.808862 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:14.809647 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:20:14.811612 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:14.811773 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f6f5eca-5a, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:14.812176 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f6f5eca-5a, col_values=(('qos', UUID('50ec5c85-fdfc-45ef-87d7-6490011e61ed')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:14.812367 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f6f5eca-5a, col_values=(('external_ids', {'iface-id': '2f6f5eca-5af4-4876-9168-9ec33e015e84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:2f:e4', 'vm-uuid': '71eb1efd-6e32-40a5-bf36-9032930485b3'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:14.813969 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:14.815107 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:20:14.832318 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:14.833418 np0000001565 nova-compute[98289]: INFO os_vif [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f6f5eca-5af4-4876-9168-9ec33e015e84,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f6f5eca-5a')
May 27 23:20:15.079025 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:20:15.079025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a861557-799c-4558-8349-f8b87f6c1b6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:20:15.079025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:20:15.079025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:20:15.079025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a861557-799c-4558-8349-f8b87f6c1b6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:20:15.089642 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:20:15.090177 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:20:15.090689 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:20:15.090956 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:20:15.091266 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:20:15.091446 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:20:15.100723 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:20:15.100723 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:15.106763 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:20:15.106763 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:15.112966 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f] added
May 27 23:20:15.112966 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:20:15.112966 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:20:15.112966 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:20:15.112966 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:20:15.112966 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:20:15.112966 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:15.113226 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:20:15.113430 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0228(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:20:15.113588 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:20:15.119921 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f] added
May 27 23:20:15.119921 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:20:15.119921 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:20:15.119921 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:20:15.119921 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:20:15.119921 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:20:15.119921 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:15.120112 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:20:15.120281 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:20:15.120459 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:20:16.113946 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:20:16.120882 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:20:16.128155 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:20:16.128155 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:20:16.136734 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:20:16.136734 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:16.146162 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:16.151654 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:16.160736 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.160736 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.160736 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.160736 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.160736 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:20:16.160964 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.160964 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.160964 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.160964 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.160964 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:20:16.168458 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.168458 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.168458 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.168458 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.168458 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:20:16.168628 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.168628 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.168628 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.168628 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.168628 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:20:16.195611 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f, portal: 192.168.40.100,3260]
May 27 23:20:16.195611 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f, portal: 192.168.40.100,3260] successful.
May 27 23:20:16.195611 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:16.208972 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:16.214398 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f, portal: 192.168.50.100,3260]
May 27 23:20:16.214398 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f, portal: 192.168.50.100,3260] successful.
May 27 23:20:16.214398 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:16.223761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.223761 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.223761 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.223761 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.223761 np0000001565 nova-compute[98289]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:16.223761 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:16.223761 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:20:16.223930 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.223930 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.223930 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.223930 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.223930 np0000001565 nova-compute[98289]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:16.223930 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:16.223930 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:20:16.224224 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:20:16.224384 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:20:16.225346 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] HCTL ('9', '-', '-', 0) found on session 201 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:20:16.225534 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:20:16.226933 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:16.240360 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching for a device in session 201 and hctl ['9', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:20:16.245240 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.245240 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.245240 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.245240 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.245240 np0000001565 nova-compute[98289]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:16.245240 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:16.245240 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:20:16.245476 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.245476 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:16.245476 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.245476 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:16.245476 np0000001565 nova-compute[98289]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:16.245476 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:16.245476 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:20:16.245712 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:20:16.245840 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:20:16.246684 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] HCTL ('10', '-', '-', 0) found on session 202 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:20:16.246790 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:20:16.260771 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching for a device in session 202 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:20:16.260771 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6a861557-799c-4558-8349-f8b87f6c1b6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:20:16.352148 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:20:16.352233 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:20:16.352309 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No VIF found with MAC fa:16:3e:da:2f:e4, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:20:16.352949 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Using config drive
May 27 23:20:16.859348 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:16.978055 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Creating config drive at /opt/stack/data/nova/instances/71eb1efd-6e32-40a5-bf36-9032930485b3/disk.config
May 27 23:20:16.982080 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/71eb1efd-6e32-40a5-bf36-9032930485b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyn8umhop {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:17.038758 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/71eb1efd-6e32-40a5-bf36-9032930485b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyn8umhop" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:17.241165 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Searching for a device in session 201 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:20:17.241643 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a861557-799c-4558-8349-f8b87f6c1b6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:20:17.425960 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:17.446567 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:17.565966 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:17.577422 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:17.578234 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:17.592297 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3e955796-cb01-4d2a-99b7-6e65f72ae04c req-06a65091-16d7-4745-9b02-3d7e34779716 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:17.594190 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e955796-cb01-4d2a-99b7-6e65f72ae04c req-06a65091-16d7-4745-9b02-3d7e34779716 service nova] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:17.594510 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e955796-cb01-4d2a-99b7-6e65f72ae04c req-06a65091-16d7-4745-9b02-3d7e34779716 service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:17.594662 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3e955796-cb01-4d2a-99b7-6e65f72ae04c req-06a65091-16d7-4745-9b02-3d7e34779716 service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:17.594943 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3e955796-cb01-4d2a-99b7-6e65f72ae04c req-06a65091-16d7-4745-9b02-3d7e34779716 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Processing event network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:20:18.112567 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Found WWN 33000000044f7e22c for multipath device dm-6 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:20:18.113018 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:20:18.113253 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '33000000044f7e22c', 'path': '/dev/dm-6', 'multipath_id': '33000000044f7e22c'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:20:18.113454 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000044f7e22c', 'path': '/dev/dm-6', 'multipath_id': '33000000044f7e22c'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:20:18.116907 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'flavor' on Instance uuid b4624032-0f35-4cef-90c7-fe07cd5f79ca {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:20:18.157345 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924018.1568582, 71eb1efd-6e32-40a5-bf36-9032930485b3 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:20:18.157936 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:20:18.158130 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] VM Started (Lifecycle Event)
May 27 23:20:18.162373 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:20:18.165710 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Instance spawned successfully.
May 27 23:20:18.166037 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:20:18.170572 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:20:18.170857 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:20:18.620404 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Attempting to attach volume 6a861557-799c-4558-8349-f8b87f6c1b6f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:20:18.621750 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:20:18.621750 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:20:18.621750 np0000001565 nova-compute[98289]:   <alias name="ua-6a861557-799c-4558-8349-f8b87f6c1b6f"/>
May 27 23:20:18.621750 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-6"/>
May 27 23:20:18.621750 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:20:18.621750 np0000001565 nova-compute[98289]:   <serial>6a861557-799c-4558-8349-f8b87f6c1b6f</serial>
May 27 23:20:18.621750 np0000001565 nova-compute[98289]: </disk>
May 27 23:20:18.621750 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:20:18.660367 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:18.663055 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:20:18.679961 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Took 8.95 seconds to spawn the instance on the hypervisor.
May 27 23:20:18.680125 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:19.165217 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:20:19.165535 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924019.1653218, 71eb1efd-6e32-40a5-bf36-9032930485b3 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:20:19.165708 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] VM Paused (Lifecycle Event)
May 27 23:20:19.190531 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Took 18.81 seconds to build instance.
May 27 23:20:19.430121 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:19.669463 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:19.674654 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8b1f1da2-1506-44aa-8165-6bab2be34dbf req-8487ca48-939f-4f46-a6bb-71b8ef27ebbc service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:19.674956 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8b1f1da2-1506-44aa-8165-6bab2be34dbf req-8487ca48-939f-4f46-a6bb-71b8ef27ebbc service nova] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:19.675125 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8b1f1da2-1506-44aa-8165-6bab2be34dbf req-8487ca48-939f-4f46-a6bb-71b8ef27ebbc service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:19.675246 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-8b1f1da2-1506-44aa-8165-6bab2be34dbf req-8487ca48-939f-4f46-a6bb-71b8ef27ebbc service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:19.675480 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-8b1f1da2-1506-44aa-8165-6bab2be34dbf req-8487ca48-939f-4f46-a6bb-71b8ef27ebbc service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] No waiting events found dispatching network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:19.675602 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-8b1f1da2-1506-44aa-8165-6bab2be34dbf req-8487ca48-939f-4f46-a6bb-71b8ef27ebbc service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received unexpected event network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 for instance with vm_state active and task_state None.
May 27 23:20:19.676446 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924019.6756308, 71eb1efd-6e32-40a5-bf36-9032930485b3 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:20:19.676643 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] VM Resumed (Lifecycle Event)
May 27 23:20:19.692596 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-459251c6-6f62-44df-9718-76620e4129f3 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.322s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:19.829442 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:20.179573 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:20.181551 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:20:20.258207 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:20:20.258374 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:20:20.258517 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:20:20.258671 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] No VIF found with MAC fa:16:3e:83:ed:5e, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:20:21.734317 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-36539c81-ddaa-4293-9a21-8552f6fa0926 req-83f28971-22e4-47da-8ae7-01c693fb06d0 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-changed-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:21.736211 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-36539c81-ddaa-4293-9a21-8552f6fa0926 req-83f28971-22e4-47da-8ae7-01c693fb06d0 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Refreshing instance network info cache due to event network-changed-2f6f5eca-5af4-4876-9168-9ec33e015e84. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:20:21.736211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-36539c81-ddaa-4293-9a21-8552f6fa0926 req-83f28971-22e4-47da-8ae7-01c693fb06d0 service nova] Acquiring lock "refresh_cache-71eb1efd-6e32-40a5-bf36-9032930485b3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:20:21.736211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-36539c81-ddaa-4293-9a21-8552f6fa0926 req-83f28971-22e4-47da-8ae7-01c693fb06d0 service nova] Acquired lock "refresh_cache-71eb1efd-6e32-40a5-bf36-9032930485b3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:20:21.736211 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-36539c81-ddaa-4293-9a21-8552f6fa0926 req-83f28971-22e4-47da-8ae7-01c693fb06d0 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Refreshing network info cache for port 2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:20:21.875485 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d2c17803-94cd-4383-a683-0bdd2e3eae02 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.488s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:22.240218 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-36539c81-ddaa-4293-9a21-8552f6fa0926 req-83f28971-22e4-47da-8ae7-01c693fb06d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:22.540996 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-36539c81-ddaa-4293-9a21-8552f6fa0926 req-83f28971-22e4-47da-8ae7-01c693fb06d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:22.708958 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-36539c81-ddaa-4293-9a21-8552f6fa0926 req-83f28971-22e4-47da-8ae7-01c693fb06d0 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Updated VIF entry in instance network info cache for port 2f6f5eca-5af4-4876-9168-9ec33e015e84. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:20:22.710147 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-36539c81-ddaa-4293-9a21-8552f6fa0926 req-83f28971-22e4-47da-8ae7-01c693fb06d0 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Updating instance_info_cache with network_info: [{"id": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "address": "fa:16:3e:da:2f:e4", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f6f5eca-5a", "ovs_interfaceid": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:20:23.211347 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-36539c81-ddaa-4293-9a21-8552f6fa0926 req-83f28971-22e4-47da-8ae7-01c693fb06d0 service nova] Releasing lock "refresh_cache-71eb1efd-6e32-40a5-bf36-9032930485b3" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:20:23.790544 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c08fdf7d-bbf4-4a28-9500-f033a013185d req-60fc12e1-26a8-495e-bf9c-e8a7f7bdb6e3 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-changed-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:23.790815 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c08fdf7d-bbf4-4a28-9500-f033a013185d req-60fc12e1-26a8-495e-bf9c-e8a7f7bdb6e3 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Refreshing instance network info cache due to event network-changed-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:20:23.791086 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c08fdf7d-bbf4-4a28-9500-f033a013185d req-60fc12e1-26a8-495e-bf9c-e8a7f7bdb6e3 service nova] Acquiring lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:20:23.791432 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c08fdf7d-bbf4-4a28-9500-f033a013185d req-60fc12e1-26a8-495e-bf9c-e8a7f7bdb6e3 service nova] Acquired lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:20:23.791541 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c08fdf7d-bbf4-4a28-9500-f033a013185d req-60fc12e1-26a8-495e-bf9c-e8a7f7bdb6e3 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Refreshing network info cache for port fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:20:24.135138 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5d97ce2b-5941-42d8-93d5-66887b424d66 req-b8d819f9-6961-495f-a651-c2a82abf90a6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-changed-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:24.135583 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5d97ce2b-5941-42d8-93d5-66887b424d66 req-b8d819f9-6961-495f-a651-c2a82abf90a6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Refreshing instance network info cache due to event network-changed-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:20:24.135742 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5d97ce2b-5941-42d8-93d5-66887b424d66 req-b8d819f9-6961-495f-a651-c2a82abf90a6 service nova] Acquiring lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:20:24.296676 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-c08fdf7d-bbf4-4a28-9500-f033a013185d req-60fc12e1-26a8-495e-bf9c-e8a7f7bdb6e3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:24.431309 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:24.594298 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-c08fdf7d-bbf4-4a28-9500-f033a013185d req-60fc12e1-26a8-495e-bf9c-e8a7f7bdb6e3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:24.710630 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c08fdf7d-bbf4-4a28-9500-f033a013185d req-60fc12e1-26a8-495e-bf9c-e8a7f7bdb6e3 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updated VIF entry in instance network info cache for port fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:20:24.711021 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-c08fdf7d-bbf4-4a28-9500-f033a013185d req-60fc12e1-26a8-495e-bf9c-e8a7f7bdb6e3 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updating instance_info_cache with network_info: [{"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:20:24.839145 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:25.213288 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c08fdf7d-bbf4-4a28-9500-f033a013185d req-60fc12e1-26a8-495e-bf9c-e8a7f7bdb6e3 service nova] Releasing lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:20:25.213779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5d97ce2b-5941-42d8-93d5-66887b424d66 req-b8d819f9-6961-495f-a651-c2a82abf90a6 service nova] Acquired lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:20:25.214129 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5d97ce2b-5941-42d8-93d5-66887b424d66 req-b8d819f9-6961-495f-a651-c2a82abf90a6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Refreshing network info cache for port fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:20:25.716643 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5d97ce2b-5941-42d8-93d5-66887b424d66 req-b8d819f9-6961-495f-a651-c2a82abf90a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:26.001342 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5d97ce2b-5941-42d8-93d5-66887b424d66 req-b8d819f9-6961-495f-a651-c2a82abf90a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:26.122122 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5d97ce2b-5941-42d8-93d5-66887b424d66 req-b8d819f9-6961-495f-a651-c2a82abf90a6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updated VIF entry in instance network info cache for port fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:20:26.122883 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5d97ce2b-5941-42d8-93d5-66887b424d66 req-b8d819f9-6961-495f-a651-c2a82abf90a6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updating instance_info_cache with network_info: [{"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:20:26.625052 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5d97ce2b-5941-42d8-93d5-66887b424d66 req-b8d819f9-6961-495f-a651-c2a82abf90a6 service nova] Releasing lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:20:29.433122 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:29.839713 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:34.434999 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:34.840454 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:39.435948 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:39.841792 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:42.719204 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:42.719754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:42.719754 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Rebooting instance
May 27 23:20:43.271038 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:20:43.271268 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquired lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:20:43.271481 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:20:43.773546 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:44.072971 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:44.218281 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updating instance_info_cache with network_info: [{"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:20:44.437059 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:44.720102 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Releasing lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:20:44.842812 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:45.223398 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:48.654658 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:48.660535 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:48.672359 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:48.682856 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:48.700575 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:48.837427 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b24d8841-5a17-44a0-8823-91ba04cf6a15 req-c6bb90fe-a27a-475a-9574-b29797c60d28 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:48.837427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b24d8841-5a17-44a0-8823-91ba04cf6a15 req-c6bb90fe-a27a-475a-9574-b29797c60d28 service nova] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:48.837427 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b24d8841-5a17-44a0-8823-91ba04cf6a15 req-c6bb90fe-a27a-475a-9574-b29797c60d28 service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:48.837924 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b24d8841-5a17-44a0-8823-91ba04cf6a15 req-c6bb90fe-a27a-475a-9574-b29797c60d28 service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:48.837924 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b24d8841-5a17-44a0-8823-91ba04cf6a15 req-c6bb90fe-a27a-475a-9574-b29797c60d28 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] No waiting events found dispatching network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:48.838078 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-b24d8841-5a17-44a0-8823-91ba04cf6a15 req-c6bb90fe-a27a-475a-9574-b29797c60d28 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received unexpected event network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 for instance with vm_state active and task_state reboot_started.
May 27 23:20:48.897036 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:49.013462 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999628974999723 future=<Future at 0x726e581e6600 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:20:49.013853 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999166054999932 future=<Future at 0x726e581e6600 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:20:49.013980 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998992959999669 future=<Future at 0x726e581e6600 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:20:49.242938 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Instance shutdown successfully.
May 27 23:20:49.438692 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:49.652625 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:49.674389 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:49.768594 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:49.843513 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:49.995909 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:49.998842 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:50.004891 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:50.005453 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:50.019901 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:50.386709 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Removed pending STOPPED event for b4624032-0f35-4cef-90c7-fe07cd5f79ca due to new event <LifecycleEvent: 1779924050.3862932, b4624032-0f35-4cef-90c7-fe07cd5f79ca => Resumed> {{(pid=98289) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 23:20:50.387172 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924050.3862932, b4624032-0f35-4cef-90c7-fe07cd5f79ca => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:20:50.387313 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] VM Resumed (Lifecycle Event)
May 27 23:20:50.390047 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Instance running successfully.
May 27 23:20:50.390439 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Instance soft rebooted successfully.
May 27 23:20:50.390624 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:50.889974 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:50.890792 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:50.890997 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:50.891197 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:50.891494 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:50.891596 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] No waiting events found dispatching network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:50.891820 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received unexpected event network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 for instance with vm_state active and task_state None.
May 27 23:20:50.892044 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:50.892269 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:50.892545 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:50.892857 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:50.893023 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] No waiting events found dispatching network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:50.893227 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received unexpected event network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 for instance with vm_state active and task_state None.
May 27 23:20:50.893474 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:50.893642 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:50.894008 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:50.894153 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:50.894320 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] No waiting events found dispatching network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:50.894488 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-7cded288-ca15-47bd-9c68-526bbd8dd394 req-edb84211-29e7-4a72-8405-0edd92a3c43c service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received unexpected event network-vif-plugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 for instance with vm_state active and task_state None.
May 27 23:20:50.896117 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:20:50.897611 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6e63635a-e798-44d5-a596-95bc6709e172 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.178s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:51.399234 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924051.398961, b4624032-0f35-4cef-90c7-fe07cd5f79ca => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:20:51.399358 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] VM Started (Lifecycle Event)
May 27 23:20:51.901430 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:20:51.903444 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:20:53.123910 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:20:53.627802 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:53.628057 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:53.628221 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:53.628369 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:20:54.440067 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:54.648019 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:20:54.649447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:54.732509 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:54.733006 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:54.821877 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:54.822525 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:20:54.827208 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:20:54.829031 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:20:54.830433 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:20:54.845292 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:54.874750 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:20:54.875154 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13086MB free_disk=72.64674377441406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:20:54.875307 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:54.875554 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:55.928944 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 5d91bc7d-00a1-44ff-9387-7fad59dc5679 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:20:55.929430 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance b4624032-0f35-4cef-90c7-fe07cd5f79ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:20:55.929430 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 71eb1efd-6e32-40a5-bf36-9032930485b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:20:55.929430 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:20:55.929430 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:20:54 up 49 min,  2 users,  load average: 2.43, 3.50, 3.84\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_5dda425dab8946dc926808806eeedced': '2', 'io_workload': '0', 'num_proj_30f40c2f26134e52b9d0ba5a2d3deb91': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:20:56.087642 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:20:56.087958 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:20:56.590767 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:20:56.803770 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:56.804013 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:56.804259 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:56.804463 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:56.804635 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:56.806859 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Terminating instance
May 27 23:20:57.097164 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:20:57.097627 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.222s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:57.097627 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 9.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:20:57.309862 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:20:57.323106 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.324712 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.340210 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.471536 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.477030 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4017e903-6bc1-4195-a818-7c3eacc8dba4 req-6e084d12-a478-42b6-b46d-9a1b7b2e68e9 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:57.477030 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4017e903-6bc1-4195-a818-7c3eacc8dba4 req-6e084d12-a478-42b6-b46d-9a1b7b2e68e9 service nova] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:57.477219 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4017e903-6bc1-4195-a818-7c3eacc8dba4 req-6e084d12-a478-42b6-b46d-9a1b7b2e68e9 service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:57.477300 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4017e903-6bc1-4195-a818-7c3eacc8dba4 req-6e084d12-a478-42b6-b46d-9a1b7b2e68e9 service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:57.477405 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4017e903-6bc1-4195-a818-7c3eacc8dba4 req-6e084d12-a478-42b6-b46d-9a1b7b2e68e9 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] No waiting events found dispatching network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:57.477648 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4017e903-6bc1-4195-a818-7c3eacc8dba4 req-6e084d12-a478-42b6-b46d-9a1b7b2e68e9 service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:20:57.478144 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.588787 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.612926 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.616767 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.635694 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.640089 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99959348099992 future=<Future at 0x726e385fefc0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:20:57.642915 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Instance destroyed successfully.
May 27 23:20:57.643300 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'resources' on Instance uuid 71eb1efd-6e32-40a5-bf36-9032930485b3 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:20:57.762630 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.768675 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.907380 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:57.913592 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:58.146762 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1996360308',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1996360308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-image-snapshot-server-1996360308',id=75,image_ref='b20271a2-eae6-4802-b5f9-7ca14958a89d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+OBzWhuGKgvUDQY50JETEMqK21nDeNgrxCT6uoewn48NEtZGGa+onqx2CGiyyewyByPiXjEqhiw5Nnr0Xl8qH/kfRVm7OWA4Thv6Bzy9M9cLAIhknU8abqFFP+b1oPeg==',key_name='tempest-keypair-1782601871',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:20:18Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-yaiqw3or',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-314561297',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=71eb1efd-6e32-40a5-bf36-9032930485b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "address": "fa:16:3e:da:2f:e4", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f6f5eca-5a", "ovs_interfaceid": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:20:58.147374 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "address": "fa:16:3e:da:2f:e4", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f6f5eca-5a", "ovs_interfaceid": "2f6f5eca-5af4-4876-9168-9ec33e015e84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:20:58.147852 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f6f5eca-5af4-4876-9168-9ec33e015e84,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f6f5eca-5a') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:20:58.148186 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f6f5eca-5af4-4876-9168-9ec33e015e84,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f6f5eca-5a') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:20:58.150560 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:58.150757 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f6f5eca-5a, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:58.151611 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:58.152237 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:20:58.152679 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:58.153315 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:58.153447 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50ec5c85-fdfc-45ef-87d7-6490011e61ed) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:20:58.154163 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:58.154285 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:20:58.154409 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:58.156219 np0000001565 nova-compute[98289]: INFO os_vif [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:2f:e4,bridge_name='br-int',has_traffic_filtering=True,id=2f6f5eca-5af4-4876-9168-9ec33e015e84,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f6f5eca-5a')
May 27 23:20:58.157804 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:20:58.158228 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92a1d44-754f-420d-b365-586328b93551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:20:58.158435 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:20:58.158861 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:20:58.159278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd92a1d44-754f-420d-b365-586328b93551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:20:58.159492 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:20:58.187389 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:58.187389 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:58.187389 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:58.187389 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:58.187389 np0000001565 nova-compute[98289]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:58.187389 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:58.187389 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:20:58.187704 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:58.187704 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:20:58.187704 np0000001565 nova-compute[98289]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:58.187704 np0000001565 nova-compute[98289]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551 (non-flash)
May 27 23:20:58.187704 np0000001565 nova-compute[98289]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:58.187704 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:20:58.187704 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:20:58.187704 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', '199'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', '202')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:20:58.187965 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', '199')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:20:58.188655 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551', '200')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:20:58.189328 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e581782c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551'): ({'sdc'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:20:58.189530 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:20:58.189733 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flush multipath device 330000000022cdf60 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:20:58.251608 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:20:58.297663 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:20:58.341795 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:20:58.341986 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:20:58.342892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:20:58.354092 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:20:58.354295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:20:58.366859 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:58.404257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551, portal: 192.168.40.100,3260]
May 27 23:20:58.404257 np0000001565 nova-compute[98289]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551, portal: 192.168.40.100,3260] successful.
May 27 23:20:58.404257 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:58.418130 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:58.427120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:58.465448 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551, portal: 192.168.50.100,3260]
May 27 23:20:58.465448 np0000001565 nova-compute[98289]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-d92a1d44-754f-420d-b365-586328b93551, portal: 192.168.50.100,3260] successful.
May 27 23:20:58.465448 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:58.479055 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:20:58.479266 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:20:58.479420 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== disconnect_volume: return (320ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:20:58.479621 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:20:58.479898 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Deleting instance files /opt/stack/data/nova/instances/71eb1efd-6e32-40a5-bf36-9032930485b3_del
May 27 23:20:58.480431 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Deletion of /opt/stack/data/nova/instances/71eb1efd-6e32-40a5-bf36-9032930485b3_del complete
May 27 23:20:58.985829 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Took 1.68 seconds to destroy the instance on the hypervisor.
May 27 23:20:58.986536 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:20:58.986695 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:20:58.986788 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:20:58.987012 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:59.038503 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:20:59.441649 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:20:59.542738 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:59.546457 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:59.546837 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:59.546993 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:59.547117 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] No waiting events found dispatching network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:59.547237 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:20:59.547419 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:59.547538 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:59.547653 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:59.547749 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:59.547844 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] No waiting events found dispatching network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:59.547975 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received unexpected event network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 for instance with vm_state active and task_state deleting.
May 27 23:20:59.548071 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:59.548177 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:59.548285 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:59.548395 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:59.548485 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] No waiting events found dispatching network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:59.548579 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received unexpected event network-vif-plugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 for instance with vm_state active and task_state deleting.
May 27 23:20:59.548667 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:59.548767 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:59.548867 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:59.548982 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:59.549073 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] No waiting events found dispatching network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:59.549164 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:20:59.549251 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:59.549369 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Acquiring lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:20:59.549470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:20:59.549557 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:20:59.549646 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] No waiting events found dispatching network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:20:59.549735 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-unplugged-2f6f5eca-5af4-4876-9168-9ec33e015e84 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:20:59.549820 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Received event network-vif-deleted-2f6f5eca-5af4-4876-9168-9ec33e015e84 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:20:59.549949 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Neutron deleted interface 2f6f5eca-5af4-4876-9168-9ec33e015e84; detaching it from the instance and deleting it from the info cache
May 27 23:20:59.551629 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d1420c62-8d7a-484f-9e62-f10274f2ce8d req-3dded634-1b96-4de5-a040-3895cee1f57b service nova] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Detach interface failed, port_id=2f6f5eca-5af4-4876-9168-9ec33e015e84, reason: Instance 71eb1efd-6e32-40a5-bf36-9032930485b3 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:20:59.866234 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:21:00.368213 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Took 1.38 seconds to deallocate network for instance.
May 27 23:21:00.917213 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Took 0.55 seconds to detach 1 volumes for instance.
May 27 23:21:00.918935 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Deleting volume: d92a1d44-754f-420d-b365-586328b93551 {{(pid=98289) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 23:21:01.457664 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:01.457831 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:01.621567 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:21:01.621765 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:21:02.124048 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:21:02.630533 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.173s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:02.673343 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deleted allocations for instance 71eb1efd-6e32-40a5-bf36-9032930485b3
May 27 23:21:03.154909 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:03.680793 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b62bf1b5-1034-4f08-938a-93a6206e875d tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "71eb1efd-6e32-40a5-bf36-9032930485b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.877s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:04.013766 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0007171070001277258 future=<Future at 0x726e581e6600 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:04.013905 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:04.013905 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.625660470999719 future=<Future at 0x726e385fefc0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:04.014014 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.625592106999648 future=<Future at 0x726e385fefc0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:04.443120 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:04.904187 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:04.904385 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:04.904519 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:04.904680 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:04.904800 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:04.907200 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Terminating instance
May 27 23:21:05.410650 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:21:05.426285 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:05.428032 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:05.443960 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:05.461388 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:05.555029 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b349b398-b4a3-4bc3-bb33-f257907f3109 req-ca7b8a68-a2c5-488b-80b6-fa117f83c3a3 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Received event network-vif-unplugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:05.555253 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b349b398-b4a3-4bc3-bb33-f257907f3109 req-ca7b8a68-a2c5-488b-80b6-fa117f83c3a3 service nova] Acquiring lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:05.555551 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b349b398-b4a3-4bc3-bb33-f257907f3109 req-ca7b8a68-a2c5-488b-80b6-fa117f83c3a3 service nova] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:05.555654 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b349b398-b4a3-4bc3-bb33-f257907f3109 req-ca7b8a68-a2c5-488b-80b6-fa117f83c3a3 service nova] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:05.555823 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b349b398-b4a3-4bc3-bb33-f257907f3109 req-ca7b8a68-a2c5-488b-80b6-fa117f83c3a3 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] No waiting events found dispatching network-vif-unplugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:21:05.555974 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b349b398-b4a3-4bc3-bb33-f257907f3109 req-ca7b8a68-a2c5-488b-80b6-fa117f83c3a3 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Received event network-vif-unplugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:21:05.716485 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999595866000163 future=<Future at 0x726e5812d340 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:05.717446 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Instance destroyed successfully.
May 27 23:21:05.717862 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'resources' on Instance uuid 5d91bc7d-00a1-44ff-9387-7fad59dc5679 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:21:06.097517 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:21:06.097765 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:21:06.097971 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:21:06.098229 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.02 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:21:06.123485 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:21:06.123685 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:21:06.123899 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:21:06.220249 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:19:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2111509405',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2111509405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-volume-backed-server-2111509405',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGQ3MPwMGxYUyT0JgiARgDoGN5oz+i9FHLGJ9Qy0KgLZ+/39YOyfz46aoi1b8Sz0s6T0uZfkLv4fmndKlJ/u66L51szi3/PjHF30SRUFzHqmlxrs0AhvrHQaLMyv3agUQ==',key_name='tempest-keypair-916219044',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:19:27Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-ypp39boq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31823a44e786429f80ba607958f8b63e',uuid=5d91bc7d-00a1-44ff-9387-7fad59dc5679,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "address": "fa:16:3e:35:d3:cc", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963e49c4-9f", "ovs_interfaceid": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:21:06.220512 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "address": "fa:16:3e:35:d3:cc", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap963e49c4-9f", "ovs_interfaceid": "963e49c4-9f06-4d28-8cde-3f893d9301b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:21:06.221006 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=963e49c4-9f06-4d28-8cde-3f893d9301b7,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963e49c4-9f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:21:06.221206 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=963e49c4-9f06-4d28-8cde-3f893d9301b7,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963e49c4-9f') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:21:06.222664 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:06.222812 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap963e49c4-9f, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:21:06.231124 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:06.231782 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:21:06.232168 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:06.232757 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:06.232921 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=914e6421-c1ef-40d2-a2dd-7b2ee642d4ae) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:21:06.233340 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:06.233804 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:21:06.233984 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:06.235621 np0000001565 nova-compute[98289]: INFO os_vif [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=963e49c4-9f06-4d28-8cde-3f893d9301b7,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963e49c4-9f')
May 27 23:21:06.236937 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:21:06.237190 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '054283ea-2baf-4704-ad7d-6b2dd3091391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:21:06.237343 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:21:06.237984 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:21:06.238250 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '054283ea-2baf-4704-ad7d-6b2dd3091391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:21:06.238421 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:21:06.263915 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:21:06.263915 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:21:06.263915 np0000001565 nova-compute[98289]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:06.263915 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:06.263915 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:21:06.264085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:21:06.264085 np0000001565 nova-compute[98289]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391 (non-flash)
May 27 23:21:06.264085 np0000001565 nova-compute[98289]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:06.264085 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:06.264085 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:21:06.264241 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', '202')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:21:06.264355 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', '197')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:21:06.265109 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391', '198')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:21:06.265888 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e587dc040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:21:06.266072 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:21:06.266257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flush multipath device 3300000000a24b912 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:21:06.322667 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:21:06.358593 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:21:06.400590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:21:06.400757 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:21:06.401407 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:21:06.414055 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:21:06.414247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:21:06.426171 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:06.452025 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391, portal: 192.168.40.100,3260]
May 27 23:21:06.452025 np0000001565 nova-compute[98289]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391, portal: 192.168.40.100,3260] successful.
May 27 23:21:06.452025 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:06.464450 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:06.473786 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:06.497149 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391, portal: 192.168.50.100,3260]
May 27 23:21:06.497149 np0000001565 nova-compute[98289]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-054283ea-2baf-4704-ad7d-6b2dd3091391, portal: 192.168.50.100,3260] successful.
May 27 23:21:06.497149 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:06.508542 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:06.508735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:21:06.508846 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== disconnect_volume: return (271ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:21:06.508959 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:21:06.509180 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Deleting instance files /opt/stack/data/nova/instances/5d91bc7d-00a1-44ff-9387-7fad59dc5679_del
May 27 23:21:06.509632 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Deletion of /opt/stack/data/nova/instances/5d91bc7d-00a1-44ff-9387-7fad59dc5679_del complete
May 27 23:21:07.014800 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Took 1.60 seconds to destroy the instance on the hypervisor.
May 27 23:21:07.015422 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:21:07.015725 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:21:07.015870 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:21:07.016102 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:07.073020 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:07.618057 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ff4dfd69-8734-4bc6-b358-ba6b57356180 req-6dee8e30-b3f3-4150-84a5-d014c735cb38 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Received event network-vif-unplugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:07.618629 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ff4dfd69-8734-4bc6-b358-ba6b57356180 req-6dee8e30-b3f3-4150-84a5-d014c735cb38 service nova] Acquiring lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:07.618885 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ff4dfd69-8734-4bc6-b358-ba6b57356180 req-6dee8e30-b3f3-4150-84a5-d014c735cb38 service nova] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:07.619037 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ff4dfd69-8734-4bc6-b358-ba6b57356180 req-6dee8e30-b3f3-4150-84a5-d014c735cb38 service nova] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:07.619201 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ff4dfd69-8734-4bc6-b358-ba6b57356180 req-6dee8e30-b3f3-4150-84a5-d014c735cb38 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] No waiting events found dispatching network-vif-unplugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:21:07.619371 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ff4dfd69-8734-4bc6-b358-ba6b57356180 req-6dee8e30-b3f3-4150-84a5-d014c735cb38 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Received event network-vif-unplugged-963e49c4-9f06-4d28-8cde-3f893d9301b7 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:21:07.992958 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fc20e543-b154-411a-bec7-523e53ef2611 req-c749b663-bb9a-4b4f-915a-4d9691813192 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Received event network-vif-deleted-963e49c4-9f06-4d28-8cde-3f893d9301b7 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:07.992958 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-fc20e543-b154-411a-bec7-523e53ef2611 req-c749b663-bb9a-4b4f-915a-4d9691813192 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Neutron deleted interface 963e49c4-9f06-4d28-8cde-3f893d9301b7; detaching it from the instance and deleting it from the info cache
May 27 23:21:07.994577 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-fc20e543-b154-411a-bec7-523e53ef2611 req-c749b663-bb9a-4b4f-915a-4d9691813192 service nova] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Detach interface failed, port_id=963e49c4-9f06-4d28-8cde-3f893d9301b7, reason: Instance 5d91bc7d-00a1-44ff-9387-7fad59dc5679 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:21:08.123690 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:21:08.123895 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:21:08.124007 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:21:08.124223 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:21:08.420078 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:21:08.922070 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Took 1.91 seconds to deallocate network for instance.
May 27 23:21:09.442805 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:09.461451 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Took 0.54 seconds to detach 1 volumes for instance.
May 27 23:21:09.463102 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Deleting volume: 054283ea-2baf-4704-ad7d-6b2dd3091391 {{(pid=98289) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 23:21:09.997531 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:09.997960 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:10.117682 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:21:10.117907 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:21:10.620116 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:21:11.126029 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.128s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:11.177875 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deleted allocations for instance 5d91bc7d-00a1-44ff-9387-7fad59dc5679
May 27 23:21:11.234587 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:12.186495 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-73280d4b-4a76-4592-b17d-fb0972ac8ccd tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "5d91bc7d-00a1-44ff-9387-7fad59dc5679" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.282s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:12.639978 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003395200001250487 future=<Future at 0x726e385fefc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:12.640387 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Emitting event <LifecycleEvent: 1779924057.639504, 71eb1efd-6e32-40a5-bf36-9032930485b3 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:21:12.640547 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:12.640717 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] VM Stopped (Lifecycle Event)
May 27 23:21:12.640820 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.075226794000173 future=<Future at 0x726e5812d340 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:12.641863 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=8.074189180000303 future=<Future at 0x726e5812d340 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:13.143474 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-35201fee-9191-4033-883c-9a7536074cb6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 71eb1efd-6e32-40a5-bf36-9032930485b3] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:21:14.444313 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:16.242583 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:16.832962 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "e9215353-288e-4ea9-89b2-5f6960210d42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:16.834011 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "e9215353-288e-4ea9-89b2-5f6960210d42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:17.335835 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:21:17.877984 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:17.878181 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:17.881463 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:21:17.881971 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Claim successful on node np0000001565
May 27 23:21:19.036639 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:21:19.037659 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:21:19.445240 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:19.540135 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:21:20.047058 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.169s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:20.047571 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:21:20.552214 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:21:20.552955 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:21:20.553245 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:20.553522 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:20.618752 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31823a44e786429f80ba607958f8b63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda425dab8946dc926808806eeedced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:21:20.716503 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004057460000694846 future=<Future at 0x726e5812d340 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:20.717072 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] Emitting event <LifecycleEvent: 1779924065.7159715, 5d91bc7d-00a1-44ff-9387-7fad59dc5679 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:21:20.717281 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:20.717464 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] VM Stopped (Lifecycle Event)
May 27 23:21:21.027182 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Successfully created port: 5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:21:21.055761 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:21:21.221133 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-f0ab0d57-5b7c-4d7f-9784-69e69c172340 tempest-TestEncryptedCinderVolumes-274929604 tempest-TestEncryptedCinderVolumes-274929604-project-member] [instance: 5d91bc7d-00a1-44ff-9387-7fad59dc5679] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:21:21.244237 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:21.436479 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Successfully updated port: 5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:21:21.479010 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e95616cb-645a-45b1-9418-30db0fd4f021 req-5a72f3fc-fb0b-4d3c-860a-8f4f73ad6923 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Received event network-changed-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:21.480033 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e95616cb-645a-45b1-9418-30db0fd4f021 req-5a72f3fc-fb0b-4d3c-860a-8f4f73ad6923 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Refreshing instance network info cache due to event network-changed-5b733c49-c4a8-4646-b5ae-89814f600a38. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:21:21.480202 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e95616cb-645a-45b1-9418-30db0fd4f021 req-5a72f3fc-fb0b-4d3c-860a-8f4f73ad6923 service nova] Acquiring lock "refresh_cache-e9215353-288e-4ea9-89b2-5f6960210d42" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:21:21.480309 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e95616cb-645a-45b1-9418-30db0fd4f021 req-5a72f3fc-fb0b-4d3c-860a-8f4f73ad6923 service nova] Acquired lock "refresh_cache-e9215353-288e-4ea9-89b2-5f6960210d42" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:21:21.480478 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e95616cb-645a-45b1-9418-30db0fd4f021 req-5a72f3fc-fb0b-4d3c-860a-8f4f73ad6923 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Refreshing network info cache for port 5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:21:21.558980 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:21:21.938223 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "refresh_cache-e9215353-288e-4ea9-89b2-5f6960210d42" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:21:21.982313 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-e95616cb-645a-45b1-9418-30db0fd4f021 req-5a72f3fc-fb0b-4d3c-860a-8f4f73ad6923 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:22.036209 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e95616cb-645a-45b1-9418-30db0fd4f021 req-5a72f3fc-fb0b-4d3c-860a-8f4f73ad6923 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:21:22.063080 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Booting with volume b80f10e3-246c-4662-b3a9-33f4316361ca at /dev/vda
May 27 23:21:22.102623 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:21:22.115666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:21:22.135120 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:21:22.171484 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-e95616cb-645a-45b1-9418-30db0fd4f021 req-5a72f3fc-fb0b-4d3c-860a-8f4f73ad6923 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:21:22.181781 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:21:22.182083 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:21:22.190539 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:21:22.191452 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe83:ed5e', 'fe80::bc5c:41ff:fe41:ca69'] 
May 27 23:21:22.191612 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:21:22.191721 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:21:22.191971 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:21:22.192159 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Updating existing volume attachment record: 21bde0ea-9c1d-4368-b5ce-ba1bcab850c2 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:21:22.675170 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-e95616cb-645a-45b1-9418-30db0fd4f021 req-5a72f3fc-fb0b-4d3c-860a-8f4f73ad6923 service nova] Releasing lock "refresh_cache-e9215353-288e-4ea9-89b2-5f6960210d42" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:21:22.675769 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquired lock "refresh_cache-e9215353-288e-4ea9-89b2-5f6960210d42" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:21:22.675962 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:21:23.230091 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:21:23.377206 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:23.497661 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Updating instance_info_cache with network_info: [{"id": "5b733c49-c4a8-4646-b5ae-89814f600a38", "address": "fa:16:3e:7d:18:68", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b733c49-c4", "ovs_interfaceid": "5b733c49-c4a8-4646-b5ae-89814f600a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:21:23.999492 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Releasing lock "refresh_cache-e9215353-288e-4ea9-89b2-5f6960210d42" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:21:23.999804 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Instance network_info: |[{"id": "5b733c49-c4a8-4646-b5ae-89814f600a38", "address": "fa:16:3e:7d:18:68", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b733c49-c4", "ovs_interfaceid": "5b733c49-c4a8-4646-b5ae-89814f600a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:21:24.273628 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:21:24.274729 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:21:24.274967 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Creating image(s)
May 27 23:21:24.275251 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:21:24.275394 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Ensure instance console log exists: /opt/stack/data/nova/instances/e9215353-288e-4ea9-89b2-5f6960210d42/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:21:24.275612 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:24.275809 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:24.275922 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:24.276348 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Start _get_guest_xml network_info=[{"id": "5b733c49-c4a8-4646-b5ae-89814f600a38", "address": "fa:16:3e:7d:18:68", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b733c49-c4", "ovs_interfaceid": "5b733c49-c4a8-4646-b5ae-89814f600a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '21bde0ea-9c1d-4368-b5ce-ba1bcab850c2', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e9215353-288e-4ea9-89b2-5f6960210d42', 'attached_at': '', 'detached_at': '', 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'serial': 'b80f10e3-246c-4662-b3a9-33f4316361ca'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:21:24.279799 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:21:24.280770 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-606145158', uuid='e9215353-288e-4ea9-89b2-5f6960210d42'), owner=OwnerMeta(userid='31823a44e786429f80ba607958f8b63e', username='tempest-TestVolumeBootPattern-314561297-project-member', projectid='5dda425dab8946dc926808806eeedced', projectname='tempest-TestVolumeBootPattern-314561297'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5b733c49-c4a8-4646-b5ae-89814f600a38", "address": "fa:16:3e:7d:18:68", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b733c49-c4", "ovs_interfaceid": "5b733c49-c4a8-4646-b5ae-89814f600a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779924084.2804685) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:21:24.281768 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:21:24.282089 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:21:24.282901 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:21:24.283348 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:21:24.284083 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:21:24.284449 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:21:24.284695 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:21:24.284879 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:21:24.285003 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:21:24.285139 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:21:24.285269 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:21:24.285484 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:21:24.285626 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:21:24.285799 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:21:24.285937 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:21:24.286092 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:21:24.294499 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:21:24.294823 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:21:24.294991 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:21:24.295310 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:21:24.295539 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:21:24.308574 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:21:24.309241 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:21:24.309871 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:21:24.310151 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:21:24.310631 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:21:24.311014 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:21:24.320640 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:21:24.320640 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:24.325423 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:21:24.325423 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:24.331590 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca] added
May 27 23:21:24.331590 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:21:24.331590 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:21:24.331590 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:21:24.331590 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:21:24.331590 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:21:24.331590 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:24.331855 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:21:24.331931 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0218(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:21:24.332071 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:21:24.335179 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca] added
May 27 23:21:24.335179 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:21:24.335179 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:21:24.335179 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:21:24.335179 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:21:24.335179 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:21:24.335179 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:24.335363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:21:24.335530 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:21:24.335663 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:21:25.332481 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:21:25.336565 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:21:25.344906 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:21:25.344906 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:21:25.349781 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:21:25.349781 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:25.355472 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:25.360990 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:25.367131 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.367131 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.367131 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:21:25.367259 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.367259 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.367259 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:21:25.372631 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.372631 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.372631 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:21:25.372900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.372900 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.372900 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:21:25.394185 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.40.100,3260]
May 27 23:21:25.394185 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.40.100,3260] successful.
May 27 23:21:25.394185 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:25.405358 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.50.100,3260]
May 27 23:21:25.405358 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.50.100,3260] successful.
May 27 23:21:25.405358 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:25.406543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:25.416295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:25.423608 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.423608 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.423608 np0000001565 nova-compute[98289]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:25.423608 np0000001565 nova-compute[98289]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:25.423608 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:21:25.423881 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.423881 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.423881 np0000001565 nova-compute[98289]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:25.423881 np0000001565 nova-compute[98289]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:25.423881 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:21:25.424115 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.115s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:21:25.424216 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:21:25.424836 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('7', '-', '-', 0) found on session 203 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:21:25.424951 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:21:25.429625 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.429625 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.429625 np0000001565 nova-compute[98289]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:25.429625 np0000001565 nova-compute[98289]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:25.429625 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:21:25.429818 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.429818 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:25.429818 np0000001565 nova-compute[98289]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:25.429818 np0000001565 nova-compute[98289]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:25.429818 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:21:25.430066 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:21:25.430170 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:21:25.430741 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('8', '-', '-', 0) found on session 204 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:21:25.430852 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:21:25.439704 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 203 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:21:25.439955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:21:25.445292 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 204 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:21:25.445292 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:21:26.246883 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:21:26.247174 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:21:26.247264 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:21:26.247340 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:21:26.252020 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:26.252267 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:21:26.310918 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:21:27.325353 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Found WWN 330000000be4fe95a for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:21:27.325715 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:21:27.325797 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000be4fe95a', 'path': '/dev/dm-0', 'multipath_id': '330000000be4fe95a'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:21:27.325919 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000be4fe95a', 'path': '/dev/dm-0', 'multipath_id': '330000000be4fe95a'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:21:27.378551 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:27.583999 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f91a5b5e-fb89-42fa-941c-df0fcae860d4 req-76ee4f22-9841-4ae5-a0a6-22b2742552ff service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-changed-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:27.584149 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f91a5b5e-fb89-42fa-941c-df0fcae860d4 req-76ee4f22-9841-4ae5-a0a6-22b2742552ff service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Refreshing instance network info cache due to event network-changed-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:21:27.584301 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f91a5b5e-fb89-42fa-941c-df0fcae860d4 req-76ee4f22-9841-4ae5-a0a6-22b2742552ff service nova] Acquiring lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:21:27.584423 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f91a5b5e-fb89-42fa-941c-df0fcae860d4 req-76ee4f22-9841-4ae5-a0a6-22b2742552ff service nova] Acquired lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:21:27.584548 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f91a5b5e-fb89-42fa-941c-df0fcae860d4 req-76ee4f22-9841-4ae5-a0a6-22b2742552ff service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Refreshing network info cache for port fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:21:27.830844 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-606145158',display_name='tempest-TestVolumeBootPattern-server-606145158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-606145158',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkuQiL7HZCdOcvEM0oVjt1zbL4sjnserQYsaCb41sHx2Ro0t2FlJaex6LqEDdWRK1DFZ2DpPVIFBVDu6t/KipI5zPLFZL2mndVngoPZJuwR7U276gcCZA+LQx8nCmmkPg==',key_name='tempest-TestVolumeBootPattern-1236496757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-d15a76va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:21:22Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=e9215353-288e-4ea9-89b2-5f6960210d42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b733c49-c4a8-4646-b5ae-89814f600a38", "address": "fa:16:3e:7d:18:68", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b733c49-c4", "ovs_interfaceid": "5b733c49-c4a8-4646-b5ae-89814f600a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:21:27.831079 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "5b733c49-c4a8-4646-b5ae-89814f600a38", "address": "fa:16:3e:7d:18:68", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b733c49-c4", "ovs_interfaceid": "5b733c49-c4a8-4646-b5ae-89814f600a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:21:27.831637 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:18:68,bridge_name='br-int',has_traffic_filtering=True,id=5b733c49-c4a8-4646-b5ae-89814f600a38,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b733c49-c4') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:21:27.832207 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'pci_devices' on Instance uuid e9215353-288e-4ea9-89b2-5f6960210d42 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:21:28.087832 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f91a5b5e-fb89-42fa-941c-df0fcae860d4 req-76ee4f22-9841-4ae5-a0a6-22b2742552ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:28.334757 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] End _get_guest_xml xml=<domain type="qemu">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <uuid>e9215353-288e-4ea9-89b2-5f6960210d42</uuid>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <name>instance-0000004c</name>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPattern-server-606145158</nova:name>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:21:24</nova:creationTime>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:user uuid="31823a44e786429f80ba607958f8b63e">tempest-TestVolumeBootPattern-314561297-project-member</nova:user>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:project uuid="5dda425dab8946dc926808806eeedced">tempest-TestVolumeBootPattern-314561297</nova:project>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         <nova:port uuid="5b733c49-c4a8-4646-b5ae-89814f600a38">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <system>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <entry name="serial">e9215353-288e-4ea9-89b2-5f6960210d42</entry>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <entry name="uuid">e9215353-288e-4ea9-89b2-5f6960210d42</entry>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     </system>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <os>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   </os>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <features>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   </features>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   <devices>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/e9215353-288e-4ea9-89b2-5f6960210d42/disk.config"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     </disk>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <alias name="ua-b80f10e3-246c-4662-b3a9-33f4316361ca"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <serial>b80f10e3-246c-4662-b3a9-33f4316361ca</serial>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     </disk>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:7d:18:68"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <target dev="tap5b733c49-c4"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     </interface>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/e9215353-288e-4ea9-89b2-5f6960210d42/console.log" append="off"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     </serial>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <video>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     </video>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     </rng>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:   </devices>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]: </domain>
May 27 23:21:28.334757 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:21:28.337717 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Preparing to wait for external event network-vif-plugged-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:21:28.337717 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:28.337717 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:28.337717 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:28.337717 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-606145158',display_name='tempest-TestVolumeBootPattern-server-606145158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-606145158',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkuQiL7HZCdOcvEM0oVjt1zbL4sjnserQYsaCb41sHx2Ro0t2FlJaex6LqEDdWRK1DFZ2DpPVIFBVDu6t/KipI5zPLFZL2mndVngoPZJuwR7U276gcCZA+LQx8nCmmkPg==',key_name='tempest-TestVolumeBootPattern-1236496757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-d15a76va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:21:22Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=e9215353-288e-4ea9-89b2-5f6960210d42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b733c49-c4a8-4646-b5ae-89814f600a38", "address": "fa:16:3e:7d:18:68", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b733c49-c4", "ovs_interfaceid": "5b733c49-c4a8-4646-b5ae-89814f600a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:21:28.337717 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "5b733c49-c4a8-4646-b5ae-89814f600a38", "address": "fa:16:3e:7d:18:68", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b733c49-c4", "ovs_interfaceid": "5b733c49-c4a8-4646-b5ae-89814f600a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:21:28.337717 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:18:68,bridge_name='br-int',has_traffic_filtering=True,id=5b733c49-c4a8-4646-b5ae-89814f600a38,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b733c49-c4') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:21:28.337717 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:18:68,bridge_name='br-int',has_traffic_filtering=True,id=5b733c49-c4a8-4646-b5ae-89814f600a38,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b733c49-c4') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:21:28.337717 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:28.337717 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:21:28.338476 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:21:28.338674 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:28.338845 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9dfd47d1-14a4-5ce9-9308-150aeb794e56', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:21:28.339643 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:28.340519 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:21:28.342263 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:28.342420 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b733c49-c4, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:21:28.342725 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b733c49-c4, col_values=(('qos', UUID('2cafa342-17a5-4548-84d4-dee6fdcdd43f')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:21:28.342879 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b733c49-c4, col_values=(('external_ids', {'iface-id': '5b733c49-c4a8-4646-b5ae-89814f600a38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:18:68', 'vm-uuid': 'e9215353-288e-4ea9-89b2-5f6960210d42'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:21:28.343666 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:28.344897 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:21:28.348858 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:28.349826 np0000001565 nova-compute[98289]: INFO os_vif [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:18:68,bridge_name='br-int',has_traffic_filtering=True,id=5b733c49-c4a8-4646-b5ae-89814f600a38,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b733c49-c4')
May 27 23:21:28.365373 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f91a5b5e-fb89-42fa-941c-df0fcae860d4 req-76ee4f22-9841-4ae5-a0a6-22b2742552ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:28.480400 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f91a5b5e-fb89-42fa-941c-df0fcae860d4 req-76ee4f22-9841-4ae5-a0a6-22b2742552ff service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updated VIF entry in instance network info cache for port fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:21:28.480400 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f91a5b5e-fb89-42fa-941c-df0fcae860d4 req-76ee4f22-9841-4ae5-a0a6-22b2742552ff service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updating instance_info_cache with network_info: [{"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:21:28.484083 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:28.484262 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:28.982175 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f91a5b5e-fb89-42fa-941c-df0fcae860d4 req-76ee4f22-9841-4ae5-a0a6-22b2742552ff service nova] Releasing lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:21:28.986605 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Detaching volume 6a861557-799c-4558-8349-f8b87f6c1b6f
May 27 23:21:29.028245 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Attempting to driver detach volume 6a861557-799c-4558-8349-f8b87f6c1b6f from mountpoint /dev/vdb
May 27 23:21:29.031664 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Found disk vdb by alias ua-6a861557-799c-4558-8349-f8b87f6c1b6f {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:21:29.032726 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Found disk vdb by alias ua-6a861557-799c-4558-8349-f8b87f6c1b6f {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:21:29.032839 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Attempting to detach device vdb from instance b4624032-0f35-4cef-90c7-fe07cd5f79ca from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:21:29.033066 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:21:29.033066 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:21:29.033066 np0000001565 nova-compute[98289]:   <alias name="ua-6a861557-799c-4558-8349-f8b87f6c1b6f"/>
May 27 23:21:29.033066 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-6"/>
May 27 23:21:29.033066 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:21:29.033066 np0000001565 nova-compute[98289]:   <serial>6a861557-799c-4558-8349-f8b87f6c1b6f</serial>
May 27 23:21:29.033066 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:21:29.033066 np0000001565 nova-compute[98289]: </disk>
May 27 23:21:29.033066 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:21:29.037293 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Successfully detached device vdb from instance b4624032-0f35-4cef-90c7-fe07cd5f79ca from the persistent domain config.
May 27 23:21:29.037445 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] (1/8): Attempting to detach device vdb with device alias ua-6a861557-799c-4558-8349-f8b87f6c1b6f from instance b4624032-0f35-4cef-90c7-fe07cd5f79ca from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:21:29.037666 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:21:29.037666 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:21:29.037666 np0000001565 nova-compute[98289]:   <alias name="ua-6a861557-799c-4558-8349-f8b87f6c1b6f"/>
May 27 23:21:29.037666 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-6"/>
May 27 23:21:29.037666 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:21:29.037666 np0000001565 nova-compute[98289]:   <serial>6a861557-799c-4558-8349-f8b87f6c1b6f</serial>
May 27 23:21:29.037666 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:21:29.037666 np0000001565 nova-compute[98289]: </disk>
May 27 23:21:29.037666 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:21:29.447580 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:29.511932 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779924089.5114875, b4624032-0f35-4cef-90c7-fe07cd5f79ca => ua-6a861557-799c-4558-8349-f8b87f6c1b6f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:21:29.512880 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6a861557-799c-4558-8349-f8b87f6c1b6f for instance b4624032-0f35-4cef-90c7-fe07cd5f79ca {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:21:29.515091 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Successfully detached device vdb from instance b4624032-0f35-4cef-90c7-fe07cd5f79ca from the live domain config.
May 27 23:21:29.516013 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:21:29.516256 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a861557-799c-4558-8349-f8b87f6c1b6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:21:29.516380 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:21:29.516710 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:21:29.516947 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a861557-799c-4558-8349-f8b87f6c1b6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:21:29.517049 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:21:29.541791 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:29.541791 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:29.541791 np0000001565 nova-compute[98289]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:29.541791 np0000001565 nova-compute[98289]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:29.541791 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:21:29.542072 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:29.542072 np0000001565 nova-compute[98289]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f (non-flash)
May 27 23:21:29.542072 np0000001565 nova-compute[98289]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:29.542072 np0000001565 nova-compute[98289]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:29.542072 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:21:29.542072 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '204')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:21:29.542347 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', '201')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:21:29.542870 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f', '202')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:21:29.543525 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e587deac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:21:29.543706 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Removing multipathed devices sdd, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:21:29.543927 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Flush multipath device 33000000044f7e22c {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:21:29.571554 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:21:29.604671 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:21:29.639039 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4cac9dad-7932-47d9-9b81-b6e553526b81 req-9a3f6d2e-bccc-41fc-b92d-159dfcd491c6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-changed-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:29.639243 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4cac9dad-7932-47d9-9b81-b6e553526b81 req-9a3f6d2e-bccc-41fc-b92d-159dfcd491c6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Refreshing instance network info cache due to event network-changed-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:21:29.640086 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4cac9dad-7932-47d9-9b81-b6e553526b81 req-9a3f6d2e-bccc-41fc-b92d-159dfcd491c6 service nova] Acquiring lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:21:29.640086 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4cac9dad-7932-47d9-9b81-b6e553526b81 req-9a3f6d2e-bccc-41fc-b92d-159dfcd491c6 service nova] Acquired lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:21:29.640086 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:21:29.640261 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4cac9dad-7932-47d9-9b81-b6e553526b81 req-9a3f6d2e-bccc-41fc-b92d-159dfcd491c6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Refreshing network info cache for port fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:21:29.641109 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:21:29.642418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:21:29.652792 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:21:29.652955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:21:29.663070 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:29.689861 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 201, target: iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f, portal: 192.168.40.100,3260]
May 27 23:21:29.689861 np0000001565 nova-compute[98289]: Logout of [sid: 201, target: iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f, portal: 192.168.40.100,3260] successful.
May 27 23:21:29.689861 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:29.701018 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:29.712088 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:29.734013 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 202, target: iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f, portal: 192.168.50.100,3260]
May 27 23:21:29.734013 np0000001565 nova-compute[98289]: Logout of [sid: 202, target: iqn.2023-03.storpool.com:os--volume-6a861557-799c-4558-8349-f8b87f6c1b6f, portal: 192.168.50.100,3260] successful.
May 27 23:21:29.734013 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:29.745886 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:21:29.746065 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.229s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:21:29.746179 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] <== disconnect_volume: return (229ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:21:29.746317 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:21:29.865097 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:21:29.865097 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:21:29.865097 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No VIF found with MAC fa:16:3e:7d:18:68, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:21:29.865097 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Using config drive
May 27 23:21:30.142660 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4cac9dad-7932-47d9-9b81-b6e553526b81 req-9a3f6d2e-bccc-41fc-b92d-159dfcd491c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:30.285419 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'flavor' on Instance uuid b4624032-0f35-4cef-90c7-fe07cd5f79ca {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:21:30.369828 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:30.376201 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-4cac9dad-7932-47d9-9b81-b6e553526b81 req-9a3f6d2e-bccc-41fc-b92d-159dfcd491c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:30.493932 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Creating config drive at /opt/stack/data/nova/instances/e9215353-288e-4ea9-89b2-5f6960210d42/disk.config
May 27 23:21:30.496869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e9215353-288e-4ea9-89b2-5f6960210d42/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7ft_mcxo {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:21:30.514980 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4cac9dad-7932-47d9-9b81-b6e553526b81 req-9a3f6d2e-bccc-41fc-b92d-159dfcd491c6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updated VIF entry in instance network info cache for port fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:21:30.515480 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-4cac9dad-7932-47d9-9b81-b6e553526b81 req-9a3f6d2e-bccc-41fc-b92d-159dfcd491c6 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updating instance_info_cache with network_info: [{"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:21:30.547973 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e9215353-288e-4ea9-89b2-5f6960210d42/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7ft_mcxo" returned: 0 in 0.051s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:21:30.900463 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:30.916771 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:30.919528 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:31.003544 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:31.018742 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4cac9dad-7932-47d9-9b81-b6e553526b81 req-9a3f6d2e-bccc-41fc-b92d-159dfcd491c6 service nova] Releasing lock "refresh_cache-b4624032-0f35-4cef-90c7-fe07cd5f79ca" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:21:31.229043 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:31.233425 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:31.233425 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:31.249074 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:31.291242 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c79bff40-6f81-4c64-b276-c1d08799ed90 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.807s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:31.574589 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924091.5741048, e9215353-288e-4ea9-89b2-5f6960210d42 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:21:31.574915 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] VM Started (Lifecycle Event)
May 27 23:21:31.688860 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7b026ccc-a913-4449-aa83-860bb70626cd req-b0853145-ed6c-4ea8-a528-9f089a1e9c56 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Received event network-vif-plugged-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:31.689079 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7b026ccc-a913-4449-aa83-860bb70626cd req-b0853145-ed6c-4ea8-a528-9f089a1e9c56 service nova] Acquiring lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:31.689275 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7b026ccc-a913-4449-aa83-860bb70626cd req-b0853145-ed6c-4ea8-a528-9f089a1e9c56 service nova] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:31.689425 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7b026ccc-a913-4449-aa83-860bb70626cd req-b0853145-ed6c-4ea8-a528-9f089a1e9c56 service nova] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:31.689571 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7b026ccc-a913-4449-aa83-860bb70626cd req-b0853145-ed6c-4ea8-a528-9f089a1e9c56 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Processing event network-vif-plugged-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:21:31.689904 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7b026ccc-a913-4449-aa83-860bb70626cd req-b0853145-ed6c-4ea8-a528-9f089a1e9c56 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Received event network-vif-plugged-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:31.690034 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7b026ccc-a913-4449-aa83-860bb70626cd req-b0853145-ed6c-4ea8-a528-9f089a1e9c56 service nova] Acquiring lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:31.690170 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7b026ccc-a913-4449-aa83-860bb70626cd req-b0853145-ed6c-4ea8-a528-9f089a1e9c56 service nova] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:31.690359 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7b026ccc-a913-4449-aa83-860bb70626cd req-b0853145-ed6c-4ea8-a528-9f089a1e9c56 service nova] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:31.690660 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7b026ccc-a913-4449-aa83-860bb70626cd req-b0853145-ed6c-4ea8-a528-9f089a1e9c56 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] No waiting events found dispatching network-vif-plugged-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:21:31.691385 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:21:31.691385 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-7b026ccc-a913-4449-aa83-860bb70626cd req-b0853145-ed6c-4ea8-a528-9f089a1e9c56 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Received unexpected event network-vif-plugged-5b733c49-c4a8-4646-b5ae-89814f600a38 for instance with vm_state building and task_state spawning.
May 27 23:21:31.693791 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:21:31.695463 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Instance spawned successfully.
May 27 23:21:31.695594 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:21:32.076943 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:21:32.078850 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:21:32.202474 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:21:32.202916 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:21:32.203173 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:21:32.203577 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:21:32.203871 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:21:32.204255 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:21:32.581533 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:21:32.582094 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924092.581905, e9215353-288e-4ea9-89b2-5f6960210d42 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:21:32.582155 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] VM Paused (Lifecycle Event)
May 27 23:21:32.709360 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Took 8.44 seconds to spawn the instance on the hypervisor.
May 27 23:21:32.709501 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:21:32.826201 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:32.827224 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:32.827224 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:32.827224 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:32.827224 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:32.828759 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Terminating instance
May 27 23:21:33.084420 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:21:33.086478 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924093.0862455, e9215353-288e-4ea9-89b2-5f6960210d42 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:21:33.086760 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] VM Resumed (Lifecycle Event)
May 27 23:21:33.217034 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Took 15.38 seconds to build instance.
May 27 23:21:33.331266 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:21:33.345169 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:33.348931 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:33.362870 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:33.369297 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:33.394985 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:33.482778 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-63db1ca8-9eeb-45c1-a28c-84a39a4d6e6e req-55c7549b-d8c9-47c6-8174-3fe999e4ead1 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:33.482886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-63db1ca8-9eeb-45c1-a28c-84a39a4d6e6e req-55c7549b-d8c9-47c6-8174-3fe999e4ead1 service nova] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:33.483193 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-63db1ca8-9eeb-45c1-a28c-84a39a4d6e6e req-55c7549b-d8c9-47c6-8174-3fe999e4ead1 service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:33.483193 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-63db1ca8-9eeb-45c1-a28c-84a39a4d6e6e req-55c7549b-d8c9-47c6-8174-3fe999e4ead1 service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:33.484738 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-63db1ca8-9eeb-45c1-a28c-84a39a4d6e6e req-55c7549b-d8c9-47c6-8174-3fe999e4ead1 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] No waiting events found dispatching network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:21:33.484738 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-63db1ca8-9eeb-45c1-a28c-84a39a4d6e6e req-55c7549b-d8c9-47c6-8174-3fe999e4ead1 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:21:33.589396 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:21:33.596404 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:21:33.653357 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Instance destroyed successfully.
May 27 23:21:33.653357 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lazy-loading 'resources' on Instance uuid b4624032-0f35-4cef-90c7-fe07cd5f79ca {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:21:33.718526 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-6d37ea3e-cdd2-48b7-94c4-c6dcee7535b9 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "e9215353-288e-4ea9-89b2-5f6960210d42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.885s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:34.099190 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999715584000114 future=<Future at 0x726e581aef00 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:34.099579 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99931873300011 future=<Future at 0x726e581aef00 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:34.099691 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999177501999839 future=<Future at 0x726e581aef00 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:34.154710 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1880108774',display_name='tempest-TestMinimumBasicScenario-server-1880108774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testminimumbasicscenario-server-1880108774',id=74,image_ref='8516b847-9fd9-48c2-b837-bba3c5960969',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKZW0X7xH53FcY48Jp6l2IzGomeruRGVzt5oEHORxpHRwKNmBLJY3C0W/NixoN7X9cnD/GXNk/22w7zFffd2aVoqks0M7AYbdUb5Me51wfzhvp0ZV5D+U7tNyt9Hv0okg==',key_name='tempest-TestMinimumBasicScenario-926744344',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:20:08Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30f40c2f26134e52b9d0ba5a2d3deb91',ramdisk_id='',reservation_id='r-soy00l0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8516b847-9fd9-48c2-b837-bba3c5960969',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-365514479',owner_user_name='tempest-TestMinimumBasicScenario-365514479-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:20:50Z,user_data=None,user_id='b20fe60fc49e4fbeb9ea63bf3cf9e3d4',uuid=b4624032-0f35-4cef-90c7-fe07cd5f79ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:21:34.154914 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converting VIF {"id": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "address": "fa:16:3e:83:ed:5e", "network": {"id": "a4522747-524a-4256-8535-69e639b9dac0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1854311691-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "30f40c2f26134e52b9d0ba5a2d3deb91", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4342c7-ea", "ovs_interfaceid": "fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:21:34.155580 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:ed:5e,bridge_name='br-int',has_traffic_filtering=True,id=fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4342c7-ea') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:21:34.155836 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ed:5e,bridge_name='br-int',has_traffic_filtering=True,id=fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4342c7-ea') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:21:34.157346 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:34.157616 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa4342c7-ea, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:21:34.158642 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:34.159352 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:21:34.159704 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:34.160492 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:34.160629 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c27c4e4c-9ec2-47ea-9b70-e0e0496c80df) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:21:34.161203 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:34.161630 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:21:34.162089 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:34.163732 np0000001565 nova-compute[98289]: INFO os_vif [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ed:5e,bridge_name='br-int',has_traffic_filtering=True,id=fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0,network=Network(a4522747-524a-4256-8535-69e639b9dac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4342c7-ea')
May 27 23:21:34.163993 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Deleting instance files /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca_del
May 27 23:21:34.164656 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Deletion of /opt/stack/data/nova/instances/b4624032-0f35-4cef-90c7-fe07cd5f79ca_del complete
May 27 23:21:34.448703 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:34.669764 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Took 1.34 seconds to destroy the instance on the hypervisor.
May 27 23:21:34.670273 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:21:34.670408 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:21:34.670495 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:21:34.670756 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:34.760129 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:34.880758 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-304aa70f-19ce-48eb-85ff-82f470d60fc7 req-bca5cfcc-dd84-4e8c-b8c2-98851939e1e2 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Received event network-changed-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:34.880929 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-304aa70f-19ce-48eb-85ff-82f470d60fc7 req-bca5cfcc-dd84-4e8c-b8c2-98851939e1e2 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Refreshing instance network info cache due to event network-changed-5b733c49-c4a8-4646-b5ae-89814f600a38. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:21:34.881100 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-304aa70f-19ce-48eb-85ff-82f470d60fc7 req-bca5cfcc-dd84-4e8c-b8c2-98851939e1e2 service nova] Acquiring lock "refresh_cache-e9215353-288e-4ea9-89b2-5f6960210d42" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:21:34.881207 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-304aa70f-19ce-48eb-85ff-82f470d60fc7 req-bca5cfcc-dd84-4e8c-b8c2-98851939e1e2 service nova] Acquired lock "refresh_cache-e9215353-288e-4ea9-89b2-5f6960210d42" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:21:34.881318 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-304aa70f-19ce-48eb-85ff-82f470d60fc7 req-bca5cfcc-dd84-4e8c-b8c2-98851939e1e2 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Refreshing network info cache for port 5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:21:35.383350 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-304aa70f-19ce-48eb-85ff-82f470d60fc7 req-bca5cfcc-dd84-4e8c-b8c2-98851939e1e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:35.483246 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:21:35.546384 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0886e119-98e6-41be-8da0-b58c8c1cd460 req-caf0c2b5-37b3-4139-af50-98d6f5d69739 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:35.546918 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0886e119-98e6-41be-8da0-b58c8c1cd460 req-caf0c2b5-37b3-4139-af50-98d6f5d69739 service nova] Acquiring lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:35.547062 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0886e119-98e6-41be-8da0-b58c8c1cd460 req-caf0c2b5-37b3-4139-af50-98d6f5d69739 service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:35.547225 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0886e119-98e6-41be-8da0-b58c8c1cd460 req-caf0c2b5-37b3-4139-af50-98d6f5d69739 service nova] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:35.547407 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0886e119-98e6-41be-8da0-b58c8c1cd460 req-caf0c2b5-37b3-4139-af50-98d6f5d69739 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] No waiting events found dispatching network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:21:35.547571 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0886e119-98e6-41be-8da0-b58c8c1cd460 req-caf0c2b5-37b3-4139-af50-98d6f5d69739 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-vif-unplugged-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:21:35.547726 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0886e119-98e6-41be-8da0-b58c8c1cd460 req-caf0c2b5-37b3-4139-af50-98d6f5d69739 service nova] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Received event network-vif-deleted-fa4342c7-eaf4-4d2a-87c2-e48dd68e10e0 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:35.658378 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-304aa70f-19ce-48eb-85ff-82f470d60fc7 req-bca5cfcc-dd84-4e8c-b8c2-98851939e1e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:21:35.786000 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-304aa70f-19ce-48eb-85ff-82f470d60fc7 req-bca5cfcc-dd84-4e8c-b8c2-98851939e1e2 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Updated VIF entry in instance network info cache for port 5b733c49-c4a8-4646-b5ae-89814f600a38. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:21:35.786384 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-304aa70f-19ce-48eb-85ff-82f470d60fc7 req-bca5cfcc-dd84-4e8c-b8c2-98851939e1e2 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Updating instance_info_cache with network_info: [{"id": "5b733c49-c4a8-4646-b5ae-89814f600a38", "address": "fa:16:3e:7d:18:68", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b733c49-c4", "ovs_interfaceid": "5b733c49-c4a8-4646-b5ae-89814f600a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:21:35.985274 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Took 1.31 seconds to deallocate network for instance.
May 27 23:21:36.288013 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-304aa70f-19ce-48eb-85ff-82f470d60fc7 req-bca5cfcc-dd84-4e8c-b8c2-98851939e1e2 service nova] Releasing lock "refresh_cache-e9215353-288e-4ea9-89b2-5f6960210d42" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:21:36.490678 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:36.490843 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:36.617807 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:21:36.618021 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:21:37.120694 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:21:37.627790 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.137s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:37.671300 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Deleted allocations for instance b4624032-0f35-4cef-90c7-fe07cd5f79ca
May 27 23:21:38.678344 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c686510f-cb9d-436a-aa56-23fb110f7f42 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Lock "b4624032-0f35-4cef-90c7-fe07cd5f79ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.852s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:39.161995 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:39.449082 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:40.931307 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:42.469797 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:44.162131 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:44.450569 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:49.099297 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00037102299984326237 future=<Future at 0x726e581aef00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:49.100161 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Emitting event <LifecycleEvent: 1779924094.0987995, b4624032-0f35-4cef-90c7-fe07cd5f79ca => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:21:49.100375 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:49.100631 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] VM Stopped (Lifecycle Event)
May 27 23:21:49.163402 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:49.451712 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:49.603108 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: b4624032-0f35-4cef-90c7-fe07cd5f79ca] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:21:53.124588 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:21:53.628655 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:53.630127 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:53.630127 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:53.630127 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:21:54.164547 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:54.453164 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:54.647570 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:21:54.648800 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:21:54.649603 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:21:54.697737 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:21:54.698270 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13640MB free_disk=72.6749153137207GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:21:54.698590 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:54.698905 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:55.763373 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance e9215353-288e-4ea9-89b2-5f6960210d42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:21:55.763373 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:21:55.763373 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:21:54 up 50 min,  2 users,  load average: 2.79, 3.38, 3.78\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_5dda425dab8946dc926808806eeedced': '1', 'io_workload': '0'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:21:55.849915 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:21:55.850108 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:21:56.352598 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:21:56.858477 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:21:56.859030 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.160s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:56.859085 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:21:58.574225 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "e9215353-288e-4ea9-89b2-5f6960210d42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:58.574680 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "e9215353-288e-4ea9-89b2-5f6960210d42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:58.574680 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:58.574764 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:58.574860 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:58.577111 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Terminating instance
May 27 23:21:58.728907 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.080714 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:21:59.092696 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.094769 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.105867 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.109358 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.125866 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.165382 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.382872 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999635060999935 future=<Future at 0x726e38573e30 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:59.383489 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999201932999767 future=<Future at 0x726e38573e30 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:59.383489 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999072796999826 future=<Future at 0x726e38573e30 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:21:59.384951 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Instance destroyed successfully.
May 27 23:21:59.385623 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'resources' on Instance uuid e9215353-288e-4ea9-89b2-5f6960210d42 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:21:59.394652 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-40028bd8-c66b-464c-9b13-0d3edbc25048 req-62b589e1-cdd4-4695-a0ec-1d4fa6e32ae3 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Received event network-vif-unplugged-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:21:59.395499 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40028bd8-c66b-464c-9b13-0d3edbc25048 req-62b589e1-cdd4-4695-a0ec-1d4fa6e32ae3 service nova] Acquiring lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:21:59.395676 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40028bd8-c66b-464c-9b13-0d3edbc25048 req-62b589e1-cdd4-4695-a0ec-1d4fa6e32ae3 service nova] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:21:59.395819 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-40028bd8-c66b-464c-9b13-0d3edbc25048 req-62b589e1-cdd4-4695-a0ec-1d4fa6e32ae3 service nova] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:21:59.395966 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-40028bd8-c66b-464c-9b13-0d3edbc25048 req-62b589e1-cdd4-4695-a0ec-1d4fa6e32ae3 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] No waiting events found dispatching network-vif-unplugged-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:21:59.396092 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-40028bd8-c66b-464c-9b13-0d3edbc25048 req-62b589e1-cdd4-4695-a0ec-1d4fa6e32ae3 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Received event network-vif-unplugged-5b733c49-c4a8-4646-b5ae-89814f600a38 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:21:59.453637 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.887826 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-606145158',display_name='tempest-TestVolumeBootPattern-server-606145158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-606145158',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkuQiL7HZCdOcvEM0oVjt1zbL4sjnserQYsaCb41sHx2Ro0t2FlJaex6LqEDdWRK1DFZ2DpPVIFBVDu6t/KipI5zPLFZL2mndVngoPZJuwR7U276gcCZA+LQx8nCmmkPg==',key_name='tempest-TestVolumeBootPattern-1236496757',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:21:32Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-d15a76va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:21:33Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=e9215353-288e-4ea9-89b2-5f6960210d42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b733c49-c4a8-4646-b5ae-89814f600a38", "address": "fa:16:3e:7d:18:68", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b733c49-c4", "ovs_interfaceid": "5b733c49-c4a8-4646-b5ae-89814f600a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:21:59.888271 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "5b733c49-c4a8-4646-b5ae-89814f600a38", "address": "fa:16:3e:7d:18:68", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b733c49-c4", "ovs_interfaceid": "5b733c49-c4a8-4646-b5ae-89814f600a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:21:59.888559 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:18:68,bridge_name='br-int',has_traffic_filtering=True,id=5b733c49-c4a8-4646-b5ae-89814f600a38,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b733c49-c4') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:21:59.888762 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:18:68,bridge_name='br-int',has_traffic_filtering=True,id=5b733c49-c4a8-4646-b5ae-89814f600a38,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b733c49-c4') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:21:59.890417 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.890631 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b733c49-c4, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:21:59.892408 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.892882 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:21:59.893551 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.893668 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2cafa342-17a5-4548-84d4-dee6fdcdd43f) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:21:59.894112 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.894684 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:21:59.895038 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:21:59.896762 np0000001565 nova-compute[98289]: INFO os_vif [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:18:68,bridge_name='br-int',has_traffic_filtering=True,id=5b733c49-c4a8-4646-b5ae-89814f600a38,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b733c49-c4')
May 27 23:21:59.898129 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:21:59.898401 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:21:59.898524 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:21:59.899840 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:21:59.900247 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:21:59.900446 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:21:59.922634 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:59.922634 np0000001565 nova-compute[98289]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:59.922634 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:21:59.922785 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:59.922785 np0000001565 nova-compute[98289]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:21:59.922785 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:21:59.922918 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '204')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:21:59.923058 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '203')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:21:59.924059 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '204')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:21:59.924839 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3879d260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'): ({'sdc'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:21:59.925080 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:21:59.925314 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flush multipath device 330000000be4fe95a {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:21:59.988769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:22:00.031839 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:22:00.078727 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:22:00.078906 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:22:00.079721 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:22:00.092751 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:22:00.092951 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:22:00.103617 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:00.135230 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.40.100,3260]
May 27 23:22:00.135230 np0000001565 nova-compute[98289]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.40.100,3260] successful.
May 27 23:22:00.135230 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:00.147934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:00.160573 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:00.185133 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.50.100,3260]
May 27 23:22:00.185133 np0000001565 nova-compute[98289]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.50.100,3260] successful.
May 27 23:22:00.185133 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:00.197698 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:00.197910 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:22:00.198036 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== disconnect_volume: return (299ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:22:00.198173 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:22:00.198489 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Deleting instance files /opt/stack/data/nova/instances/e9215353-288e-4ea9-89b2-5f6960210d42_del
May 27 23:22:00.198959 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Deletion of /opt/stack/data/nova/instances/e9215353-288e-4ea9-89b2-5f6960210d42_del complete
May 27 23:22:00.705891 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Took 1.62 seconds to destroy the instance on the hypervisor.
May 27 23:22:00.706453 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:22:00.706637 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:22:00.706728 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:22:00.706969 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:22:00.764399 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:22:00.952680 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:01.329840 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1d14fb03-c0b5-45ea-ab4d-8d745f2db179 req-be556be0-a7d4-48d7-aba6-9270b14e6b4c service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Received event network-vif-deleted-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:22:01.330034 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-1d14fb03-c0b5-45ea-ab4d-8d745f2db179 req-be556be0-a7d4-48d7-aba6-9270b14e6b4c service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Neutron deleted interface 5b733c49-c4a8-4646-b5ae-89814f600a38; detaching it from the instance and deleting it from the info cache
May 27 23:22:01.331685 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1d14fb03-c0b5-45ea-ab4d-8d745f2db179 req-be556be0-a7d4-48d7-aba6-9270b14e6b4c service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Detach interface failed, port_id=5b733c49-c4a8-4646-b5ae-89814f600a38, reason: Instance e9215353-288e-4ea9-89b2-5f6960210d42 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:22:01.459479 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-52f508fb-6b5a-4e05-8a9f-271d00b72f87 req-be42c0e3-d54c-42ac-a6ac-6f141f620025 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Received event network-vif-unplugged-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:22:01.459645 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-52f508fb-6b5a-4e05-8a9f-271d00b72f87 req-be42c0e3-d54c-42ac-a6ac-6f141f620025 service nova] Acquiring lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:22:01.459787 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-52f508fb-6b5a-4e05-8a9f-271d00b72f87 req-be42c0e3-d54c-42ac-a6ac-6f141f620025 service nova] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:22:01.460122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-52f508fb-6b5a-4e05-8a9f-271d00b72f87 req-be42c0e3-d54c-42ac-a6ac-6f141f620025 service nova] Lock "e9215353-288e-4ea9-89b2-5f6960210d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:22:01.460181 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-52f508fb-6b5a-4e05-8a9f-271d00b72f87 req-be42c0e3-d54c-42ac-a6ac-6f141f620025 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] No waiting events found dispatching network-vif-unplugged-5b733c49-c4a8-4646-b5ae-89814f600a38 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:22:01.460503 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-52f508fb-6b5a-4e05-8a9f-271d00b72f87 req-be42c0e3-d54c-42ac-a6ac-6f141f620025 service nova] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Received event network-vif-unplugged-5b733c49-c4a8-4646-b5ae-89814f600a38 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:22:01.785862 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:22:02.288090 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Took 1.58 seconds to deallocate network for instance.
May 27 23:22:02.832689 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Took 0.54 seconds to detach 1 volumes for instance.
May 27 23:22:03.337523 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:22:03.337936 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:22:03.422240 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:22:03.422458 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:22:03.924841 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:22:04.433788 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.096s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:22:04.455417 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:04.478281 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deleted allocations for instance e9215353-288e-4ea9-89b2-5f6960210d42
May 27 23:22:04.894872 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:05.486102 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4dc24d0c-2097-4eed-987f-736bbe322db1 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "e9215353-288e-4ea9-89b2-5f6960210d42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.912s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:22:06.354533 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "3ad44af8-c055-4954-a2ac-980322690477" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:22:06.354788 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "3ad44af8-c055-4954-a2ac-980322690477" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:22:06.856534 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:22:06.859299 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:22:06.859620 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:22:06.859882 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:22:06.860269 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:22:06.860614 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.26 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:22:07.123749 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:22:07.124063 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:22:07.124298 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:22:07.398631 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:22:07.398808 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:22:07.401535 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:22:07.401654 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Claim successful on node np0000001565
May 27 23:22:08.123746 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:22:08.124236 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:22:08.124236 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:22:08.490958 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:22:08.491158 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:22:08.761884 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:22:08.993584 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:22:09.456562 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:09.499676 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.101s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:22:09.499953 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:22:09.896307 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:10.005342 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:22:10.005533 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:22:10.006106 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:22:10.006106 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:22:10.069048 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31823a44e786429f80ba607958f8b63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda425dab8946dc926808806eeedced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:22:10.124038 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:22:10.124342 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:22:10.508470 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:22:10.602300 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Successfully created port: b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:22:10.798147 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:11.012250 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:22:11.059512 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Successfully updated port: b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:22:11.104558 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ccdb5698-ccc6-4732-b6c1-6c2874427cc1 req-4fe25a4a-1dd6-4953-b1d2-bc3f96d15d5c service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Received event network-changed-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:22:11.104688 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ccdb5698-ccc6-4732-b6c1-6c2874427cc1 req-4fe25a4a-1dd6-4953-b1d2-bc3f96d15d5c service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Refreshing instance network info cache due to event network-changed-b19d5e54-bb3a-4e6d-aff0-337b4807e23f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:22:11.104855 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ccdb5698-ccc6-4732-b6c1-6c2874427cc1 req-4fe25a4a-1dd6-4953-b1d2-bc3f96d15d5c service nova] Acquiring lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:22:11.105165 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ccdb5698-ccc6-4732-b6c1-6c2874427cc1 req-4fe25a4a-1dd6-4953-b1d2-bc3f96d15d5c service nova] Acquired lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:22:11.105272 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ccdb5698-ccc6-4732-b6c1-6c2874427cc1 req-4fe25a4a-1dd6-4953-b1d2-bc3f96d15d5c service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Refreshing network info cache for port b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:22:11.516108 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Booting with volume b80f10e3-246c-4662-b3a9-33f4316361ca at /dev/vda
May 27 23:22:11.555019 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:22:11.561402 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:22:11.565241 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:22:11.581474 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:22:11.608575 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-ccdb5698-ccc6-4732-b6c1-6c2874427cc1 req-4fe25a4a-1dd6-4953-b1d2-bc3f96d15d5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:22:11.629227 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:22:11.629511 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:22:11.636771 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:22:11.637493 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43'] 
May 27 23:22:11.637600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:22:11.637719 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:22:11.637931 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:22:11.638116 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Updating existing volume attachment record: c6836ce2-e705-4401-92e6-c82b47d0d050 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:22:11.670399 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ccdb5698-ccc6-4732-b6c1-6c2874427cc1 req-4fe25a4a-1dd6-4953-b1d2-bc3f96d15d5c service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:22:11.789062 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-ccdb5698-ccc6-4732-b6c1-6c2874427cc1 req-4fe25a4a-1dd6-4953-b1d2-bc3f96d15d5c service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:22:12.291121 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ccdb5698-ccc6-4732-b6c1-6c2874427cc1 req-4fe25a4a-1dd6-4953-b1d2-bc3f96d15d5c service nova] Releasing lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:22:12.292631 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquired lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:22:12.292631 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:22:12.846436 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:22:12.979009 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:22:13.115283 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Updating instance_info_cache with network_info: [{"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:22:13.617039 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Releasing lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:22:13.617292 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Instance network_info: |[{"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:22:13.719548 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:22:13.720652 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:22:13.720919 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Creating image(s)
May 27 23:22:13.721271 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:22:13.721455 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Ensure instance console log exists: /opt/stack/data/nova/instances/3ad44af8-c055-4954-a2ac-980322690477/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:22:13.721724 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:22:13.721974 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:22:13.722139 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:22:13.722623 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Start _get_guest_xml network_info=[{"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c6836ce2-e705-4401-92e6-c82b47d0d050', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3ad44af8-c055-4954-a2ac-980322690477', 'attached_at': '', 'detached_at': '', 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'serial': 'b80f10e3-246c-4662-b3a9-33f4316361ca'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:22:13.726466 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:22:13.727470 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-798686209', uuid='3ad44af8-c055-4954-a2ac-980322690477'), owner=OwnerMeta(userid='31823a44e786429f80ba607958f8b63e', username='tempest-TestVolumeBootPattern-314561297-project-member', projectid='5dda425dab8946dc926808806eeedced', projectname='tempest-TestVolumeBootPattern-314561297'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779924133.7271602) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:22:13.728507 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:22:13.728797 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:22:13.729758 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:22:13.729922 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:22:13.730698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:22:13.730949 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:22:13.731073 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:22:13.731164 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:22:13.731271 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:22:13.731370 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:22:13.731456 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:22:13.731597 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:22:13.731689 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:22:13.731808 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:22:13.731903 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:22:13.732008 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:22:13.741238 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:22:13.741551 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:22:13.741668 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:22:13.741990 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:22:13.742167 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:22:13.752181 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:22:13.753061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:22:13.753580 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:22:13.753762 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:22:13.754173 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:22:13.754408 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:22:13.763705 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:22:13.763705 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:13.767631 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:22:13.767631 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:13.775980 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca] added
May 27 23:22:13.775980 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:22:13.775980 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:22:13.775980 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:22:13.775980 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:22:13.775980 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:22:13.775980 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:13.776182 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:22:13.776379 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:22:13.776549 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:22:13.779540 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca] added
May 27 23:22:13.779540 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:22:13.779540 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:22:13.779540 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:22:13.779540 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:22:13.779540 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:22:13.779540 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:13.779719 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:22:13.779955 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:22:13.780123 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:22:14.383703 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0011573759998100286 future=<Future at 0x726e38573e30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:22:14.384238 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] Emitting event <LifecycleEvent: 1779924119.3823237, e9215353-288e-4ea9-89b2-5f6960210d42 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:22:14.384419 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:22:14.384550 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] VM Stopped (Lifecycle Event)
May 27 23:22:14.777088 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:22:14.780569 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:22:14.788287 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:22:14.788287 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:22:14.794930 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:22:14.794930 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:14.801466 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:14.808600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:14.813281 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5e2857-876c-4e80-b6b5-dc9ca8fa51bc (non-flash)
May 27 23:22:14.813281 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:22:14.813435 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5e2857-876c-4e80-b6b5-dc9ca8fa51bc (non-flash)
May 27 23:22:14.813435 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:22:14.819861 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5e2857-876c-4e80-b6b5-dc9ca8fa51bc (non-flash)
May 27 23:22:14.819861 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:22:14.819981 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5e2857-876c-4e80-b6b5-dc9ca8fa51bc (non-flash)
May 27 23:22:14.819981 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:22:14.845769 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.40.100,3260]
May 27 23:22:14.845769 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.40.100,3260] successful.
May 27 23:22:14.845769 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:14.856896 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:14.867225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5e2857-876c-4e80-b6b5-dc9ca8fa51bc (non-flash)
May 27 23:22:14.867225 np0000001565 nova-compute[98289]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:22:14.867225 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:22:14.867418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5e2857-876c-4e80-b6b5-dc9ca8fa51bc (non-flash)
May 27 23:22:14.867418 np0000001565 nova-compute[98289]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:22:14.867418 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:22:14.867582 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.114s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:22:14.867721 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:22:14.868190 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('8', '-', '-', 0) found on session 206 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:22:14.868315 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:22:14.879650 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 206 and hctl ['8', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:22:14.887193 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ca8ea1de-fd3d-4ca4-b5db-ef1a19342994 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910 tempest-TestServerVolumeAttachScenarioOldVersion-1979128910-project-member] [instance: e9215353-288e-4ea9-89b2-5f6960210d42] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:22:14.898141 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:15.850448 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.50.100,3260]
May 27 23:22:15.850448 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.50.100,3260] successful.
May 27 23:22:15.850448 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:15.862505 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:22:15.874325 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5e2857-876c-4e80-b6b5-dc9ca8fa51bc (non-flash)
May 27 23:22:15.874325 np0000001565 nova-compute[98289]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:22:15.874325 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:22:15.874325 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:22:15.874571 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5e2857-876c-4e80-b6b5-dc9ca8fa51bc (non-flash)
May 27 23:22:15.874571 np0000001565 nova-compute[98289]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:22:15.874571 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:22:15.874571 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:22:15.874728 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.121s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:22:15.874873 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:22:15.875480 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('9', '-', '-', 0) found on session 207 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:22:15.875558 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:22:15.879436 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 206 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:22:15.879541 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:22:15.887736 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 207 and hctl ['9', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:22:16.887751 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 207 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:22:16.888061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:22:17.768894 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Found WWN 330000000be4fe95a for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:22:17.769184 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.027s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:22:17.769423 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== connect_volume: return (4027ms) {'type': 'block', 'scsi_wwn': '330000000be4fe95a', 'path': '/dev/dm-0', 'multipath_id': '330000000be4fe95a'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:22:17.769590 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000be4fe95a', 'path': '/dev/dm-0', 'multipath_id': '330000000be4fe95a'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:22:18.274817 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-798686209',display_name='tempest-TestVolumeBootPattern-server-798686209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-798686209',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkuQiL7HZCdOcvEM0oVjt1zbL4sjnserQYsaCb41sHx2Ro0t2FlJaex6LqEDdWRK1DFZ2DpPVIFBVDu6t/KipI5zPLFZL2mndVngoPZJuwR7U276gcCZA+LQx8nCmmkPg==',key_name='tempest-TestVolumeBootPattern-1236496757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-1r3ef4st',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:22:11Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=3ad44af8-c055-4954-a2ac-980322690477,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:22:18.275353 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:22:18.275438 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d2:f3,bridge_name='br-int',has_traffic_filtering=True,id=b19d5e54-bb3a-4e6d-aff0-337b4807e23f,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb19d5e54-bb') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:22:18.275929 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ad44af8-c055-4954-a2ac-980322690477 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:22:18.779818 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] End _get_guest_xml xml=<domain type="qemu">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <uuid>3ad44af8-c055-4954-a2ac-980322690477</uuid>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <name>instance-0000004d</name>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPattern-server-798686209</nova:name>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:22:13</nova:creationTime>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:user uuid="31823a44e786429f80ba607958f8b63e">tempest-TestVolumeBootPattern-314561297-project-member</nova:user>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:project uuid="5dda425dab8946dc926808806eeedced">tempest-TestVolumeBootPattern-314561297</nova:project>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         <nova:port uuid="b19d5e54-bb3a-4e6d-aff0-337b4807e23f">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <system>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <entry name="serial">3ad44af8-c055-4954-a2ac-980322690477</entry>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <entry name="uuid">3ad44af8-c055-4954-a2ac-980322690477</entry>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     </system>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <os>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   </os>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <features>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   </features>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   <devices>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/3ad44af8-c055-4954-a2ac-980322690477/disk.config"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     </disk>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <alias name="ua-b80f10e3-246c-4662-b3a9-33f4316361ca"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-0"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <serial>b80f10e3-246c-4662-b3a9-33f4316361ca</serial>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     </disk>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:d3:d2:f3"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <target dev="tapb19d5e54-bb"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     </interface>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/3ad44af8-c055-4954-a2ac-980322690477/console.log" append="off"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     </serial>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <video>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     </video>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     </rng>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:   </devices>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]: </domain>
May 27 23:22:18.779818 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:22:18.781674 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Preparing to wait for external event network-vif-plugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:22:18.781674 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "3ad44af8-c055-4954-a2ac-980322690477-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:22:18.781674 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:22:18.781674 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:22:18.781674 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-798686209',display_name='tempest-TestVolumeBootPattern-server-798686209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-798686209',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkuQiL7HZCdOcvEM0oVjt1zbL4sjnserQYsaCb41sHx2Ro0t2FlJaex6LqEDdWRK1DFZ2DpPVIFBVDu6t/KipI5zPLFZL2mndVngoPZJuwR7U276gcCZA+LQx8nCmmkPg==',key_name='tempest-TestVolumeBootPattern-1236496757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-1r3ef4st',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:22:11Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=3ad44af8-c055-4954-a2ac-980322690477,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:22:18.781674 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:22:18.781674 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d2:f3,bridge_name='br-int',has_traffic_filtering=True,id=b19d5e54-bb3a-4e6d-aff0-337b4807e23f,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb19d5e54-bb') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:22:18.781938 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d2:f3,bridge_name='br-int',has_traffic_filtering=True,id=b19d5e54-bb3a-4e6d-aff0-337b4807e23f,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb19d5e54-bb') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:22:18.781938 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:18.782179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:22:18.782431 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:22:18.782809 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:18.782933 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf3344ba-b781-588b-9f80-4de1373473f9', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:22:18.784344 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:18.784828 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:22:18.786301 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:18.786435 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb19d5e54-bb, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:22:18.786675 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb19d5e54-bb, col_values=(('qos', UUID('64b2954e-e36d-41fe-b74d-71e4916c9cce')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:22:18.786826 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb19d5e54-bb, col_values=(('external_ids', {'iface-id': 'b19d5e54-bb3a-4e6d-aff0-337b4807e23f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:d2:f3', 'vm-uuid': '3ad44af8-c055-4954-a2ac-980322690477'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:22:18.787568 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:18.788538 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:22:18.792191 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:18.793849 np0000001565 nova-compute[98289]: INFO os_vif [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d2:f3,bridge_name='br-int',has_traffic_filtering=True,id=b19d5e54-bb3a-4e6d-aff0-337b4807e23f,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb19d5e54-bb')
May 27 23:22:19.458230 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:20.307038 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:22:20.307038 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:22:20.307227 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No VIF found with MAC fa:16:3e:d3:d2:f3, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:22:20.307684 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Using config drive
May 27 23:22:20.814652 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:22:20.929198 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Creating config drive at /opt/stack/data/nova/instances/3ad44af8-c055-4954-a2ac-980322690477/disk.config
May 27 23:22:20.932524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3ad44af8-c055-4954-a2ac-980322690477/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz49knmu2 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:22:20.986434 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3ad44af8-c055-4954-a2ac-980322690477/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz49knmu2" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:22:21.348179 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:21.363808 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:21.454198 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:21.457769 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:21.498504 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f370ff87-1e50-4f22-994e-084054c9c737 req-0e7b69de-2c20-4947-9ae2-d3e996e9bde1 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Received event network-vif-plugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:22:21.499179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f370ff87-1e50-4f22-994e-084054c9c737 req-0e7b69de-2c20-4947-9ae2-d3e996e9bde1 service nova] Acquiring lock "3ad44af8-c055-4954-a2ac-980322690477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:22:21.499179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f370ff87-1e50-4f22-994e-084054c9c737 req-0e7b69de-2c20-4947-9ae2-d3e996e9bde1 service nova] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:22:21.499179 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f370ff87-1e50-4f22-994e-084054c9c737 req-0e7b69de-2c20-4947-9ae2-d3e996e9bde1 service nova] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:22:21.499179 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f370ff87-1e50-4f22-994e-084054c9c737 req-0e7b69de-2c20-4947-9ae2-d3e996e9bde1 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Processing event network-vif-plugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:22:21.660867 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:21.662376 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:21.664255 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:21.679533 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:22.057123 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:22:22.057680 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924142.0572727, 3ad44af8-c055-4954-a2ac-980322690477 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:22:22.057789 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3ad44af8-c055-4954-a2ac-980322690477] VM Started (Lifecycle Event)
May 27 23:22:22.061208 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:22:22.062902 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Instance spawned successfully.
May 27 23:22:22.063261 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:22:22.560478 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:22:22.562344 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:22:22.569140 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:22:22.569394 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:22:22.569594 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:22:22.569775 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:22:22.569988 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:22:22.570252 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:22:23.064541 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3ad44af8-c055-4954-a2ac-980322690477] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:22:23.064936 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924143.0645666, 3ad44af8-c055-4954-a2ac-980322690477 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:22:23.064936 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3ad44af8-c055-4954-a2ac-980322690477] VM Paused (Lifecycle Event)
May 27 23:22:23.075055 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Took 9.36 seconds to spawn the instance on the hypervisor.
May 27 23:22:23.075271 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:22:23.556933 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f6b623ae-b026-48a1-9cc0-98d4a331f8a6 req-22bf9123-7c4a-470a-9283-81c7cc900d85 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Received event network-vif-plugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:22:23.557380 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f6b623ae-b026-48a1-9cc0-98d4a331f8a6 req-22bf9123-7c4a-470a-9283-81c7cc900d85 service nova] Acquiring lock "3ad44af8-c055-4954-a2ac-980322690477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:22:23.557564 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f6b623ae-b026-48a1-9cc0-98d4a331f8a6 req-22bf9123-7c4a-470a-9283-81c7cc900d85 service nova] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:22:23.557702 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f6b623ae-b026-48a1-9cc0-98d4a331f8a6 req-22bf9123-7c4a-470a-9283-81c7cc900d85 service nova] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:22:23.557824 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f6b623ae-b026-48a1-9cc0-98d4a331f8a6 req-22bf9123-7c4a-470a-9283-81c7cc900d85 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] No waiting events found dispatching network-vif-plugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:22:23.557966 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-f6b623ae-b026-48a1-9cc0-98d4a331f8a6 req-22bf9123-7c4a-470a-9283-81c7cc900d85 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Received unexpected event network-vif-plugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f for instance with vm_state active and task_state None.
May 27 23:22:23.567514 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:22:23.569628 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924143.569375, 3ad44af8-c055-4954-a2ac-980322690477 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:22:23.569768 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3ad44af8-c055-4954-a2ac-980322690477] VM Resumed (Lifecycle Event)
May 27 23:22:23.585294 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Took 16.22 seconds to build instance.
May 27 23:22:23.789708 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:24.072296 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:22:24.076693 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:22:24.087115 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-7906fa15-3e7d-4e41-9297-3b14ba5c74c7 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "3ad44af8-c055-4954-a2ac-980322690477" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.732s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:22:24.459191 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:24.547855 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5603faee-94fa-403b-9077-7662edbd8bd4 req-a067b2b8-a6b4-4558-9c34-2c11b48cd2b3 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Received event network-changed-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:22:24.547950 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5603faee-94fa-403b-9077-7662edbd8bd4 req-a067b2b8-a6b4-4558-9c34-2c11b48cd2b3 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Refreshing instance network info cache due to event network-changed-b19d5e54-bb3a-4e6d-aff0-337b4807e23f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:22:24.548448 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5603faee-94fa-403b-9077-7662edbd8bd4 req-a067b2b8-a6b4-4558-9c34-2c11b48cd2b3 service nova] Acquiring lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:22:24.548448 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5603faee-94fa-403b-9077-7662edbd8bd4 req-a067b2b8-a6b4-4558-9c34-2c11b48cd2b3 service nova] Acquired lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:22:24.549633 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5603faee-94fa-403b-9077-7662edbd8bd4 req-a067b2b8-a6b4-4558-9c34-2c11b48cd2b3 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Refreshing network info cache for port b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:22:25.054985 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5603faee-94fa-403b-9077-7662edbd8bd4 req-a067b2b8-a6b4-4558-9c34-2c11b48cd2b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:22:25.394177 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-5603faee-94fa-403b-9077-7662edbd8bd4 req-a067b2b8-a6b4-4558-9c34-2c11b48cd2b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:22:25.532005 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5603faee-94fa-403b-9077-7662edbd8bd4 req-a067b2b8-a6b4-4558-9c34-2c11b48cd2b3 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Updated VIF entry in instance network info cache for port b19d5e54-bb3a-4e6d-aff0-337b4807e23f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:22:25.532269 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-5603faee-94fa-403b-9077-7662edbd8bd4 req-a067b2b8-a6b4-4558-9c34-2c11b48cd2b3 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Updating instance_info_cache with network_info: [{"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:22:26.035447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5603faee-94fa-403b-9077-7662edbd8bd4 req-a067b2b8-a6b4-4558-9c34-2c11b48cd2b3 service nova] Releasing lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:22:28.798084 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:29.460169 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:33.801677 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:34.461534 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:38.804775 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:39.462053 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:43.807136 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:44.463437 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:48.809984 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:49.464653 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:53.811913 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:54.465534 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:55.123889 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:22:55.627944 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:22:55.628096 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:22:55.628252 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:22:55.628422 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:22:56.647201 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:22:56.648882 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:22:56.649651 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:22:56.695658 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:22:56.696047 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13502MB free_disk=72.6694564819336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:22:56.696229 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:22:56.696450 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:22:57.752538 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 3ad44af8-c055-4954-a2ac-980322690477 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:22:57.752910 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:22:57.752910 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:22:56 up 51 min,  2 users,  load average: 2.39, 3.17, 3.68\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_5dda425dab8946dc926808806eeedced': '1', 'io_workload': '0'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:22:57.842715 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:22:57.842949 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:22:58.345365 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:22:58.813937 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:22:58.852844 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:22:58.853029 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.157s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:22:58.853383 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 8.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:22:59.466990 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:03.817079 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:04.386093 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "4199c008-c776-46af-bbc2-eaa869ac18fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:04.386269 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:04.467927 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:04.887949 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:23:05.435875 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:05.436099 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:05.438907 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:23:05.439083 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Claim successful on node np0000001565
May 27 23:23:06.571775 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:23:06.571775 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:23:06.853377 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:23:06.853654 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:23:06.853869 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:23:06.854120 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.27 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:23:07.073124 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:23:07.123670 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:23:07.123927 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:23:07.583737 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.148s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:07.584161 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:23:08.090069 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:23:08.090319 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:23:08.090641 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:08.090928 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:08.157450 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31823a44e786429f80ba607958f8b63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda425dab8946dc926808806eeedced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:23:08.460507 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:08.594354 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:23:08.605435 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Successfully created port: b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:23:08.817628 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:09.016117 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Successfully updated port: b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:23:09.058573 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2112dc4e-922b-4f9c-9f2c-02e120be50f0 req-2633f8ec-1ed4-4337-9a79-caed7aded4c7 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Received event network-changed-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:23:09.059095 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2112dc4e-922b-4f9c-9f2c-02e120be50f0 req-2633f8ec-1ed4-4337-9a79-caed7aded4c7 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Refreshing instance network info cache due to event network-changed-b56a0449-8e55-48e5-938f-6b6819fbf2d2. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:23:09.059153 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2112dc4e-922b-4f9c-9f2c-02e120be50f0 req-2633f8ec-1ed4-4337-9a79-caed7aded4c7 service nova] Acquiring lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:23:09.059308 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2112dc4e-922b-4f9c-9f2c-02e120be50f0 req-2633f8ec-1ed4-4337-9a79-caed7aded4c7 service nova] Acquired lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:23:09.059472 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2112dc4e-922b-4f9c-9f2c-02e120be50f0 req-2633f8ec-1ed4-4337-9a79-caed7aded4c7 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Refreshing network info cache for port b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:23:09.098640 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:23:09.124853 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:23:09.125383 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:23:09.519088 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:23:09.563776 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2112dc4e-922b-4f9c-9f2c-02e120be50f0 req-2633f8ec-1ed4-4337-9a79-caed7aded4c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:09.602458 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Booting with volume f5417f1d-8f96-46f9-84a0-a766ba4c9320 at /dev/vda
May 27 23:23:09.637126 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2112dc4e-922b-4f9c-9f2c-02e120be50f0 req-2633f8ec-1ed4-4337-9a79-caed7aded4c7 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:23:09.641888 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:23:09.652112 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:23:09.672826 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:09.714230 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:23:09.714936 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:23:09.725060 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:23:09.726373 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fed3:d2f3', 'fe80::b098:84ff:fe18:24bd'] 
May 27 23:23:09.726488 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:23:09.726606 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:23:09.726892 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:23:09.727139 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Updating existing volume attachment record: 6cdb7240-0126-402a-acf2-633b9debd46f {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:23:09.766048 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2112dc4e-922b-4f9c-9f2c-02e120be50f0 req-2633f8ec-1ed4-4337-9a79-caed7aded4c7 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:23:10.124035 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:23:10.124035 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:23:10.124533 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:23:10.272655 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2112dc4e-922b-4f9c-9f2c-02e120be50f0 req-2633f8ec-1ed4-4337-9a79-caed7aded4c7 service nova] Releasing lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:23:10.274865 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquired lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:23:10.275026 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:23:10.839750 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:23:10.978238 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:11.093625 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Updating instance_info_cache with network_info: [{"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:23:11.595534 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Releasing lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:23:11.595792 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Instance network_info: |[{"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:23:11.835576 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:23:11.836647 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:23:11.836936 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Creating image(s)
May 27 23:23:11.837238 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Did not create local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 23:23:11.837385 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Ensure instance console log exists: /opt/stack/data/nova/instances/4199c008-c776-46af-bbc2-eaa869ac18fa/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:23:11.837601 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:11.837789 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:11.837901 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:11.838364 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Start _get_guest_xml network_info=[{"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6cdb7240-0126-402a-acf2-633b9debd46f', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4199c008-c776-46af-bbc2-eaa869ac18fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'serial': 'f5417f1d-8f96-46f9-84a0-a766ba4c9320'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:23:11.841647 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:23:11.842579 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-228038631', uuid='4199c008-c776-46af-bbc2-eaa869ac18fa'), owner=OwnerMeta(userid='31823a44e786429f80ba607958f8b63e', username='tempest-TestVolumeBootPattern-314561297-project-member', projectid='5dda425dab8946dc926808806eeedced', projectname='tempest-TestVolumeBootPattern-314561297'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779924191.8422372) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:23:11.843593 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:23:11.843900 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:23:11.844739 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:23:11.844888 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:23:11.845705 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:23:11.845943 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:23:11.846099 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:23:11.846192 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:23:11.846303 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:23:11.846414 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:23:11.846504 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:23:11.846649 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:23:11.846751 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:23:11.846876 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:23:11.846992 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:23:11.847108 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:23:11.856259 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:23:11.856587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:23:11.856712 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:23:11.857061 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:23:11.857233 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:23:11.869065 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:23:11.869797 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:23:11.870204 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:23:11.870480 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:23:11.870828 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:23:11.871003 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:23:11.881600 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:23:11.881600 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:11.885757 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:23:11.885757 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:11.892718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320] added
May 27 23:23:11.892718 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:23:11.892718 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:23:11.892718 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:23:11.892718 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:23:11.892718 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:23:11.892718 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:11.893031 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:23:11.893211 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:23:11.893450 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:23:11.896414 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320] added
May 27 23:23:11.896414 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:23:11.896414 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:23:11.896414 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:23:11.896414 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:23:11.896414 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:23:11.896414 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:11.896572 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:23:11.896750 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:23:11.896876 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:23:12.124475 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:23:12.124761 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:23:12.893947 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:23:12.897185 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:23:12.909517 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:23:12.909517 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:23:12.913812 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:23:12.913812 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:12.919713 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:12.924843 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:12.932667 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:12.932667 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:12.932667 np0000001565 nova-compute[98289]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31937d8c-f74c-4486-899a-7db511777981 (non-flash)
May 27 23:23:12.932667 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:23:12.932849 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:12.932849 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:12.932849 np0000001565 nova-compute[98289]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31937d8c-f74c-4486-899a-7db511777981 (non-flash)
May 27 23:23:12.932849 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:23:12.939379 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:12.939379 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:12.939379 np0000001565 nova-compute[98289]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31937d8c-f74c-4486-899a-7db511777981 (non-flash)
May 27 23:23:12.939379 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:23:12.939530 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:12.939530 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:12.939530 np0000001565 nova-compute[98289]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31937d8c-f74c-4486-899a-7db511777981 (non-flash)
May 27 23:23:12.939530 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:23:12.978983 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320, portal: 192.168.50.100,3260]
May 27 23:23:12.978983 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320, portal: 192.168.50.100,3260] successful.
May 27 23:23:12.978983 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:12.992674 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:12.993079 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320, portal: 192.168.40.100,3260]
May 27 23:23:12.993079 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320, portal: 192.168.40.100,3260] successful.
May 27 23:23:12.993079 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31937d8c-f74c-4486-899a-7db511777981 (non-flash)
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:13.008354 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31937d8c-f74c-4486-899a-7db511777981 (non-flash)
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:13.008354 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('10', '-', '-', 0) found on session 212 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:23:13.008354 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:23:13.013233 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:13.022778 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 212 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:23:13.022778 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:23:13.027418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:13.027418 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:13.027418 np0000001565 nova-compute[98289]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31937d8c-f74c-4486-899a-7db511777981 (non-flash)
May 27 23:23:13.027418 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:13.027418 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:13.027418 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:23:13.027795 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:13.027795 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:13.027795 np0000001565 nova-compute[98289]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31937d8c-f74c-4486-899a-7db511777981 (non-flash)
May 27 23:23:13.027795 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:13.027795 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:13.027795 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:23:13.028512 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:23:13.028761 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:23:13.029715 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] HCTL ('11', '-', '-', 0) found on session 213 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:23:13.029823 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:23:13.045623 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 213 and hctl ['11', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:23:13.820277 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:14.046104 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Searching for a device in session 213 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:23:14.046481 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:23:14.888153 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Found WWN 33000000055dc8c57 for multipath device dm-3 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:23:14.888431 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:23:14.888596 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '33000000055dc8c57', 'path': '/dev/dm-3', 'multipath_id': '33000000055dc8c57'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:23:14.888710 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000055dc8c57', 'path': '/dev/dm-3', 'multipath_id': '33000000055dc8c57'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:23:15.124066 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:23:15.393511 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:23:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-228038631',display_name='tempest-TestVolumeBootPattern-server-228038631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-228038631',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkuQiL7HZCdOcvEM0oVjt1zbL4sjnserQYsaCb41sHx2Ro0t2FlJaex6LqEDdWRK1DFZ2DpPVIFBVDu6t/KipI5zPLFZL2mndVngoPZJuwR7U276gcCZA+LQx8nCmmkPg==',key_name='tempest-TestVolumeBootPattern-1236496757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-hrtxwdno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:23:09Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=4199c008-c776-46af-bbc2-eaa869ac18fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:23:15.393748 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:23:15.394285 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:83:6a,bridge_name='br-int',has_traffic_filtering=True,id=b56a0449-8e55-48e5-938f-6b6819fbf2d2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb56a0449-8e') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:23:15.394878 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'pci_devices' on Instance uuid 4199c008-c776-46af-bbc2-eaa869ac18fa {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:23:15.625654 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:23:15.897566 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] End _get_guest_xml xml=<domain type="qemu">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <uuid>4199c008-c776-46af-bbc2-eaa869ac18fa</uuid>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <name>instance-0000004e</name>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <nova:name>tempest-TestVolumeBootPattern-server-228038631</nova:name>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:23:11</nova:creationTime>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <nova:image uuid="">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:user uuid="31823a44e786429f80ba607958f8b63e">tempest-TestVolumeBootPattern-314561297-project-member</nova:user>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:project uuid="5dda425dab8946dc926808806eeedced">tempest-TestVolumeBootPattern-314561297</nova:project>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <nova:root type="volume" uuid=""/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         <nova:port uuid="b56a0449-8e55-48e5-938f-6b6819fbf2d2">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <system>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <entry name="serial">4199c008-c776-46af-bbc2-eaa869ac18fa</entry>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <entry name="uuid">4199c008-c776-46af-bbc2-eaa869ac18fa</entry>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     </system>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <os>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   </os>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <features>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   </features>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   <devices>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/4199c008-c776-46af-bbc2-eaa869ac18fa/disk.config"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     </disk>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <alias name="ua-f5417f1d-8f96-46f9-84a0-a766ba4c9320"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-3"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <serial>f5417f1d-8f96-46f9-84a0-a766ba4c9320</serial>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     </disk>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:b1:83:6a"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <target dev="tapb56a0449-8e"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     </interface>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/4199c008-c776-46af-bbc2-eaa869ac18fa/console.log" append="off"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     </serial>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <video>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     </video>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     </rng>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:   </devices>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]: </domain>
May 27 23:23:15.897566 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:23:15.900988 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Preparing to wait for external event network-vif-plugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:23:15.900988 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:15.900988 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:15.900988 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:15.900988 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:23:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-228038631',display_name='tempest-TestVolumeBootPattern-server-228038631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-228038631',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkuQiL7HZCdOcvEM0oVjt1zbL4sjnserQYsaCb41sHx2Ro0t2FlJaex6LqEDdWRK1DFZ2DpPVIFBVDu6t/KipI5zPLFZL2mndVngoPZJuwR7U276gcCZA+LQx8nCmmkPg==',key_name='tempest-TestVolumeBootPattern-1236496757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-hrtxwdno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:23:09Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=4199c008-c776-46af-bbc2-eaa869ac18fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:23:15.900988 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:23:15.900988 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:83:6a,bridge_name='br-int',has_traffic_filtering=True,id=b56a0449-8e55-48e5-938f-6b6819fbf2d2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb56a0449-8e') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:23:15.900988 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:83:6a,bridge_name='br-int',has_traffic_filtering=True,id=b56a0449-8e55-48e5-938f-6b6819fbf2d2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb56a0449-8e') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:23:15.900988 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:15.901631 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:23:15.901631 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:23:15.901959 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:15.902126 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94f8fd73-a021-5941-b3c7-a8da6e0707a2', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:23:15.902988 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:15.903650 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:23:15.904199 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:15.905744 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:15.905880 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb56a0449-8e, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:23:15.906214 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb56a0449-8e, col_values=(('qos', UUID('a3143e45-92b7-447d-adcf-4a52a29a23ae')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:23:15.906407 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb56a0449-8e, col_values=(('external_ids', {'iface-id': 'b56a0449-8e55-48e5-938f-6b6819fbf2d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:83:6a', 'vm-uuid': '4199c008-c776-46af-bbc2-eaa869ac18fa'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:23:15.907166 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:15.908276 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:23:15.912592 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:15.913451 np0000001565 nova-compute[98289]: INFO os_vif [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:83:6a,bridge_name='br-int',has_traffic_filtering=True,id=b56a0449-8e55-48e5-938f-6b6819fbf2d2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb56a0449-8e')
May 27 23:23:17.428767 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:23:17.429055 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:23:17.429055 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] No VIF found with MAC fa:16:3e:b1:83:6a, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:23:17.429311 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Using config drive
May 27 23:23:17.933884 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:18.030718 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Creating config drive at /opt/stack/data/nova/instances/4199c008-c776-46af-bbc2-eaa869ac18fa/disk.config
May 27 23:23:18.033496 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4199c008-c776-46af-bbc2-eaa869ac18fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp34upvcds {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:18.082850 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4199c008-c776-46af-bbc2-eaa869ac18fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp34upvcds" returned: 0 in 0.049s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:23:18.434945 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:18.452134 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:18.454632 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:18.545674 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:18.575940 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d39bd505-a739-49fd-9285-0bdc867f9f71 req-a4ec9309-bf81-4927-9740-87cfe00138d5 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Received event network-vif-plugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:23:18.576167 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d39bd505-a739-49fd-9285-0bdc867f9f71 req-a4ec9309-bf81-4927-9740-87cfe00138d5 service nova] Acquiring lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:18.576675 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d39bd505-a739-49fd-9285-0bdc867f9f71 req-a4ec9309-bf81-4927-9740-87cfe00138d5 service nova] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:18.577107 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d39bd505-a739-49fd-9285-0bdc867f9f71 req-a4ec9309-bf81-4927-9740-87cfe00138d5 service nova] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:18.577107 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d39bd505-a739-49fd-9285-0bdc867f9f71 req-a4ec9309-bf81-4927-9740-87cfe00138d5 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Processing event network-vif-plugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:23:18.581317 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:18.582194 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:19.115289 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924199.11488, 4199c008-c776-46af-bbc2-eaa869ac18fa => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:23:19.115426 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] VM Started (Lifecycle Event)
May 27 23:23:19.117421 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:23:19.119599 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:23:19.122912 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Instance spawned successfully.
May 27 23:23:19.123200 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:23:19.470754 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:19.618994 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:23:19.621184 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:23:19.627546 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:23:19.627546 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 27 23:23:19.632061 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:19.632150 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:19.632411 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:19.632601 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:19.632899 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:19.633111 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:20.123549 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:23:20.123950 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924200.1236699, 4199c008-c776-46af-bbc2-eaa869ac18fa => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:23:20.124121 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] VM Paused (Lifecycle Event)
May 27 23:23:20.131392 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] There are 0 instances to clean {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 27 23:23:20.131643 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:23:20.138181 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Took 8.30 seconds to spawn the instance on the hypervisor.
May 27 23:23:20.138608 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:23:20.626693 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:23:20.628757 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924200.6285207, 4199c008-c776-46af-bbc2-eaa869ac18fa => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:23:20.628901 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] VM Resumed (Lifecycle Event)
May 27 23:23:20.633697 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7bf77252-2ae9-4e0f-856b-30c615d702a6 req-96a9ed9f-cb72-449f-befd-07bcc5c3d661 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Received event network-vif-plugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:23:20.633896 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7bf77252-2ae9-4e0f-856b-30c615d702a6 req-96a9ed9f-cb72-449f-befd-07bcc5c3d661 service nova] Acquiring lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:20.634059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7bf77252-2ae9-4e0f-856b-30c615d702a6 req-96a9ed9f-cb72-449f-befd-07bcc5c3d661 service nova] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:20.634182 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7bf77252-2ae9-4e0f-856b-30c615d702a6 req-96a9ed9f-cb72-449f-befd-07bcc5c3d661 service nova] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:20.634316 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7bf77252-2ae9-4e0f-856b-30c615d702a6 req-96a9ed9f-cb72-449f-befd-07bcc5c3d661 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] No waiting events found dispatching network-vif-plugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:23:20.634466 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-7bf77252-2ae9-4e0f-856b-30c615d702a6 req-96a9ed9f-cb72-449f-befd-07bcc5c3d661 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Received unexpected event network-vif-plugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 for instance with vm_state active and task_state None.
May 27 23:23:20.650078 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Took 15.26 seconds to build instance.
May 27 23:23:20.908688 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:21.131426 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:23:21.133171 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:23:21.151401 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1175713f-c1de-42d1-be28-c0d8c331b570 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.765s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:22.426842 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-28e94273-814b-4414-9f43-faf5046c324d req-48abed3d-8c85-4a14-921c-fb945c12d611 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Received event network-changed-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:23:22.427259 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-28e94273-814b-4414-9f43-faf5046c324d req-48abed3d-8c85-4a14-921c-fb945c12d611 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Refreshing instance network info cache due to event network-changed-b56a0449-8e55-48e5-938f-6b6819fbf2d2. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:23:22.427507 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-28e94273-814b-4414-9f43-faf5046c324d req-48abed3d-8c85-4a14-921c-fb945c12d611 service nova] Acquiring lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:23:22.427618 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-28e94273-814b-4414-9f43-faf5046c324d req-48abed3d-8c85-4a14-921c-fb945c12d611 service nova] Acquired lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:23:22.427822 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-28e94273-814b-4414-9f43-faf5046c324d req-48abed3d-8c85-4a14-921c-fb945c12d611 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Refreshing network info cache for port b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:23:22.930296 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-28e94273-814b-4414-9f43-faf5046c324d req-48abed3d-8c85-4a14-921c-fb945c12d611 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:23.218347 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-28e94273-814b-4414-9f43-faf5046c324d req-48abed3d-8c85-4a14-921c-fb945c12d611 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:23.349853 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-28e94273-814b-4414-9f43-faf5046c324d req-48abed3d-8c85-4a14-921c-fb945c12d611 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Updated VIF entry in instance network info cache for port b56a0449-8e55-48e5-938f-6b6819fbf2d2. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:23:23.350150 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-28e94273-814b-4414-9f43-faf5046c324d req-48abed3d-8c85-4a14-921c-fb945c12d611 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Updating instance_info_cache with network_info: [{"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:23:23.852061 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-28e94273-814b-4414-9f43-faf5046c324d req-48abed3d-8c85-4a14-921c-fb945c12d611 service nova] Releasing lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:23:24.124187 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:23:24.124365 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98289) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 27 23:23:24.472444 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:24.626501 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 32.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:23:25.910822 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:29.473744 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:30.912551 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:34.474645 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:35.912922 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:38.167849 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "89edf412-f1ac-4877-9fc8-22996056329c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:38.168410 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "89edf412-f1ac-4877-9fc8-22996056329c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:38.670043 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:23:39.330783 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:39.331060 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:39.333879 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:23:39.334012 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Claim successful on node np0000001565
May 27 23:23:39.475922 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:40.377190 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Refreshing inventories for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 27 23:23:40.412518 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Updating ProviderTree inventory for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 27 23:23:40.412659 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Updating inventory in ProviderTree for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 23:23:40.448420 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Refreshing aggregate associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, aggregates: None {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 27 23:23:40.489320 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Refreshing trait associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_PPC64LE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_AARCH64,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_STATELESS_FIRMWARE {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 27 23:23:40.638247 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:23:40.638484 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:23:40.913839 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:41.141191 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:23:41.647622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.316s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:41.648087 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:23:42.153163 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:23:42.153363 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:23:42.153614 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:42.153903 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:42.215077 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '591adce03570420b88d602af6f874d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869f9c08edb643a185b92c3dcc03c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:23:42.601159 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Successfully created port: eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:23:42.656592 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:23:43.024125 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Successfully updated port: eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:23:43.068412 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-43fbe915-1382-4eb3-9ff1-791aae5e6bfb req-9ff40a90-e7aa-4eaf-8e03-8680c881474e service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Received event network-changed-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:23:43.068528 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-43fbe915-1382-4eb3-9ff1-791aae5e6bfb req-9ff40a90-e7aa-4eaf-8e03-8680c881474e service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Refreshing instance network info cache due to event network-changed-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:23:43.068699 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-43fbe915-1382-4eb3-9ff1-791aae5e6bfb req-9ff40a90-e7aa-4eaf-8e03-8680c881474e service nova] Acquiring lock "refresh_cache-89edf412-f1ac-4877-9fc8-22996056329c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:23:43.068784 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-43fbe915-1382-4eb3-9ff1-791aae5e6bfb req-9ff40a90-e7aa-4eaf-8e03-8680c881474e service nova] Acquired lock "refresh_cache-89edf412-f1ac-4877-9fc8-22996056329c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:23:43.068891 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-43fbe915-1382-4eb3-9ff1-791aae5e6bfb req-9ff40a90-e7aa-4eaf-8e03-8680c881474e service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Refreshing network info cache for port eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:23:43.525853 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "refresh_cache-89edf412-f1ac-4877-9fc8-22996056329c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:23:43.570537 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-43fbe915-1382-4eb3-9ff1-791aae5e6bfb req-9ff40a90-e7aa-4eaf-8e03-8680c881474e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:43.633714 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-43fbe915-1382-4eb3-9ff1-791aae5e6bfb req-9ff40a90-e7aa-4eaf-8e03-8680c881474e service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:23:43.663697 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:23:43.749922 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-43fbe915-1382-4eb3-9ff1-791aae5e6bfb req-9ff40a90-e7aa-4eaf-8e03-8680c881474e service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:23:44.167992 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Booting with volume 5aaeac01-b895-46ea-9271-1451c3828218 at /dev/vdb
May 27 23:23:44.205220 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:23:44.215749 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:23:44.234729 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:44.253157 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-43fbe915-1382-4eb3-9ff1-791aae5e6bfb req-9ff40a90-e7aa-4eaf-8e03-8680c881474e service nova] Releasing lock "refresh_cache-89edf412-f1ac-4877-9fc8-22996056329c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:23:44.254121 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquired lock "refresh_cache-89edf412-f1ac-4877-9fc8-22996056329c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:23:44.254422 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:23:44.276954 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:23:44.277178 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:23:44.285196 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:23:44.286088 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fed3:d2f3', 'fe80::b098:84ff:fe18:24bd', 'fe80::fc16:3eff:feb1:836a'] 
May 27 23:23:44.286188 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:23:44.286305 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:23:44.286537 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:23:44.286726 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Updating existing volume attachment record: d63851af-3302-468a-a858-270989601d87 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:23:44.477999 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:44.810488 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:23:44.937814 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:45.047866 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Updating instance_info_cache with network_info: [{"id": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "address": "fa:16:3e:a4:7f:11", "network": {"id": "c84ced41-8d01-49a7-ba90-b7b2199c2456", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2004961323-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "869f9c08edb643a185b92c3dcc03c575", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabfc672-0f", "ovs_interfaceid": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:23:45.549937 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Releasing lock "refresh_cache-89edf412-f1ac-4877-9fc8-22996056329c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:23:45.550265 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Instance network_info: |[{"id": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "address": "fa:16:3e:a4:7f:11", "network": {"id": "c84ced41-8d01-49a7-ba90-b7b2199c2456", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2004961323-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "869f9c08edb643a185b92c3dcc03c575", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabfc672-0f", "ovs_interfaceid": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:23:45.915210 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:46.376226 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:23:46.377343 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:23:46.377608 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Creating image(s)
May 27 23:23:46.378085 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "/opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:46.378318 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "/opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:46.378773 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "/opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:46.379243 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:23:46.382007 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:23:46.383132 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:46.473349 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:23:46.473779 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:46.474250 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:46.474770 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:23:46.477396 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:23:46.477924 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:46.569352 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.091s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:23:46.569879 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:46.626470 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk 1073741824" returned: 0 in 0.056s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:23:46.626918 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:46.627213 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:46.714869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:23:46.715320 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:23:46.715589 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:46.797079 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:23:46.797455 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Cannot resize image /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:23:46.797943 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:23:46.798244 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Ensure instance console log exists: /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:23:46.798607 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:46.798857 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:46.799010 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:46.801178 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Start _get_guest_xml network_info=[{"id": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "address": "fa:16:3e:a4:7f:11", "network": {"id": "c84ced41-8d01-49a7-ba90-b7b2199c2456", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2004961323-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "869f9c08edb643a185b92c3dcc03c575", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabfc672-0f", "ovs_interfaceid": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd63851af-3302-468a-a858-270989601d87', 'device_type': 'disk', 'boot_index': -1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5aaeac01-b895-46ea-9271-1451c3828218', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '89edf412-f1ac-4877-9fc8-22996056329c', 'attached_at': '', 'detached_at': '', 'volume_id': '5aaeac01-b895-46ea-9271-1451c3828218', 'serial': '5aaeac01-b895-46ea-9271-1451c3828218'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:23:46.804828 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:23:46.806313 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-instance-550054679', uuid='89edf412-f1ac-4877-9fc8-22996056329c'), owner=OwnerMeta(userid='591adce03570420b88d602af6f874d52', username='tempest-VolumesBackupsTest-1646956116-project-member', projectid='869f9c08edb643a185b92c3dcc03c575', projectname='tempest-VolumesBackupsTest-1646956116'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "address": "fa:16:3e:a4:7f:11", "network": {"id": "c84ced41-8d01-49a7-ba90-b7b2199c2456", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2004961323-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "869f9c08edb643a185b92c3dcc03c575", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabfc672-0f", "ovs_interfaceid": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779924226.8059423) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:23:46.807529 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:23:46.807868 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:23:46.808768 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:23:46.808929 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:23:46.809835 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:23:46.810173 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:23:46.810322 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:23:46.810432 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:23:46.810542 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:23:46.810636 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:23:46.810802 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:23:46.810947 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:23:46.811048 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:23:46.811167 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:23:46.811264 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:23:46.811393 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:23:46.821019 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:23:46.821325 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5aaeac01-b895-46ea-9271-1451c3828218', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:23:46.821464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:23:46.821766 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:23:46.821934 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5aaeac01-b895-46ea-9271-1451c3828218', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:23:46.833552 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:23:46.834022 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:23:46.834542 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:23:46.834766 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:23:46.835096 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:23:46.835257 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:23:46.855440 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:23:46.855440 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:46.855818 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:23:46.855818 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:46.865826 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218] added
May 27 23:23:46.865826 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:23:46.865826 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:23:46.865826 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:23:46.865826 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:23:46.865826 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:23:46.865826 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:46.866095 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:23:46.866237 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:23:46.866446 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:23:46.867912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218] added
May 27 23:23:46.867912 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:23:46.867912 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:23:46.867912 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:23:46.867912 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:23:46.867912 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:23:46.867912 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:46.868176 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:23:46.868231 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0329(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:23:46.868414 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:23:47.866889 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:23:47.869711 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:23:47.880205 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:23:47.880205 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:23:47.882888 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:23:47.882888 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:47.891865 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:47.897662 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:47.905085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.905085 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.905085 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.905085 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.905085 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:23:47.905308 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.905308 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.905308 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.905308 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.905308 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:23:47.910047 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.910047 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.910047 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.910047 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.910047 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:23:47.910246 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.910246 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.910246 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.910246 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.910246 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:23:47.941539 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218, portal: 192.168.40.100,3260]
May 27 23:23:47.941539 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218, portal: 192.168.40.100,3260] successful.
May 27 23:23:47.941539 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:47.952706 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218, portal: 192.168.50.100,3260]
May 27 23:23:47.952706 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218, portal: 192.168.50.100,3260] successful.
May 27 23:23:47.952706 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:47.953347 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:47.964723 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:23:47.971209 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.971209 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.971209 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.971209 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.971209 np0000001565 nova-compute[98289]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:23:47.971209 np0000001565 nova-compute[98289]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:23:47.971209 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:23:47.971422 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.971422 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.971422 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.971422 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.971422 np0000001565 nova-compute[98289]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:23:47.971422 np0000001565 nova-compute[98289]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:23:47.971422 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:23:47.971805 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:23:47.971927 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:23:47.972679 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] HCTL ('7', '-', '-', 0) found on session 215 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:23:47.972811 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:23:47.979440 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.979440 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.979440 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.979440 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.979440 np0000001565 nova-compute[98289]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:23:47.979440 np0000001565 nova-compute[98289]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:23:47.979440 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:23:47.979613 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.979613 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:23:47.979613 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.979613 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:23:47.979613 np0000001565 nova-compute[98289]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:23:47.979613 np0000001565 nova-compute[98289]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:23:47.979613 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:23:47.979909 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:23:47.980045 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:23:47.980741 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] HCTL ('12', '-', '-', 0) found on session 216 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:23:47.980875 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:23:47.986910 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Searching for a device in session 215 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:23:47.986910 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5aaeac01-b895-46ea-9271-1451c3828218', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:23:47.993701 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Searching for a device in session 216 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:23:47.993766 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5aaeac01-b895-46ea-9271-1451c3828218', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:23:48.835367 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:23:49.480949 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:49.850184 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Found WWN 3300000002a2250f5 for multipath device dm-6 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:23:49.850510 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:23:49.850684 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000002a2250f5', 'path': '/dev/dm-6', 'multipath_id': '3300000002a2250f5'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:23:49.850815 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002a2250f5', 'path': '/dev/dm-6', 'multipath_id': '3300000002a2250f5'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:23:50.356752 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-550054679',display_name='tempest-instance-550054679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-instance-550054679',id=79,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUTQ8UcaplUnsxbChfsdQlMvytQKrPK9Z09o9nVaf6Ik9+alXekl8Kcfc56y2j3E/RWuLDgJwbJ5g7pgkpP8+PubB6rFfHwvTUEbcjbjq6/X2ejRbUeiaoZ0L/MXcv7Yw==',key_name='tempest-keypair-743283956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='869f9c08edb643a185b92c3dcc03c575',ramdisk_id='',reservation_id='r-0g5hejkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1646956116',owner_user_name='tempest-VolumesBackupsTest-1646956116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='591adce03570420b88d602af6f874d52',uuid=89edf412-f1ac-4877-9fc8-22996056329c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "address": "fa:16:3e:a4:7f:11", "network": {"id": "c84ced41-8d01-49a7-ba90-b7b2199c2456", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2004961323-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "869f9c08edb643a185b92c3dcc03c575", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabfc672-0f", "ovs_interfaceid": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:23:50.357073 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Converting VIF {"id": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "address": "fa:16:3e:a4:7f:11", "network": {"id": "c84ced41-8d01-49a7-ba90-b7b2199c2456", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2004961323-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "869f9c08edb643a185b92c3dcc03c575", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabfc672-0f", "ovs_interfaceid": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:23:50.357780 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7f:11,bridge_name='br-int',has_traffic_filtering=True,id=eabfc672-0ffa-42bd-8ae5-8fab0ab602ea,network=Network(c84ced41-8d01-49a7-ba90-b7b2199c2456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabfc672-0f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:23:50.358441 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lazy-loading 'pci_devices' on Instance uuid 89edf412-f1ac-4877-9fc8-22996056329c {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:23:50.861139 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] End _get_guest_xml xml=<domain type="qemu">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <uuid>89edf412-f1ac-4877-9fc8-22996056329c</uuid>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <name>instance-0000004f</name>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <nova:name>tempest-instance-550054679</nova:name>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:23:46</nova:creationTime>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:user uuid="591adce03570420b88d602af6f874d52">tempest-VolumesBackupsTest-1646956116-project-member</nova:user>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:project uuid="869f9c08edb643a185b92c3dcc03c575">tempest-VolumesBackupsTest-1646956116</nova:project>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         <nova:port uuid="eabfc672-0ffa-42bd-8ae5-8fab0ab602ea">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <system>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <entry name="serial">89edf412-f1ac-4877-9fc8-22996056329c</entry>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <entry name="uuid">89edf412-f1ac-4877-9fc8-22996056329c</entry>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     </system>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <os>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   </os>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <features>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   </features>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   <devices>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     </disk>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk.config"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     </disk>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <disk type="block" device="disk">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <alias name="ua-5aaeac01-b895-46ea-9271-1451c3828218"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <source dev="/dev/dm-6"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <target dev="vdb" bus="virtio"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <serial>5aaeac01-b895-46ea-9271-1451c3828218</serial>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     </disk>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:a4:7f:11"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <target dev="tapeabfc672-0f"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     </interface>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/console.log" append="off"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     </serial>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <video>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     </video>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     </rng>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:   </devices>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]: </domain>
May 27 23:23:50.861139 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Preparing to wait for external event network-vif-plugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "89edf412-f1ac-4877-9fc8-22996056329c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-550054679',display_name='tempest-instance-550054679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-instance-550054679',id=79,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUTQ8UcaplUnsxbChfsdQlMvytQKrPK9Z09o9nVaf6Ik9+alXekl8Kcfc56y2j3E/RWuLDgJwbJ5g7pgkpP8+PubB6rFfHwvTUEbcjbjq6/X2ejRbUeiaoZ0L/MXcv7Yw==',key_name='tempest-keypair-743283956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='869f9c08edb643a185b92c3dcc03c575',ramdisk_id='',reservation_id='r-0g5hejkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1646956116',owner_user_name='tempest-VolumesBackupsTest-1646956116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='591adce03570420b88d602af6f874d52',uuid=89edf412-f1ac-4877-9fc8-22996056329c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "address": "fa:16:3e:a4:7f:11", "network": {"id": "c84ced41-8d01-49a7-ba90-b7b2199c2456", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2004961323-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "869f9c08edb643a185b92c3dcc03c575", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabfc672-0f", "ovs_interfaceid": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Converting VIF {"id": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "address": "fa:16:3e:a4:7f:11", "network": {"id": "c84ced41-8d01-49a7-ba90-b7b2199c2456", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2004961323-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "869f9c08edb643a185b92c3dcc03c575", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabfc672-0f", "ovs_interfaceid": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7f:11,bridge_name='br-int',has_traffic_filtering=True,id=eabfc672-0ffa-42bd-8ae5-8fab0ab602ea,network=Network(c84ced41-8d01-49a7-ba90-b7b2199c2456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabfc672-0f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7f:11,bridge_name='br-int',has_traffic_filtering=True,id=eabfc672-0ffa-42bd-8ae5-8fab0ab602ea,network=Network(c84ced41-8d01-49a7-ba90-b7b2199c2456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabfc672-0f') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:50.867021 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '127c1436-a2f0-505f-98b3-a7137ecc432b', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:23:50.869718 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:50.869718 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:23:50.871904 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:50.871904 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeabfc672-0f, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:23:50.871904 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeabfc672-0f, col_values=(('qos', UUID('5dfcda7c-6138-489d-b324-6e0cb39c0bf1')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:23:50.871904 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeabfc672-0f, col_values=(('external_ids', {'iface-id': 'eabfc672-0ffa-42bd-8ae5-8fab0ab602ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:7f:11', 'vm-uuid': '89edf412-f1ac-4877-9fc8-22996056329c'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:23:50.873601 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:50.873601 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:23:50.878748 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:50.879523 np0000001565 nova-compute[98289]: INFO os_vif [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7f:11,bridge_name='br-int',has_traffic_filtering=True,id=eabfc672-0ffa-42bd-8ae5-8fab0ab602ea,network=Network(c84ced41-8d01-49a7-ba90-b7b2199c2456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabfc672-0f')
May 27 23:23:52.393581 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:23:52.394083 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:23:52.394083 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:23:52.394083 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] No VIF found with MAC fa:16:3e:a4:7f:11, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:23:52.394380 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Using config drive
May 27 23:23:52.899230 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:52.998985 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Creating config drive at /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk.config
May 27 23:23:53.002645 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpci3l6xnu {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:53.055721 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpci3l6xnu" returned: 0 in 0.053s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:23:53.422596 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:53.438825 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:53.440931 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:53.526601 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:53.570755 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4ff90346-a8b6-4cff-8256-ed64591048f3 req-f6f2a529-46ad-4074-83b3-0f22718ce092 service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Received event network-vif-plugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:23:53.571259 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4ff90346-a8b6-4cff-8256-ed64591048f3 req-f6f2a529-46ad-4074-83b3-0f22718ce092 service nova] Acquiring lock "89edf412-f1ac-4877-9fc8-22996056329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:53.571368 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4ff90346-a8b6-4cff-8256-ed64591048f3 req-f6f2a529-46ad-4074-83b3-0f22718ce092 service nova] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:53.571514 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-4ff90346-a8b6-4cff-8256-ed64591048f3 req-f6f2a529-46ad-4074-83b3-0f22718ce092 service nova] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:53.571750 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-4ff90346-a8b6-4cff-8256-ed64591048f3 req-f6f2a529-46ad-4074-83b3-0f22718ce092 service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Processing event network-vif-plugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:23:53.728449 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:53.746879 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:53.747888 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:54.100953 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:23:54.101512 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924234.1010504, 89edf412-f1ac-4877-9fc8-22996056329c => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:23:54.101760 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] VM Started (Lifecycle Event)
May 27 23:23:54.103744 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:23:54.106496 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Instance spawned successfully.
May 27 23:23:54.107258 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:23:54.481570 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:54.604803 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:23:54.606602 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:23:54.612461 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:54.612614 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:54.612980 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:54.613274 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:54.613619 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:54.613935 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:23:55.110685 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:23:55.110981 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924235.1107872, 89edf412-f1ac-4877-9fc8-22996056329c => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:23:55.111101 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] VM Paused (Lifecycle Event)
May 27 23:23:55.119501 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Took 8.74 seconds to spawn the instance on the hypervisor.
May 27 23:23:55.119683 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:23:55.613321 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:23:55.615674 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924235.6154552, 89edf412-f1ac-4877-9fc8-22996056329c => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:23:55.615801 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] VM Resumed (Lifecycle Event)
May 27 23:23:55.629260 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Took 16.46 seconds to build instance.
May 27 23:23:55.633096 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dbb726e3-e12e-47f0-94bf-e9bc5071e1ff req-bbfc20c8-f501-4920-889c-28c398a449bd service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Received event network-vif-plugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:23:55.635761 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dbb726e3-e12e-47f0-94bf-e9bc5071e1ff req-bbfc20c8-f501-4920-889c-28c398a449bd service nova] Acquiring lock "89edf412-f1ac-4877-9fc8-22996056329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:55.635956 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dbb726e3-e12e-47f0-94bf-e9bc5071e1ff req-bbfc20c8-f501-4920-889c-28c398a449bd service nova] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:55.636087 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-dbb726e3-e12e-47f0-94bf-e9bc5071e1ff req-bbfc20c8-f501-4920-889c-28c398a449bd service nova] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:55.636207 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-dbb726e3-e12e-47f0-94bf-e9bc5071e1ff req-bbfc20c8-f501-4920-889c-28c398a449bd service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] No waiting events found dispatching network-vif-plugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:23:55.636325 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-dbb726e3-e12e-47f0-94bf-e9bc5071e1ff req-bbfc20c8-f501-4920-889c-28c398a449bd service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Received unexpected event network-vif-plugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea for instance with vm_state active and task_state None.
May 27 23:23:55.874183 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:56.118051 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:23:56.119764 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:23:56.131286 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "89edf412-f1ac-4877-9fc8-22996056329c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.963s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:56.626281 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:23:57.130146 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:57.130413 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:57.130487 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:57.130588 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:23:57.706446 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b5c63996-c433-4b6f-846f-7c49d238f668 req-8b88620b-7113-4dee-9630-98c464e32e36 service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Received event network-changed-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:23:57.706915 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b5c63996-c433-4b6f-846f-7c49d238f668 req-8b88620b-7113-4dee-9630-98c464e32e36 service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Refreshing instance network info cache due to event network-changed-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:23:57.706915 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b5c63996-c433-4b6f-846f-7c49d238f668 req-8b88620b-7113-4dee-9630-98c464e32e36 service nova] Acquiring lock "refresh_cache-89edf412-f1ac-4877-9fc8-22996056329c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:23:57.706915 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b5c63996-c433-4b6f-846f-7c49d238f668 req-8b88620b-7113-4dee-9630-98c464e32e36 service nova] Acquired lock "refresh_cache-89edf412-f1ac-4877-9fc8-22996056329c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:23:57.707074 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b5c63996-c433-4b6f-846f-7c49d238f668 req-8b88620b-7113-4dee-9630-98c464e32e36 service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Refreshing network info cache for port eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:23:58.151903 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:23:58.153376 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:23:58.154646 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:58.210623 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-b5c63996-c433-4b6f-846f-7c49d238f668 req-8b88620b-7113-4dee-9630-98c464e32e36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:58.238953 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:23:58.239479 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:58.341873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:23:58.342249 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:23:58.348230 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:23:58.349691 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:23:58.400059 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:23:58.400562 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13144MB free_disk=72.65327835083008GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:23:58.400833 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:58.401089 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:58.533769 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-b5c63996-c433-4b6f-846f-7c49d238f668 req-8b88620b-7113-4dee-9630-98c464e32e36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:58.663135 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b5c63996-c433-4b6f-846f-7c49d238f668 req-8b88620b-7113-4dee-9630-98c464e32e36 service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Updated VIF entry in instance network info cache for port eabfc672-0ffa-42bd-8ae5-8fab0ab602ea. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:23:58.663600 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b5c63996-c433-4b6f-846f-7c49d238f668 req-8b88620b-7113-4dee-9630-98c464e32e36 service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Updating instance_info_cache with network_info: [{"id": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "address": "fa:16:3e:a4:7f:11", "network": {"id": "c84ced41-8d01-49a7-ba90-b7b2199c2456", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2004961323-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "869f9c08edb643a185b92c3dcc03c575", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabfc672-0f", "ovs_interfaceid": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:23:58.955476 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b3167929-ad09-42cf-9a85-03a881182310 req-f67c4e0c-80e4-458d-aeb7-11531f26552d service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Received event network-changed-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:23:58.955840 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b3167929-ad09-42cf-9a85-03a881182310 req-f67c4e0c-80e4-458d-aeb7-11531f26552d service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Refreshing instance network info cache due to event network-changed-b56a0449-8e55-48e5-938f-6b6819fbf2d2. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:23:58.956025 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b3167929-ad09-42cf-9a85-03a881182310 req-f67c4e0c-80e4-458d-aeb7-11531f26552d service nova] Acquiring lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:23:58.956273 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b3167929-ad09-42cf-9a85-03a881182310 req-f67c4e0c-80e4-458d-aeb7-11531f26552d service nova] Acquired lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:23:58.956448 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b3167929-ad09-42cf-9a85-03a881182310 req-f67c4e0c-80e4-458d-aeb7-11531f26552d service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Refreshing network info cache for port b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:23:59.166508 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b5c63996-c433-4b6f-846f-7c49d238f668 req-8b88620b-7113-4dee-9630-98c464e32e36 service nova] Releasing lock "refresh_cache-89edf412-f1ac-4877-9fc8-22996056329c" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:23:59.455973 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 3ad44af8-c055-4954-a2ac-980322690477 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:23:59.456096 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 4199c008-c776-46af-bbc2-eaa869ac18fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:23:59.456208 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 89edf412-f1ac-4877-9fc8-22996056329c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:23:59.456385 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:23:59.456543 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:23:58 up 52 min,  2 users,  load average: 1.77, 2.87, 3.54\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_5dda425dab8946dc926808806eeedced': '2', 'io_workload': '0', 'num_proj_869f9c08edb643a185b92c3dcc03c575': '1'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:23:59.458377 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-b3167929-ad09-42cf-9a85-03a881182310 req-f67c4e0c-80e4-458d-aeb7-11531f26552d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:59.480750 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "4199c008-c776-46af-bbc2-eaa869ac18fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:59.480972 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:59.481234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:23:59.481439 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:23:59.481604 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:23:59.483266 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:23:59.486714 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Terminating instance
May 27 23:23:59.658197 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:23:59.658476 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:23:59.743262 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-b3167929-ad09-42cf-9a85-03a881182310 req-f67c4e0c-80e4-458d-aeb7-11531f26552d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:23:59.852304 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b3167929-ad09-42cf-9a85-03a881182310 req-f67c4e0c-80e4-458d-aeb7-11531f26552d service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Updated VIF entry in instance network info cache for port b56a0449-8e55-48e5-938f-6b6819fbf2d2. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:23:59.852589 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-b3167929-ad09-42cf-9a85-03a881182310 req-f67c4e0c-80e4-458d-aeb7-11531f26552d service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Updating instance_info_cache with network_info: [{"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:23:59.990831 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:24:00.006256 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:00.022053 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:00.150646 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0b77fadf-7dfa-4885-a7e2-7b35525dc44b req-5c46903a-e37a-416d-9df7-938d9d598174 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Received event network-vif-unplugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:24:00.150805 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0b77fadf-7dfa-4885-a7e2-7b35525dc44b req-5c46903a-e37a-416d-9df7-938d9d598174 service nova] Acquiring lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:00.150963 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0b77fadf-7dfa-4885-a7e2-7b35525dc44b req-5c46903a-e37a-416d-9df7-938d9d598174 service nova] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:00.151066 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-0b77fadf-7dfa-4885-a7e2-7b35525dc44b req-5c46903a-e37a-416d-9df7-938d9d598174 service nova] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:00.151201 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0b77fadf-7dfa-4885-a7e2-7b35525dc44b req-5c46903a-e37a-416d-9df7-938d9d598174 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] No waiting events found dispatching network-vif-unplugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:24:00.151287 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-0b77fadf-7dfa-4885-a7e2-7b35525dc44b req-5c46903a-e37a-416d-9df7-938d9d598174 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Received event network-vif-unplugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:24:00.161058 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:24:00.171211 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:00.171211 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:00.310449 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.9996968749997 future=<Future at 0x726e604c55b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:00.310945 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999130200999844 future=<Future at 0x726e604c55b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:00.311079 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.998964928000078 future=<Future at 0x726e604c55b0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:00.312721 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Instance destroyed successfully.
May 27 23:24:00.313780 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'resources' on Instance uuid 4199c008-c776-46af-bbc2-eaa869ac18fa {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:24:00.354475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b3167929-ad09-42cf-9a85-03a881182310 req-f67c4e0c-80e4-458d-aeb7-11531f26552d service nova] Releasing lock "refresh_cache-4199c008-c776-46af-bbc2-eaa869ac18fa" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:24:00.668890 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:24:00.669040 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.268s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:00.669353 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:24:00.817390 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:23:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-228038631',display_name='tempest-TestVolumeBootPattern-server-228038631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-228038631',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkuQiL7HZCdOcvEM0oVjt1zbL4sjnserQYsaCb41sHx2Ro0t2FlJaex6LqEDdWRK1DFZ2DpPVIFBVDu6t/KipI5zPLFZL2mndVngoPZJuwR7U276gcCZA+LQx8nCmmkPg==',key_name='tempest-TestVolumeBootPattern-1236496757',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:23:20Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-hrtxwdno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:23:20Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=4199c008-c776-46af-bbc2-eaa869ac18fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:24:00.817598 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "address": "fa:16:3e:b1:83:6a", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb56a0449-8e", "ovs_interfaceid": "b56a0449-8e55-48e5-938f-6b6819fbf2d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:24:00.818152 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:83:6a,bridge_name='br-int',has_traffic_filtering=True,id=b56a0449-8e55-48e5-938f-6b6819fbf2d2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb56a0449-8e') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:24:00.818423 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:83:6a,bridge_name='br-int',has_traffic_filtering=True,id=b56a0449-8e55-48e5-938f-6b6819fbf2d2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb56a0449-8e') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:24:00.819833 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:00.820151 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb56a0449-8e, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:24:00.821222 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:00.821915 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:24:00.823064 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:00.823740 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:00.823879 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3143e45-92b7-447d-adcf-4a52a29a23ae) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:24:00.824287 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:00.824697 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:24:00.825261 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:00.827117 np0000001565 nova-compute[98289]: INFO os_vif [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:83:6a,bridge_name='br-int',has_traffic_filtering=True,id=b56a0449-8e55-48e5-938f-6b6819fbf2d2,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb56a0449-8e')
May 27 23:24:00.828547 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:24:00.828820 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:24:00.828946 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:24:00.829313 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:24:00.829612 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5417f1d-8f96-46f9-84a0-a766ba4c9320', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:24:00.829756 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:24:00.853478 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:24:00.853478 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:24:00.853478 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:24:00.853478 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:24:00.853478 np0000001565 nova-compute[98289]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:00.853478 np0000001565 nova-compute[98289]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:00.853478 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:24:00.853732 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:24:00.853732 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:24:00.853732 np0000001565 nova-compute[98289]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:24:00.853732 np0000001565 nova-compute[98289]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320 (non-flash)
May 27 23:24:00.853732 np0000001565 nova-compute[98289]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:00.853732 np0000001565 nova-compute[98289]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:00.853732 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:24:00.853732 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', '215'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', '216')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:24:00.853925 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', '213')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:24:00.854675 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320', '212')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:24:00.855346 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e601289a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:24:00.855549 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Removing multipathed devices sdf, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:24:00.855737 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flush multipath device 33000000055dc8c57 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:24:00.903974 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:24:00.966690 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:24:00.999683 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:24:01.000093 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:24:01.000889 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:24:01.012970 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:24:01.013146 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:24:01.025232 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:01.055276 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 213, target: iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320, portal: 192.168.40.100,3260]
May 27 23:24:01.055276 np0000001565 nova-compute[98289]: Logout of [sid: 213, target: iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320, portal: 192.168.40.100,3260] successful.
May 27 23:24:01.055276 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:01.069906 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:01.079159 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:01.108008 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320, portal: 192.168.50.100,3260]
May 27 23:24:01.108008 np0000001565 nova-compute[98289]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-f5417f1d-8f96-46f9-84a0-a766ba4c9320, portal: 192.168.50.100,3260] successful.
May 27 23:24:01.108008 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:01.121605 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:01.121780 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:24:01.121893 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== disconnect_volume: return (293ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:24:01.122016 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:24:01.122276 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Deleting instance files /opt/stack/data/nova/instances/4199c008-c776-46af-bbc2-eaa869ac18fa_del
May 27 23:24:01.122733 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Deletion of /opt/stack/data/nova/instances/4199c008-c776-46af-bbc2-eaa869ac18fa_del complete
May 27 23:24:01.628089 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Took 1.64 seconds to destroy the instance on the hypervisor.
May 27 23:24:01.628682 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:24:01.628991 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:24:01.629097 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:24:01.629364 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:24:01.714174 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:24:01.942024 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e08c0268-dc1f-41fe-9533-1d077e801460 req-6e6597e0-fa15-46c7-a81a-1a814cfddaf9 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Received event network-vif-deleted-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:24:01.942371 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-e08c0268-dc1f-41fe-9533-1d077e801460 req-6e6597e0-fa15-46c7-a81a-1a814cfddaf9 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Neutron deleted interface b56a0449-8e55-48e5-938f-6b6819fbf2d2; detaching it from the instance and deleting it from the info cache
May 27 23:24:01.945954 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-e08c0268-dc1f-41fe-9533-1d077e801460 req-6e6597e0-fa15-46c7-a81a-1a814cfddaf9 service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Detach interface failed, port_id=b56a0449-8e55-48e5-938f-6b6819fbf2d2, reason: Instance 4199c008-c776-46af-bbc2-eaa869ac18fa could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:24:02.209848 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1083b0a2-7e1d-4885-9388-21ce32df2b8d req-a6ec93fa-a2e3-4dab-898a-0b8efac6844e service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Received event network-vif-unplugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:24:02.210423 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1083b0a2-7e1d-4885-9388-21ce32df2b8d req-a6ec93fa-a2e3-4dab-898a-0b8efac6844e service nova] Acquiring lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:02.210423 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1083b0a2-7e1d-4885-9388-21ce32df2b8d req-a6ec93fa-a2e3-4dab-898a-0b8efac6844e service nova] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:02.210542 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-1083b0a2-7e1d-4885-9388-21ce32df2b8d req-a6ec93fa-a2e3-4dab-898a-0b8efac6844e service nova] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:02.210653 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1083b0a2-7e1d-4885-9388-21ce32df2b8d req-a6ec93fa-a2e3-4dab-898a-0b8efac6844e service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] No waiting events found dispatching network-vif-unplugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:24:02.210757 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-1083b0a2-7e1d-4885-9388-21ce32df2b8d req-a6ec93fa-a2e3-4dab-898a-0b8efac6844e service nova] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Received event network-vif-unplugged-b56a0449-8e55-48e5-938f-6b6819fbf2d2 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:24:02.397757 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:24:02.900019 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Took 1.27 seconds to deallocate network for instance.
May 27 23:24:03.442849 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Took 0.54 seconds to detach 1 volumes for instance.
May 27 23:24:03.947548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:03.947719 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:04.113644 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:24:04.113839 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:24:04.484381 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:04.616807 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:24:05.122546 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.175s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:05.178339 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deleted allocations for instance 4199c008-c776-46af-bbc2-eaa869ac18fa
May 27 23:24:05.824847 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:06.187186 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ce6cbdd9-b759-4e2e-aa0f-912a0ff04972 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "4199c008-c776-46af-bbc2-eaa869ac18fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.706s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:07.166890 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:24:07.167317 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:24:07.167317 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.95 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:24:08.117720 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:24:08.117926 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:24:08.118169 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:24:08.123523 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:24:08.123760 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:24:08.350579 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-74697c50-ee08-49f8-8e60-48e2be08177a req-c94bccc0-64cf-47d0-a19f-74e62c734dbe service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Received event network-changed-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:24:08.351068 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-74697c50-ee08-49f8-8e60-48e2be08177a req-c94bccc0-64cf-47d0-a19f-74e62c734dbe service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Refreshing instance network info cache due to event network-changed-b19d5e54-bb3a-4e6d-aff0-337b4807e23f. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:24:08.351318 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74697c50-ee08-49f8-8e60-48e2be08177a req-c94bccc0-64cf-47d0-a19f-74e62c734dbe service nova] Acquiring lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:24:08.351640 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74697c50-ee08-49f8-8e60-48e2be08177a req-c94bccc0-64cf-47d0-a19f-74e62c734dbe service nova] Acquired lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:24:08.351824 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-74697c50-ee08-49f8-8e60-48e2be08177a req-c94bccc0-64cf-47d0-a19f-74e62c734dbe service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Refreshing network info cache for port b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:24:08.768082 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:24:08.855231 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-74697c50-ee08-49f8-8e60-48e2be08177a req-c94bccc0-64cf-47d0-a19f-74e62c734dbe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:24:08.870841 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "3ad44af8-c055-4954-a2ac-980322690477" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:08.871095 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "3ad44af8-c055-4954-a2ac-980322690477" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:08.871324 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "3ad44af8-c055-4954-a2ac-980322690477-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:08.871561 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:08.871718 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:08.875341 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Terminating instance
May 27 23:24:09.123952 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:24:09.124207 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:24:09.126907 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-74697c50-ee08-49f8-8e60-48e2be08177a req-c94bccc0-64cf-47d0-a19f-74e62c734dbe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:24:09.265394 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-74697c50-ee08-49f8-8e60-48e2be08177a req-c94bccc0-64cf-47d0-a19f-74e62c734dbe service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Updated VIF entry in instance network info cache for port b19d5e54-bb3a-4e6d-aff0-337b4807e23f. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:24:09.265641 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-74697c50-ee08-49f8-8e60-48e2be08177a req-c94bccc0-64cf-47d0-a19f-74e62c734dbe service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Updating instance_info_cache with network_info: [{"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:24:09.378695 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:24:09.400937 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:09.403112 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:09.421785 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:09.430641 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:09.446140 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:09.450470 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:09.485854 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:09.549651 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f14c1272-1e1b-46a9-bc3d-16726c74242e req-d1d8ea62-a682-4a3d-a0b0-b1fed3bda62c service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Received event network-vif-unplugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:24:09.550035 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f14c1272-1e1b-46a9-bc3d-16726c74242e req-d1d8ea62-a682-4a3d-a0b0-b1fed3bda62c service nova] Acquiring lock "3ad44af8-c055-4954-a2ac-980322690477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:09.550228 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f14c1272-1e1b-46a9-bc3d-16726c74242e req-d1d8ea62-a682-4a3d-a0b0-b1fed3bda62c service nova] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:09.550342 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f14c1272-1e1b-46a9-bc3d-16726c74242e req-d1d8ea62-a682-4a3d-a0b0-b1fed3bda62c service nova] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:09.550509 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f14c1272-1e1b-46a9-bc3d-16726c74242e req-d1d8ea62-a682-4a3d-a0b0-b1fed3bda62c service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] No waiting events found dispatching network-vif-unplugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:24:09.550623 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f14c1272-1e1b-46a9-bc3d-16726c74242e req-d1d8ea62-a682-4a3d-a0b0-b1fed3bda62c service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Received event network-vif-unplugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:24:09.624871 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:09.705021 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999775975000375 future=<Future at 0x726e60179eb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:09.708007 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Instance destroyed successfully.
May 27 23:24:09.708396 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lazy-loading 'resources' on Instance uuid 3ad44af8-c055-4954-a2ac-980322690477 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:24:09.767869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-74697c50-ee08-49f8-8e60-48e2be08177a req-c94bccc0-64cf-47d0-a19f-74e62c734dbe service nova] Releasing lock "refresh_cache-3ad44af8-c055-4954-a2ac-980322690477" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:24:10.211004 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-798686209',display_name='tempest-TestVolumeBootPattern-server-798686209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-testvolumebootpattern-server-798686209',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkuQiL7HZCdOcvEM0oVjt1zbL4sjnserQYsaCb41sHx2Ro0t2FlJaex6LqEDdWRK1DFZ2DpPVIFBVDu6t/KipI5zPLFZL2mndVngoPZJuwR7U276gcCZA+LQx8nCmmkPg==',key_name='tempest-TestVolumeBootPattern-1236496757',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:22:23Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dda425dab8946dc926808806eeedced',ramdisk_id='',reservation_id='r-1r3ef4st',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-314561297',owner_user_name='tempest-TestVolumeBootPattern-314561297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:22:23Z,user_data=None,user_id='31823a44e786429f80ba607958f8b63e',uuid=3ad44af8-c055-4954-a2ac-980322690477,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:24:10.211249 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converting VIF {"id": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "address": "fa:16:3e:d3:d2:f3", "network": {"id": "d9ecae3d-b519-47a2-b577-6643a443678d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-781195464-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5dda425dab8946dc926808806eeedced", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb19d5e54-bb", "ovs_interfaceid": "b19d5e54-bb3a-4e6d-aff0-337b4807e23f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:24:10.211843 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d2:f3,bridge_name='br-int',has_traffic_filtering=True,id=b19d5e54-bb3a-4e6d-aff0-337b4807e23f,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb19d5e54-bb') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:24:10.212061 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d2:f3,bridge_name='br-int',has_traffic_filtering=True,id=b19d5e54-bb3a-4e6d-aff0-337b4807e23f,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb19d5e54-bb') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:24:10.213133 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:10.213298 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb19d5e54-bb, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:24:10.214136 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:10.214935 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:24:10.216204 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:10.217200 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:10.217462 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64b2954e-e36d-41fe-b74d-71e4916c9cce) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:24:10.218428 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:10.219599 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:24:10.221225 np0000001565 nova-compute[98289]: INFO os_vif [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d2:f3,bridge_name='br-int',has_traffic_filtering=True,id=b19d5e54-bb3a-4e6d-aff0-337b4807e23f,network=Network(d9ecae3d-b519-47a2-b577-6643a443678d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb19d5e54-bb')
May 27 23:24:10.222814 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:24:10.223091 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:24:10.223238 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:24:10.223636 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:24:10.223892 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b80f10e3-246c-4662-b3a9-33f4316361ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:24:10.224030 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:24:10.250700 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:24:10.250700 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:24:10.250700 np0000001565 nova-compute[98289]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:10.250700 np0000001565 nova-compute[98289]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:10.250700 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:24:10.250960 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:24:10.250960 np0000001565 nova-compute[98289]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca (non-flash)
May 27 23:24:10.250960 np0000001565 nova-compute[98289]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:10.250960 np0000001565 nova-compute[98289]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:10.250960 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:24:10.251073 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '207'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', '215'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', '216')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:24:10.251136 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '206')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:24:10.251921 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca', '207')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:24:10.252526 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e587df7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'): ({'sdd'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:24:10.252717 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Removing multipathed devices sdd, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:24:10.252938 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Flush multipath device 330000000be4fe95a {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:24:10.306607 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:24:10.345896 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:24:10.385917 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:24:10.386268 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:24:10.386901 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:24:10.398389 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:24:10.398617 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:24:10.409784 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:10.438955 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.40.100,3260]
May 27 23:24:10.438955 np0000001565 nova-compute[98289]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.40.100,3260] successful.
May 27 23:24:10.438955 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:10.451634 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:10.462460 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:10.488059 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.50.100,3260]
May 27 23:24:10.488059 np0000001565 nova-compute[98289]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-b80f10e3-246c-4662-b3a9-33f4316361ca, portal: 192.168.50.100,3260] successful.
May 27 23:24:10.488059 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:10.500108 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:10.500289 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:24:10.500418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] <== disconnect_volume: return (276ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:24:10.500529 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:24:10.500772 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Deleting instance files /opt/stack/data/nova/instances/3ad44af8-c055-4954-a2ac-980322690477_del
May 27 23:24:10.501201 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Deletion of /opt/stack/data/nova/instances/3ad44af8-c055-4954-a2ac-980322690477_del complete
May 27 23:24:11.006542 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Took 1.63 seconds to destroy the instance on the hypervisor.
May 27 23:24:11.007024 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:24:11.007293 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:24:11.007402 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 3ad44af8-c055-4954-a2ac-980322690477] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:24:11.007638 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:24:11.098112 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:24:11.331709 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2f5a824f-b793-4f4a-bc99-db93aca3baf7 req-aab3bcf9-81c8-458c-9478-84cd681ec170 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Received event network-vif-deleted-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:24:11.331846 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-2f5a824f-b793-4f4a-bc99-db93aca3baf7 req-aab3bcf9-81c8-458c-9478-84cd681ec170 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Neutron deleted interface b19d5e54-bb3a-4e6d-aff0-337b4807e23f; detaching it from the instance and deleting it from the info cache
May 27 23:24:11.333343 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2f5a824f-b793-4f4a-bc99-db93aca3baf7 req-aab3bcf9-81c8-458c-9478-84cd681ec170 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Detach interface failed, port_id=b19d5e54-bb3a-4e6d-aff0-337b4807e23f, reason: Instance 3ad44af8-c055-4954-a2ac-980322690477 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:24:11.602399 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6542930b-fada-4872-a75a-ccb4d251d0b1 req-d2c565b7-b082-436c-9c89-a486ff2b6883 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Received event network-vif-unplugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:24:11.602399 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6542930b-fada-4872-a75a-ccb4d251d0b1 req-d2c565b7-b082-436c-9c89-a486ff2b6883 service nova] Acquiring lock "3ad44af8-c055-4954-a2ac-980322690477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:11.602766 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6542930b-fada-4872-a75a-ccb4d251d0b1 req-d2c565b7-b082-436c-9c89-a486ff2b6883 service nova] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:11.602766 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-6542930b-fada-4872-a75a-ccb4d251d0b1 req-d2c565b7-b082-436c-9c89-a486ff2b6883 service nova] Lock "3ad44af8-c055-4954-a2ac-980322690477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:11.602766 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6542930b-fada-4872-a75a-ccb4d251d0b1 req-d2c565b7-b082-436c-9c89-a486ff2b6883 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] No waiting events found dispatching network-vif-unplugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:24:11.602858 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-6542930b-fada-4872-a75a-ccb4d251d0b1 req-d2c565b7-b082-436c-9c89-a486ff2b6883 service nova] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Received event network-vif-unplugged-b19d5e54-bb3a-4e6d-aff0-337b4807e23f for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:24:11.787611 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:24:12.123823 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:24:12.123965 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:24:12.124217 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:24:12.289504 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Took 1.28 seconds to deallocate network for instance.
May 27 23:24:12.835283 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Took 0.55 seconds to detach 1 volumes for instance.
May 27 23:24:13.339893 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:13.340068 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:13.454111 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:24:13.454282 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:24:13.956601 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:24:14.124242 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:24:14.124511 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:24:14.461918 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.122s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:14.485743 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:14.502528 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Deleted allocations for instance 3ad44af8-c055-4954-a2ac-980322690477
May 27 23:24:15.219093 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:15.310427 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003158800000164774 future=<Future at 0x726e604c55b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:15.310827 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Emitting event <LifecycleEvent: 1779924240.30998, 4199c008-c776-46af-bbc2-eaa869ac18fa => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:24:15.311310 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] VM Stopped (Lifecycle Event)
May 27 23:24:15.311310 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:15.311310 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.39355797799999 future=<Future at 0x726e60179eb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:15.311310 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=9.393458149000253 future=<Future at 0x726e60179eb0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:15.509226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c89435c5-a706-40a9-bf54-9092eef693b6 tempest-TestVolumeBootPattern-314561297 tempest-TestVolumeBootPattern-314561297-project-member] Lock "3ad44af8-c055-4954-a2ac-980322690477" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.638s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:15.813735 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 4199c008-c776-46af-bbc2-eaa869ac18fa] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:24:18.106018 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:19.488722 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:20.119076 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:20.232610 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:24.489245 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:24.705164 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00036205299966241 future=<Future at 0x726e60179eb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:24.707064 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Emitting event <LifecycleEvent: 1779924249.7047079, 3ad44af8-c055-4954-a2ac-980322690477 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:24:24.707064 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:24.707064 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] VM Stopped (Lifecycle Event)
May 27 23:24:25.208428 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-45b174a7-78d8-4676-9e72-6c54bc628f23 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 3ad44af8-c055-4954-a2ac-980322690477] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:24:25.234311 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:29.489806 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:30.235903 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:33.181386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "89edf412-f1ac-4877-9fc8-22996056329c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:33.181386 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "89edf412-f1ac-4877-9fc8-22996056329c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:33.181907 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "89edf412-f1ac-4877-9fc8-22996056329c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:33.181907 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:33.181907 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:33.183506 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Terminating instance
May 27 23:24:33.686484 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:24:33.698493 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:33.699920 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:33.714579 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:33.732844 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:33.819612 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7514a85a-384a-48a1-bf5c-5a200f5a9ebe req-0dbf4661-1db8-47f6-a876-477a4e956c4b service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Received event network-vif-unplugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:24:33.819753 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7514a85a-384a-48a1-bf5c-5a200f5a9ebe req-0dbf4661-1db8-47f6-a876-477a4e956c4b service nova] Acquiring lock "89edf412-f1ac-4877-9fc8-22996056329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:33.819902 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7514a85a-384a-48a1-bf5c-5a200f5a9ebe req-0dbf4661-1db8-47f6-a876-477a4e956c4b service nova] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:33.820012 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-7514a85a-384a-48a1-bf5c-5a200f5a9ebe req-0dbf4661-1db8-47f6-a876-477a4e956c4b service nova] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:33.820130 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7514a85a-384a-48a1-bf5c-5a200f5a9ebe req-0dbf4661-1db8-47f6-a876-477a4e956c4b service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] No waiting events found dispatching network-vif-unplugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:24:33.820532 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-7514a85a-384a-48a1-bf5c-5a200f5a9ebe req-0dbf4661-1db8-47f6-a876-477a4e956c4b service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Received event network-vif-unplugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:24:33.972606 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:33.978572 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:34.004446 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999666339000214 future=<Future at 0x726e3878a480 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:34.004870 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99914359100012 future=<Future at 0x726e3878a480 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:34.005457 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999025487999916 future=<Future at 0x726e3878a480 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:34.006890 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Instance destroyed successfully.
May 27 23:24:34.007253 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lazy-loading 'resources' on Instance uuid 89edf412-f1ac-4877-9fc8-22996056329c {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:24:34.491237 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:34.510150 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-550054679',display_name='tempest-instance-550054679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-instance-550054679',id=79,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUTQ8UcaplUnsxbChfsdQlMvytQKrPK9Z09o9nVaf6Ik9+alXekl8Kcfc56y2j3E/RWuLDgJwbJ5g7pgkpP8+PubB6rFfHwvTUEbcjbjq6/X2ejRbUeiaoZ0L/MXcv7Yw==',key_name='tempest-keypair-743283956',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:23:55Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='869f9c08edb643a185b92c3dcc03c575',ramdisk_id='',reservation_id='r-0g5hejkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1646956116',owner_user_name='tempest-VolumesBackupsTest-1646956116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='591adce03570420b88d602af6f874d52',uuid=89edf412-f1ac-4877-9fc8-22996056329c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "address": "fa:16:3e:a4:7f:11", "network": {"id": "c84ced41-8d01-49a7-ba90-b7b2199c2456", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2004961323-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "869f9c08edb643a185b92c3dcc03c575", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabfc672-0f", "ovs_interfaceid": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:24:34.510593 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Converting VIF {"id": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "address": "fa:16:3e:a4:7f:11", "network": {"id": "c84ced41-8d01-49a7-ba90-b7b2199c2456", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-2004961323-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "869f9c08edb643a185b92c3dcc03c575", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabfc672-0f", "ovs_interfaceid": "eabfc672-0ffa-42bd-8ae5-8fab0ab602ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:24:34.511031 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7f:11,bridge_name='br-int',has_traffic_filtering=True,id=eabfc672-0ffa-42bd-8ae5-8fab0ab602ea,network=Network(c84ced41-8d01-49a7-ba90-b7b2199c2456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabfc672-0f') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:24:34.511295 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7f:11,bridge_name='br-int',has_traffic_filtering=True,id=eabfc672-0ffa-42bd-8ae5-8fab0ab602ea,network=Network(c84ced41-8d01-49a7-ba90-b7b2199c2456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabfc672-0f') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:24:34.512377 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:34.512586 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeabfc672-0f, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:24:34.513501 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:34.514286 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:24:34.514810 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:34.514930 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5dfcda7c-6138-489d-b324-6e0cb39c0bf1) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:24:34.515297 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:34.515803 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:24:34.517626 np0000001565 nova-compute[98289]: INFO os_vif [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7f:11,bridge_name='br-int',has_traffic_filtering=True,id=eabfc672-0ffa-42bd-8ae5-8fab0ab602ea,network=Network(c84ced41-8d01-49a7-ba90-b7b2199c2456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabfc672-0f')
May 27 23:24:34.519023 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:24:34.519270 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5aaeac01-b895-46ea-9271-1451c3828218', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:24:34.519410 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:24:34.519924 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:24:34.519993 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5aaeac01-b895-46ea-9271-1451c3828218', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:24:34.520099 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:24:34.541195 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:34.541195 np0000001565 nova-compute[98289]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:34.541195 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:24:34.541429 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsi session list stdout=tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:34.541429 np0000001565 nova-compute[98289]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218 (non-flash)
May 27 23:24:34.541429 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:24:34.541531 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', '215'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', '216')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:24:34.541647 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', '215')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:24:34.542368 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218', '216')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:24:34.542927 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e587deb60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:24:34.543123 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Removing multipathed devices sdb, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:24:34.543371 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Flush multipath device 3300000002a2250f5 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:24:34.605680 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:24:34.658937 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:24:34.700839 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Checking to see if SCSI volumes sdb, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:24:34.701095 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] SCSI volumes sdb, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:24:34.701736 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Checking to see if device paths {'sdb', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:24:34.712418 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Device paths {'sdb', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:24:34.712587 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:24:34.722361 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:34.749009 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218, portal: 192.168.40.100,3260]
May 27 23:24:34.749009 np0000001565 nova-compute[98289]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218, portal: 192.168.40.100,3260] successful.
May 27 23:24:34.749009 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:34.759650 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:34.770441 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:34.793100 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218, portal: 192.168.50.100,3260]
May 27 23:24:34.793100 np0000001565 nova-compute[98289]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-5aaeac01-b895-46ea-9271-1451c3828218, portal: 192.168.50.100,3260] successful.
May 27 23:24:34.793100 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:34.805956 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:24:34.806131 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:24:34.806240 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] <== disconnect_volume: return (286ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:24:34.806379 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:24:34.806625 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Deleting instance files /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c_del
May 27 23:24:34.807161 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Deletion of /opt/stack/data/nova/instances/89edf412-f1ac-4877-9fc8-22996056329c_del complete
May 27 23:24:35.312829 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Took 1.63 seconds to destroy the instance on the hypervisor.
May 27 23:24:35.313401 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:24:35.313704 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:24:35.313794 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:24:35.314004 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:24:35.405226 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:24:35.825938 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf7b208e-9f51-4e58-8c20-6da34061195e req-d1d004ae-a656-44b1-aa6d-8880b0667dba service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Received event network-vif-deleted-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:24:35.826369 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-cf7b208e-9f51-4e58-8c20-6da34061195e req-d1d004ae-a656-44b1-aa6d-8880b0667dba service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Neutron deleted interface eabfc672-0ffa-42bd-8ae5-8fab0ab602ea; detaching it from the instance and deleting it from the info cache
May 27 23:24:35.828965 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cf7b208e-9f51-4e58-8c20-6da34061195e req-d1d004ae-a656-44b1-aa6d-8880b0667dba service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Detach interface failed, port_id=eabfc672-0ffa-42bd-8ae5-8fab0ab602ea, reason: Instance 89edf412-f1ac-4877-9fc8-22996056329c could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:24:35.887999 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c43d2ae8-5080-4bd1-b71b-504c42f47c14 req-aa934fcb-11f6-489d-82f3-0400c0427c6d service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Received event network-vif-unplugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:24:35.888411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c43d2ae8-5080-4bd1-b71b-504c42f47c14 req-aa934fcb-11f6-489d-82f3-0400c0427c6d service nova] Acquiring lock "89edf412-f1ac-4877-9fc8-22996056329c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:35.888622 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c43d2ae8-5080-4bd1-b71b-504c42f47c14 req-aa934fcb-11f6-489d-82f3-0400c0427c6d service nova] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:35.888744 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-c43d2ae8-5080-4bd1-b71b-504c42f47c14 req-aa934fcb-11f6-489d-82f3-0400c0427c6d service nova] Lock "89edf412-f1ac-4877-9fc8-22996056329c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:35.888862 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c43d2ae8-5080-4bd1-b71b-504c42f47c14 req-aa934fcb-11f6-489d-82f3-0400c0427c6d service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] No waiting events found dispatching network-vif-unplugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:24:35.889006 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-c43d2ae8-5080-4bd1-b71b-504c42f47c14 req-aa934fcb-11f6-489d-82f3-0400c0427c6d service nova] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Received event network-vif-unplugged-eabfc672-0ffa-42bd-8ae5-8fab0ab602ea for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:24:36.277989 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:24:36.779813 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Took 1.47 seconds to deallocate network for instance.
May 27 23:24:37.326020 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Took 0.55 seconds to detach 1 volumes for instance.
May 27 23:24:37.604105 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:37.831714 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:37.831857 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:37.935412 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:24:37.935635 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:24:38.438102 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:24:38.942480 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:38.944585 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.112s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:38.990083 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Deleted allocations for instance 89edf412-f1ac-4877-9fc8-22996056329c
May 27 23:24:39.492294 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:39.515594 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:39.999988 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-9b2ef608-afd0-4c03-af0c-7b7c0cdcd295 tempest-VolumesBackupsTest-1646956116 tempest-VolumesBackupsTest-1646956116-project-member] Lock "89edf412-f1ac-4877-9fc8-22996056329c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.818s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:41.093536 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:42.561868 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:44.493251 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:44.516531 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:49.004342 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003131989997200435 future=<Future at 0x726e3878a480 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:49.005283 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] Emitting event <LifecycleEvent: 1779924274.003946, 89edf412-f1ac-4877-9fc8-22996056329c => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:24:49.005458 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:24:49.005571 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] VM Stopped (Lifecycle Event)
May 27 23:24:49.500412 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:49.507816 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-e2e7994a-baec-433d-b6bc-57543fa47d04 tempest-VolumesSnapshotTestJSON-1830020059 tempest-VolumesSnapshotTestJSON-1830020059-project-member] [instance: 89edf412-f1ac-4877-9fc8-22996056329c] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:24:49.517608 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:50.942408 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:52.535376 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:54.518477 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:24:58.123710 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:24:58.627447 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:58.627770 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:58.627770 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:24:58.627840 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:24:58.637982 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:24:58.638743 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:24:58.683747 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:24:58.684113 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13983MB free_disk=72.63253784179688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:24:58.684258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:24:58.684511 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:24:59.528015 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:24:59.732660 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:24:59.732876 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:24:58 up 53 min,  2 users,  load average: 1.85, 2.69, 3.43\n'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:24:59.777111 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:24:59.777381 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:25:00.279819 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:25:00.787993 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:25:00.788506 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.104s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:25:00.788506 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:25:04.539304 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:04.539304 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:04.539304 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:25:04.539304 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:04.540171 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:04.540171 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:07.788566 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:25:07.789012 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:25:07.789012 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.33 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:25:08.123702 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:25:08.123981 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:25:09.117624 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:25:09.118107 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.01 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:25:09.123452 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:25:09.123688 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:25:09.549539 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:09.549671 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:09.549783 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5009 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:25:09.549839 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:09.550066 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:09.550257 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:13.123808 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:25:13.124403 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:25:13.124403 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:25:14.553953 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:14.554303 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:14.554303 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:25:14.554303 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:14.560752 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:14.560879 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:15.124170 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:25:15.124504 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:25:19.566310 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:19.566310 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:19.566310 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:25:19.566967 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:19.573078 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:19.573078 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:20.141099 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:21.181890 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:24.583406 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:29.583842 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:29.584258 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:29.584258 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:25:29.584258 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:29.597154 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:29.597374 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:34.602630 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:34.603165 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:34.603165 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:25:34.603165 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:34.605109 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:34.605413 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:39.610629 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:39.611110 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:39.611110 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:25:39.611110 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:39.616355 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:39.616562 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:44.622182 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:44.622182 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:44.622182 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:25:44.622182 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:44.624565 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:44.624565 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:49.628588 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:49.628588 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:49.628588 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:25:49.628588 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:49.632646 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:49.633132 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:54.640360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:54.640360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:54.640360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:25:54.640360 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:54.640941 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:54.640941 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:59.642361 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:59.642361 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:25:59.642361 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:25:59.642361 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:25:59.653192 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:25:59.653403 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:26:00.123866 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:26:00.627732 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:26:00.627897 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:26:00.628020 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:26:00.628126 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:26:00.639544 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:26:00.640708 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:26:00.689354 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:26:00.689764 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13993MB free_disk=72.62803649902344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:26:00.689946 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:26:00.690159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:26:01.742545 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:26:01.742963 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:26:00 up 54 min,  2 users,  load average: 1.06, 2.28, 3.24\n'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:26:01.785564 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:26:01.785856 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:26:02.288497 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:26:02.794174 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:26:02.794648 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.104s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:26:02.794648 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:26:04.665810 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:26:04.665810 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:26:04.665810 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:26:04.665810 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:26:04.666298 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:04.666298 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:26:07.146379 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:08.582209 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:08.770774 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:26:08.794516 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:26:08.794745 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:26:08.795013 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.32 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:26:09.513349 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:09.666776 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:10.117792 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:26:10.118068 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.01 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:26:10.123452 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:26:10.123655 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:26:10.123886 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:26:10.832139 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:11.117840 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:26:11.118194 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.01 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:26:12.285310 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:13.123812 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:26:13.123930 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:26:13.124153 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:26:14.514440 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:14.668044 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:15.619088 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:26:15.619482 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:26:16.120925 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:26:16.124002 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:26:16.124261 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:26:16.663193 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:26:16.663193 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:26:16.665869 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:26:16.665999 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Claim successful on node np0000001565
May 27 23:26:17.754181 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:26:17.754630 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:26:18.256774 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:26:18.762416 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.099s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:26:18.762827 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:26:19.267833 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:26:19.268098 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:26:19.268566 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:26:19.268656 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:26:19.348020 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c175a7231a7b496eacfc7a46ad2a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec606fe4c964d358de1d627ce948d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:26:19.523662 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:19.668861 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:19.697426 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Successfully created port: f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:26:19.770721 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:26:20.143748 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Successfully updated port: f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:26:20.190026 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-78d01173-76b2-48d7-9040-5fce0f148356 req-7306b79b-4d73-4f77-953b-eb51b04fcd24 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Received event network-changed-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:26:20.190254 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-78d01173-76b2-48d7-9040-5fce0f148356 req-7306b79b-4d73-4f77-953b-eb51b04fcd24 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Refreshing instance network info cache due to event network-changed-f1642905-d742-47f6-82ab-cea550ba4748. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:26:20.190410 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-78d01173-76b2-48d7-9040-5fce0f148356 req-7306b79b-4d73-4f77-953b-eb51b04fcd24 service nova] Acquiring lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:26:20.190614 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-78d01173-76b2-48d7-9040-5fce0f148356 req-7306b79b-4d73-4f77-953b-eb51b04fcd24 service nova] Acquired lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:26:20.190721 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-78d01173-76b2-48d7-9040-5fce0f148356 req-7306b79b-4d73-4f77-953b-eb51b04fcd24 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Refreshing network info cache for port f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:26:20.273485 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:26:20.646122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:26:20.692427 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-78d01173-76b2-48d7-9040-5fce0f148356 req-7306b79b-4d73-4f77-953b-eb51b04fcd24 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:26:20.753793 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-78d01173-76b2-48d7-9040-5fce0f148356 req-7306b79b-4d73-4f77-953b-eb51b04fcd24 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:26:20.880794 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-78d01173-76b2-48d7-9040-5fce0f148356 req-7306b79b-4d73-4f77-953b-eb51b04fcd24 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:26:21.281956 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:26:21.282841 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:26:21.283049 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Creating image(s)
May 27 23:26:21.283537 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "/opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:26:21.283675 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "/opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:26:21.284185 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "/opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:26:21.284745 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:26:21.287029 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:26:21.287888 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:26:21.376968 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:26:21.377348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:26:21.377825 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:26:21.379403 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:26:21.381944 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:26:21.382237 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:26:21.382879 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-78d01173-76b2-48d7-9040-5fce0f148356 req-7306b79b-4d73-4f77-953b-eb51b04fcd24 service nova] Releasing lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:26:21.383541 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquired lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:26:21.383841 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:26:21.472298 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:26:21.474040 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:26:21.525777 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk 1073741824" returned: 0 in 0.053s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:26:21.526234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:26:21.526608 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:26:21.607395 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.080s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:26:21.607852 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:26:21.608070 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:26:21.690643 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:26:21.691050 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Cannot resize image /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:26:21.691447 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:26:21.691619 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Ensure instance console log exists: /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:26:21.691869 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:26:21.692093 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:26:21.692254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:26:21.974971 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:26:22.132253 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:26:22.259659 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Updating instance_info_cache with network_info: [{"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:26:22.762203 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Releasing lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:26:22.762520 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Instance network_info: |[{"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:26:22.764376 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Start _get_guest_xml network_info=[{"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:26:22.767927 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:26:22.769127 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1254711628', uuid='eee054e7-0060-4f21-8573-91b8e0564192'), owner=OwnerMeta(userid='c175a7231a7b496eacfc7a46ad2a379d', username='tempest-VolumeMultiattachTests-892484312-project-member', projectid='1ec606fe4c964d358de1d627ce948d87', projectname='tempest-VolumeMultiattachTests-892484312'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779924382.7687738) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:26:22.770107 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:26:22.770439 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:26:22.771417 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:26:22.771579 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:26:22.772484 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:26:22.772793 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:26:22.772941 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:26:22.773036 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:26:22.773150 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:26:22.773226 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:26:22.773310 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:26:22.773488 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:26:22.773645 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:26:22.773789 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:26:22.773885 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:26:22.774011 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:26:22.784081 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1254711628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumemultiattachtests-server-1254711628',id=80,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVQnlvngnzpx8nZmIeojUodUInaOiAo394MWlnUAbFDRXt7nIzdnZu30tlYxOW13akWbDAd8NbmEzp08LI3YRQ7nDPPUghaFadIXon2DMM+8RrQt26DZlzF60DfmUP/OA==',key_name='tempest-keypair-1042981963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec606fe4c964d358de1d627ce948d87',ramdisk_id='',reservation_id='r-xwn3awo3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-892484312',owner_user_name='tempest-VolumeMultiattachTests-892484312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c175a7231a7b496eacfc7a46ad2a379d',uuid=eee054e7-0060-4f21-8573-91b8e0564192,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:26:22.784247 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converting VIF {"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:26:22.784795 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=f1642905-d742-47f6-82ab-cea550ba4748,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1642905-d7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:26:22.785656 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'pci_devices' on Instance uuid eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:26:23.288627 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] End _get_guest_xml xml=<domain type="qemu">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <uuid>eee054e7-0060-4f21-8573-91b8e0564192</uuid>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <name>instance-00000050</name>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumeMultiattachTests-server-1254711628</nova:name>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:26:22</nova:creationTime>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:user uuid="c175a7231a7b496eacfc7a46ad2a379d">tempest-VolumeMultiattachTests-892484312-project-member</nova:user>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:project uuid="1ec606fe4c964d358de1d627ce948d87">tempest-VolumeMultiattachTests-892484312</nova:project>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         <nova:port uuid="f1642905-d742-47f6-82ab-cea550ba4748">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <system>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <entry name="serial">eee054e7-0060-4f21-8573-91b8e0564192</entry>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <entry name="uuid">eee054e7-0060-4f21-8573-91b8e0564192</entry>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     </system>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <os>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   </os>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <features>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   </features>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   <devices>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     </disk>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk.config"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     </disk>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:39:fc:03"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <target dev="tapf1642905-d7"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     </interface>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/console.log" append="off"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     </serial>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <video>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     </video>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     </rng>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:   </devices>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]: </domain>
May 27 23:26:23.288627 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:26:23.290845 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Preparing to wait for external event network-vif-plugged-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:26:23.290845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:26:23.290845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:26:23.290845 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:26:23.290845 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1254711628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumemultiattachtests-server-1254711628',id=80,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVQnlvngnzpx8nZmIeojUodUInaOiAo394MWlnUAbFDRXt7nIzdnZu30tlYxOW13akWbDAd8NbmEzp08LI3YRQ7nDPPUghaFadIXon2DMM+8RrQt26DZlzF60DfmUP/OA==',key_name='tempest-keypair-1042981963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec606fe4c964d358de1d627ce948d87',ramdisk_id='',reservation_id='r-xwn3awo3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-892484312',owner_user_name='tempest-VolumeMultiattachTests-892484312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c175a7231a7b496eacfc7a46ad2a379d',uuid=eee054e7-0060-4f21-8573-91b8e0564192,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:26:23.290845 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converting VIF {"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:26:23.290845 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=f1642905-d742-47f6-82ab-cea550ba4748,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1642905-d7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:26:23.291110 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=f1642905-d742-47f6-82ab-cea550ba4748,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1642905-d7') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:26:23.291460 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:23.291880 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:26:23.292248 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:26:23.292859 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:23.293058 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22f53024-4074-5966-8dde-65b9fa59c496', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:26:23.302320 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:23.303101 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:26:23.304911 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:23.305069 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1642905-d7, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:26:23.305409 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1642905-d7, col_values=(('qos', UUID('21811e29-3ef3-4af9-a679-094278c36389')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:26:23.305837 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1642905-d7, col_values=(('external_ids', {'iface-id': 'f1642905-d742-47f6-82ab-cea550ba4748', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:fc:03', 'vm-uuid': 'eee054e7-0060-4f21-8573-91b8e0564192'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:26:23.306513 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:23.307634 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:26:23.311569 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:23.312392 np0000001565 nova-compute[98289]: INFO os_vif [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=f1642905-d742-47f6-82ab-cea550ba4748,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1642905-d7')
May 27 23:26:24.539486 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:24.827201 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:26:24.827201 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:26:24.827201 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No VIF found with MAC fa:16:3e:39:fc:03, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:26:24.827521 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Using config drive
May 27 23:26:25.332220 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:26:25.436367 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Creating config drive at /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk.config
May 27 23:26:25.440064 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp27vedi93 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:26:25.494087 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp27vedi93" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:26:25.868274 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:25.886042 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:25.887160 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:25.989266 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:25.992262 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:26.053731 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cd3c6a13-7192-4e44-b71e-665d5711206b req-8b35698f-0ec2-40ee-8aeb-b4151471f01f service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Received event network-vif-plugged-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:26:26.054369 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cd3c6a13-7192-4e44-b71e-665d5711206b req-8b35698f-0ec2-40ee-8aeb-b4151471f01f service nova] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:26:26.054369 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cd3c6a13-7192-4e44-b71e-665d5711206b req-8b35698f-0ec2-40ee-8aeb-b4151471f01f service nova] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:26:26.054369 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-cd3c6a13-7192-4e44-b71e-665d5711206b req-8b35698f-0ec2-40ee-8aeb-b4151471f01f service nova] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:26:26.054614 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-cd3c6a13-7192-4e44-b71e-665d5711206b req-8b35698f-0ec2-40ee-8aeb-b4151471f01f service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Processing event network-vif-plugged-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:26:26.096323 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:26.179662 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:26.181063 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:26.183202 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:26.198567 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:26.550856 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:26:26.551540 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924386.5510461, eee054e7-0060-4f21-8573-91b8e0564192 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:26:26.551712 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eee054e7-0060-4f21-8573-91b8e0564192] VM Started (Lifecycle Event)
May 27 23:26:26.554091 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:26:26.556289 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Instance spawned successfully.
May 27 23:26:26.556621 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:26:27.055439 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:26:27.057959 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:26:27.065698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:26:27.065698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:26:27.065698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:26:27.065698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:26:27.065698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:26:27.065698 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:26:27.563235 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eee054e7-0060-4f21-8573-91b8e0564192] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:26:27.563469 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924387.5632973, eee054e7-0060-4f21-8573-91b8e0564192 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:26:27.563573 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eee054e7-0060-4f21-8573-91b8e0564192] VM Paused (Lifecycle Event)
May 27 23:26:27.570827 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Took 6.29 seconds to spawn the instance on the hypervisor.
May 27 23:26:27.571158 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:26:28.066785 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:26:28.072362 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924388.0710366, eee054e7-0060-4f21-8573-91b8e0564192 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:26:28.072362 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eee054e7-0060-4f21-8573-91b8e0564192] VM Resumed (Lifecycle Event)
May 27 23:26:28.081365 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Took 11.46 seconds to build instance.
May 27 23:26:28.128896 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9160a6fc-383f-4764-bc1a-94a23f417923 req-d511c56f-13b2-4173-ab2e-1da6618aad81 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Received event network-vif-plugged-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:26:28.128896 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9160a6fc-383f-4764-bc1a-94a23f417923 req-d511c56f-13b2-4173-ab2e-1da6618aad81 service nova] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:26:28.129043 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9160a6fc-383f-4764-bc1a-94a23f417923 req-d511c56f-13b2-4173-ab2e-1da6618aad81 service nova] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:26:28.129173 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9160a6fc-383f-4764-bc1a-94a23f417923 req-d511c56f-13b2-4173-ab2e-1da6618aad81 service nova] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:26:28.129276 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9160a6fc-383f-4764-bc1a-94a23f417923 req-d511c56f-13b2-4173-ab2e-1da6618aad81 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] No waiting events found dispatching network-vif-plugged-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:26:28.129466 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-9160a6fc-383f-4764-bc1a-94a23f417923 req-d511c56f-13b2-4173-ab2e-1da6618aad81 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Received unexpected event network-vif-plugged-f1642905-d742-47f6-82ab-cea550ba4748 for instance with vm_state active and task_state None.
May 27 23:26:28.307410 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:28.484855 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2013d9f8-07f7-45c4-a7ec-e9a3460166db req-64f2523a-cc91-4dfb-b132-382506422dd5 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Received event network-changed-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:26:28.484971 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-2013d9f8-07f7-45c4-a7ec-e9a3460166db req-64f2523a-cc91-4dfb-b132-382506422dd5 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Refreshing instance network info cache due to event network-changed-f1642905-d742-47f6-82ab-cea550ba4748. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:26:28.485113 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2013d9f8-07f7-45c4-a7ec-e9a3460166db req-64f2523a-cc91-4dfb-b132-382506422dd5 service nova] Acquiring lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:26:28.485211 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2013d9f8-07f7-45c4-a7ec-e9a3460166db req-64f2523a-cc91-4dfb-b132-382506422dd5 service nova] Acquired lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:26:28.485318 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2013d9f8-07f7-45c4-a7ec-e9a3460166db req-64f2523a-cc91-4dfb-b132-382506422dd5 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Refreshing network info cache for port f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:26:28.576285 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:26:28.580231 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:26:28.584688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c1fc9480-7a93-494d-b925-be2468a79ede tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.965s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:26:28.987185 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2013d9f8-07f7-45c4-a7ec-e9a3460166db req-64f2523a-cc91-4dfb-b132-382506422dd5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:26:29.266753 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-2013d9f8-07f7-45c4-a7ec-e9a3460166db req-64f2523a-cc91-4dfb-b132-382506422dd5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:26:29.378681 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2013d9f8-07f7-45c4-a7ec-e9a3460166db req-64f2523a-cc91-4dfb-b132-382506422dd5 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Updated VIF entry in instance network info cache for port f1642905-d742-47f6-82ab-cea550ba4748. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:26:29.378973 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-2013d9f8-07f7-45c4-a7ec-e9a3460166db req-64f2523a-cc91-4dfb-b132-382506422dd5 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Updating instance_info_cache with network_info: [{"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:26:29.562792 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:29.880787 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-2013d9f8-07f7-45c4-a7ec-e9a3460166db req-64f2523a-cc91-4dfb-b132-382506422dd5 service nova] Releasing lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:26:33.330686 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:34.565528 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:38.345045 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:39.577948 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:43.365990 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:44.592357 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:48.375097 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:49.605381 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:53.385913 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:54.615049 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:58.397113 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:58.430254 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:26:58.430651 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:26:58.933560 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:26:59.625409 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:26:59.938696 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:01.022475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:01.022873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:01.022873 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attaching volume b730cab8-3400-4d29-ab2a-c6341eca5ac6 to /dev/vdb
May 27 23:27:01.056592 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:27:01.067446 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:27:01.088318 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:01.143880 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:27:01.144299 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:27:01.153646 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:27:01.155089 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe39:fc03', 'fe80::464:47ff:fea6:3c4d'] 
May 27 23:27:01.155269 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:27:01.155474 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:27:01.155819 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:27:01.156272 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Updating existing volume attachment record: db80782e-9ccb-4319-beec-e75de98e30c5 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:27:01.705510 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:27:01.705945 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:27:01.706116 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:27:01.706626 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:27:01.706849 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:27:01.718553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:27:01.719068 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:27:01.719701 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:27:01.720041 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:27:01.720431 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:27:01.720690 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:27:01.730851 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:27:01.730851 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:01.736134 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:27:01.736134 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:01.742926 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6] added
May 27 23:27:01.742926 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:27:01.742926 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:01.742926 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:01.742926 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:01.742926 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:01.742926 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:01.743118 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:27:01.743238 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0237(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:27:01.743392 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:27:01.746463 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6] added
May 27 23:27:01.746463 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:27:01.746463 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:01.746463 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:01.746463 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:01.746463 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:01.746463 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:01.746604 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:27:01.746721 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:27:01.746847 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:27:02.123931 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:27:02.628683 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:02.628894 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:02.629041 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:02.629178 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:27:02.743855 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:27:02.747244 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:27:02.755423 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:27:02.755423 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:27:02.761690 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:27:02.761690 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:02.767284 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:02.774202 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:02.779579 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:27:02.779579 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:02.779738 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:27:02.779738 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:02.779782 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:27:02.779782 np0000001565 nova-compute[98289]: 
May 27 23:27:02.785713 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:27:02.785713 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:02.785825 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:27:02.785825 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:02.785924 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:27:02.785924 np0000001565 nova-compute[98289]: 
May 27 23:27:03.410098 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:03.646226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:03.736907 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:27:03.737411 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:03.813482 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6, portal: 192.168.40.100,3260]
May 27 23:27:03.813482 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6, portal: 192.168.40.100,3260] successful.
May 27 23:27:03.813482 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:03.818537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6, portal: 192.168.50.100,3260]
May 27 23:27:03.818537 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6, portal: 192.168.50.100,3260] successful.
May 27 23:27:03.818537 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:03.824991 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:03.831208 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:03.832141 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:27:03.836928 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:27:03.838281 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:03.838721 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:03.838721 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:03.838721 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:03.851200 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:03.851200 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:03.851200 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:03.853739 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.135s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:27:03.853940 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:27:03.854700 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:03.854700 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:03.854700 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:03.854878 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:03.854878 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:03.854878 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:03.855255 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.135s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:27:03.855407 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:27:03.856251 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] HCTL ('7', '-', '-', 0) found on session 227 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:27:03.856439 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:27:03.856914 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] HCTL ('8', '-', '-', 0) found on session 228 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:27:03.857036 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:27:03.870553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 227 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:27:03.870553 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:27:03.876914 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 228 and hctl ['8', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:27:03.887493 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:27:03.888235 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13690MB free_disk=72.58535766601562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:27:03.888466 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:03.888561 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:04.874863 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 228 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:27:04.875496 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:27:04.946171 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance eee054e7-0060-4f21-8573-91b8e0564192 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:27:04.946351 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:27:04.946461 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:27:03 up 55 min,  2 users,  load average: 1.11, 2.09, 3.11\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_1ec606fe4c964d358de1d627ce948d87': '1', 'io_workload': '0'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:27:05.029490 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:27:05.029719 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:27:05.532174 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:27:05.734900 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found WWN 3300000004ffbbd33 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:27:05.735324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:27:05.735632 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== connect_volume: return (4029ms) {'type': 'block', 'scsi_wwn': '3300000004ffbbd33', 'path': '/dev/dm-0', 'multipath_id': '3300000004ffbbd33'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:27:05.735834 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004ffbbd33', 'path': '/dev/dm-0', 'multipath_id': '3300000004ffbbd33'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:27:05.738629 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:27:06.039249 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:27:06.039735 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.151s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:06.039927 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:27:06.241612 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attempting to attach volume b730cab8-3400-4d29-ab2a-c6341eca5ac6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:27:06.242934 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:27:06.242934 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:27:06.242934 np0000001565 nova-compute[98289]:   <alias name="ua-b730cab8-3400-4d29-ab2a-c6341eca5ac6"/>
May 27 23:27:06.242934 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:27:06.242934 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:27:06.242934 np0000001565 nova-compute[98289]:   <serial>b730cab8-3400-4d29-ab2a-c6341eca5ac6</serial>
May 27 23:27:06.242934 np0000001565 nova-compute[98289]: </disk>
May 27 23:27:06.242934 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:27:07.867707 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:07.868136 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:07.868136 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:07.868136 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No VIF found with MAC fa:16:3e:39:fc:03, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:27:08.415574 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:27:08.415848 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:27:08.415913 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:27:08.415958 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:27:08.425202 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:08.425458 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:27:09.280194 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:09.410941 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-c9d40795-47bf-458f-9b72-87e3d4cefe3d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.388s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:09.411796 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.131s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:09.916148 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:27:10.039837 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:27:10.040130 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:27:10.040414 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.08 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:27:10.921696 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:11.867064 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:11.867243 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:11.867449 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attaching volume 8d09ee6f-2bd4-472d-8189-fe8c92088966 to /dev/vdc
May 27 23:27:11.900607 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:27:11.912205 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:27:11.932169 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:11.975440 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:27:11.975735 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:27:11.984109 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:27:11.984978 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe39:fc03', 'fe80::464:47ff:fea6:3c4d'] 
May 27 23:27:11.985083 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:27:11.985198 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:27:11.985476 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:27:11.985646 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Updating existing volume attachment record: 3f3f254f-f4b1-4801-b0b2-e5a40668621c {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:27:12.118217 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:27:12.118667 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:27:12.123711 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:27:12.123977 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:27:12.124294 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:27:12.557034 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'eee054e7-0060-4f21-8573-91b8e0564192', 'attached_at': '', 'detached_at': '', 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'serial': '8d09ee6f-2bd4-472d-8189-fe8c92088966'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:27:12.560261 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:27:12.560678 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:27:12.560805 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:27:12.561287 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:27:12.561556 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:27:12.572401 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:27:12.574058 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:27:12.574716 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:27:12.575016 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:27:12.575505 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:27:12.575740 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:27:12.586759 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:27:12.586759 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:12.587972 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:27:12.587972 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:12.597203 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966] added
May 27 23:27:12.597203 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:27:12.597203 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:12.597203 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:12.597203 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:12.597203 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:12.597203 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:12.597399 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:27:12.597566 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:27:12.597750 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:27:12.601817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966] added
May 27 23:27:12.601817 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:27:12.601817 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:12.601817 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:12.601817 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:12.601817 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:12.601817 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:12.601973 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:27:12.602092 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:27:12.602211 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:27:13.426690 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:13.598238 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:27:13.602573 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:27:13.610408 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:27:13.610408 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:27:13.615963 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:27:13.615963 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:13.622316 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:13.628210 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:13.635141 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.635141 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.635141 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:13.635387 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.635387 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.635387 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:13.640721 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.640721 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.640721 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:13.640936 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.640936 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.640936 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:13.671570 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966, portal: 192.168.40.100,3260]
May 27 23:27:13.671570 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966, portal: 192.168.40.100,3260] successful.
May 27 23:27:13.671570 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:13.682948 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:13.691363 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966, portal: 192.168.50.100,3260]
May 27 23:27:13.691363 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966, portal: 192.168.50.100,3260] successful.
May 27 23:27:13.691363 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:13.697030 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.697030 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.697030 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:13.697030 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:13.697030 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:13.697208 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.697208 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.697208 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:13.697208 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:13.697208 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:13.697431 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:27:13.697527 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:27:13.698129 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] HCTL ('9', '-', '-', 0) found on session 229 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:27:13.698228 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:27:13.703487 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:13.712505 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 229 and hctl ['9', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:27:13.715591 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.715591 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.715591 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:13.715591 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:13.715591 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:13.715713 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.715713 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:13.715713 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:13.715713 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:13.715713 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:13.715946 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:27:13.716053 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:27:13.716634 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] HCTL ('10', '-', '-', 0) found on session 230 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:27:13.716741 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:27:13.729251 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 230 and hctl ['10', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:27:14.712133 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 229 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:27:14.712604 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:27:14.729560 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 230 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:27:14.729808 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:27:15.123780 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:27:15.123888 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:27:15.124092 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:27:15.575386 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:27:16.590863 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found WWN 330000000003ffa2b for multipath device dm-1 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:27:16.591389 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.030s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:27:16.592411 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== connect_volume: return (4031ms) {'type': 'block', 'scsi_wwn': '330000000003ffa2b', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000003ffa2b'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:27:16.592543 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000003ffa2b', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000003ffa2b'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:27:16.594560 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:27:16.594828 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:27:16.595021 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:27:16.609676 np0000001565 nova-compute[98289]: WARNING os_brick.encryptors.luks [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 23:27:16.609982 np0000001565 nova-compute[98289]: WARNING stevedore.named [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 23:27:16.610129 np0000001565 nova-compute[98289]: WARNING castellan.key_manager [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:27:16.610259 np0000001565 nova-compute[98289]: WARNING nova.keymgr.conf_key_mgr [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 23:27:16.610760 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x726e5812b230>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'eee054e7-0060-4f21-8573-91b8e0564192', 'attached_at': '', 'detached_at': '', 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'serial': '8d09ee6f-2bd4-472d-8189-fe8c92088966'} {{(pid=98289) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 23:27:16.610882 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors.luks [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98289) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 27 23:27:18.124154 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:27:18.124613 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:27:18.428785 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:20.503006 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 23:27:20.503006 np0000001565 nova-compute[98289]:   <usage type="volume">
May 27 23:27:20.503006 np0000001565 nova-compute[98289]:     <volume>8d09ee6f-2bd4-472d-8189-fe8c92088966</volume>
May 27 23:27:20.503006 np0000001565 nova-compute[98289]:   </usage>
May 27 23:27:20.503006 np0000001565 nova-compute[98289]: </secret>
May 27 23:27:20.503006 np0000001565 nova-compute[98289]:  {{(pid=98289) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 23:27:20.509377 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:27:21.012614 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attempting to attach volume 8d09ee6f-2bd4-472d-8189-fe8c92088966 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:27:21.013994 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:27:21.013994 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:27:21.013994 np0000001565 nova-compute[98289]:   <alias name="ua-8d09ee6f-2bd4-472d-8189-fe8c92088966"/>
May 27 23:27:21.013994 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 27 23:27:21.013994 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:27:21.013994 np0000001565 nova-compute[98289]:   <serial>8d09ee6f-2bd4-472d-8189-fe8c92088966</serial>
May 27 23:27:21.013994 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:27:21.013994 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="572d7df8-6347-4251-98d4-e38ef361c35e"/>
May 27 23:27:21.013994 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:27:21.013994 np0000001565 nova-compute[98289]: </disk>
May 27 23:27:21.013994 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:27:23.431167 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:23.635378 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:23.635378 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:23.635378 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:23.635378 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:23.635378 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No VIF found with MAC fa:16:3e:39:fc:03, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:27:25.177320 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-ad394233-7f4e-4da4-b0f3-346d20b8790a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.310s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:25.800201 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:25.800459 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:26.304538 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:27:27.309563 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:28.401030 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:28.401479 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:28.401479 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attaching volume db227bf6-8e81-45a9-b1b0-de41ca4385a4 to /dev/vdd
May 27 23:27:28.432615 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:28.435115 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:27:28.446220 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:27:28.469421 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:28.512114 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:27:28.512434 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:27:28.521943 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:27:28.522892 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe39:fc03', 'fe80::464:47ff:fea6:3c4d'] 
May 27 23:27:28.523010 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:27:28.523120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:27:28.523339 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:27:28.523581 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Updating existing volume attachment record: c5166097-7e25-48d4-a0a5-636867876508 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:27:29.072788 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:27:29.073174 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:27:29.073466 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:27:29.074063 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:27:29.074345 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:27:29.085101 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:27:29.085539 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:27:29.085887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:27:29.086119 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:27:29.086445 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:27:29.086601 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:27:29.099467 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:27:29.099467 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:29.104314 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:27:29.104314 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:29.110975 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4] added
May 27 23:27:29.110975 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:27:29.110975 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:29.110975 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:29.110975 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:29.110975 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:29.110975 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:29.111154 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:27:29.111340 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:27:29.111613 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:27:29.117001 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4] added
May 27 23:27:29.117001 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:27:29.117001 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:29.117001 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:29.117001 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:27:29.117001 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:27:29.117001 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:29.117179 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:27:29.117298 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:27:29.117465 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:27:29.634811 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:30.112147 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:27:30.117835 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:27:30.124050 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:27:30.124050 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:27:30.130229 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:27:30.130229 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:30.136730 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:30.143353 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:30.149691 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.149691 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.149691 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.149691 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.149691 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:30.149883 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.149883 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.149883 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.149883 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.149883 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:30.157379 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.157379 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.157379 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.157379 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.157379 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:30.157639 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.157639 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.157639 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.157639 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.157639 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:30.183708 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4, portal: 192.168.40.100,3260]
May 27 23:27:30.183708 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4, portal: 192.168.40.100,3260] successful.
May 27 23:27:30.183708 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:30.194764 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:30.199390 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4, portal: 192.168.50.100,3260]
May 27 23:27:30.199390 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4, portal: 192.168.50.100,3260] successful.
May 27 23:27:30.199390 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:30.209020 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.209020 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.209020 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.209020 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.209020 np0000001565 nova-compute[98289]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:27:30.209020 np0000001565 nova-compute[98289]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:27:30.209020 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:30.209225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.209225 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.209225 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.209225 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.209225 np0000001565 nova-compute[98289]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:27:30.209225 np0000001565 nova-compute[98289]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:27:30.209225 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:30.209443 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:27:30.209543 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:27:30.210278 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] HCTL ('11', '-', '-', 0) found on session 231 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:27:30.210415 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:27:30.214935 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:27:30.223706 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 231 and hctl ['11', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:27:30.230348 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.230348 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.230348 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.230348 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.230348 np0000001565 nova-compute[98289]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:27:30.230348 np0000001565 nova-compute[98289]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:27:30.230348 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:27:30.230632 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.230632 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:27:30.230632 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.230632 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:27:30.230632 np0000001565 nova-compute[98289]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:27:30.230632 np0000001565 nova-compute[98289]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:27:30.230632 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:27:30.230843 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:27:30.230930 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:27:30.231563 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] HCTL ('12', '-', '-', 0) found on session 232 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:27:30.231664 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:27:30.244817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 232 and hctl ['12', '*', '*', 0] yield: None {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:27:31.224085 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 231 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:27:31.224624 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:27:31.244557 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 232 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:27:31.244718 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:27:32.086695 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:27:33.101385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found WWN 3300000003c1c9852 for multipath device dm-2 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:27:33.101385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.027s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:27:33.101385 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== connect_volume: return (4027ms) {'type': 'block', 'scsi_wwn': '3300000003c1c9852', 'path': '/dev/dm-2', 'multipath_id': '3300000003c1c9852'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:27:33.101921 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003c1c9852', 'path': '/dev/dm-2', 'multipath_id': '3300000003c1c9852'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:27:33.104057 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:27:33.444408 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:33.607274 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attempting to attach volume db227bf6-8e81-45a9-b1b0-de41ca4385a4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:27:33.608431 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:27:33.608431 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:27:33.608431 np0000001565 nova-compute[98289]:   <alias name="ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4"/>
May 27 23:27:33.608431 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:27:33.608431 np0000001565 nova-compute[98289]:   <target dev="vdd" bus="virtio"/>
May 27 23:27:33.608431 np0000001565 nova-compute[98289]:   <serial>db227bf6-8e81-45a9-b1b0-de41ca4385a4</serial>
May 27 23:27:33.608431 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:27:33.608431 np0000001565 nova-compute[98289]: </disk>
May 27 23:27:33.608431 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:27:35.237614 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:35.238014 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:35.238014 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:35.238014 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:35.238014 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:35.238014 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No VIF found with MAC fa:16:3e:39:fc:03, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:27:36.779735 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-f88ea8b9-2890-451f-8f66-8469516b74ca tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.379s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:38.449753 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:27:38.450188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:27:38.450188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:27:38.450188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:27:38.454176 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:38.454341 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:27:39.643618 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:39.670039 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:39.670039 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:40.171967 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:27:40.718353 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:40.718673 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:40.721497 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:27:40.721674 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Claim successful on node np0000001565
May 27 23:27:41.853411 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:27:41.853808 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:27:42.356197 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:27:42.862437 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.144s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:42.862879 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:27:43.367871 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:27:43.368160 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:27:43.368700 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:27:43.369141 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:27:43.434198 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c175a7231a7b496eacfc7a46ad2a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec606fe4c964d358de1d627ce948d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:27:43.467468 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:43.730446 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:43.869442 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:27:43.910735 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Successfully created port: 1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:27:44.352108 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Successfully updated port: 1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:27:44.372609 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:27:44.396531 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-62b09452-4d8c-458c-8905-d455f5fd7929 req-53ac744e-de75-4304-adfe-3b7793de9df4 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Received event network-changed-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:27:44.397126 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-62b09452-4d8c-458c-8905-d455f5fd7929 req-53ac744e-de75-4304-adfe-3b7793de9df4 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Refreshing instance network info cache due to event network-changed-1df13c9c-1dc4-4392-bba6-7f22998da688. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:27:44.397351 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-62b09452-4d8c-458c-8905-d455f5fd7929 req-53ac744e-de75-4304-adfe-3b7793de9df4 service nova] Acquiring lock "refresh_cache-0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:27:44.397555 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-62b09452-4d8c-458c-8905-d455f5fd7929 req-53ac744e-de75-4304-adfe-3b7793de9df4 service nova] Acquired lock "refresh_cache-0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:27:44.397708 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-62b09452-4d8c-458c-8905-d455f5fd7929 req-53ac744e-de75-4304-adfe-3b7793de9df4 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Refreshing network info cache for port 1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:27:44.854197 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "refresh_cache-0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:27:44.899782 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-62b09452-4d8c-458c-8905-d455f5fd7929 req-53ac744e-de75-4304-adfe-3b7793de9df4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:27:44.957064 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-62b09452-4d8c-458c-8905-d455f5fd7929 req-53ac744e-de75-4304-adfe-3b7793de9df4 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:27:45.072688 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-62b09452-4d8c-458c-8905-d455f5fd7929 req-53ac744e-de75-4304-adfe-3b7793de9df4 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:27:45.379802 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:27:45.380906 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:27:45.381246 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Creating image(s)
May 27 23:27:45.382019 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "/opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:45.382171 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "/opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:45.382637 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "/opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:45.383186 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:27:45.385767 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:27:45.386643 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:45.474036 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:27:45.474459 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:45.474885 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:45.475362 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:27:45.477722 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:27:45.478014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:45.565304 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.087s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:27:45.565688 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:45.577054 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-62b09452-4d8c-458c-8905-d455f5fd7929 req-53ac744e-de75-4304-adfe-3b7793de9df4 service nova] Releasing lock "refresh_cache-0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:27:45.578389 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquired lock "refresh_cache-0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:27:45.578389 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:27:45.620534 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk 1073741824" returned: 0 in 0.055s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:27:45.620882 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:45.621177 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:45.705810 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.084s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:27:45.706241 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:27:45.706517 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:45.792527 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:27:45.792910 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Cannot resize image /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:27:45.793493 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:27:45.793672 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Ensure instance console log exists: /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:27:45.794159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:45.794159 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:45.794278 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:46.137717 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:27:46.271033 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:27:46.384036 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Updating instance_info_cache with network_info: [{"id": "1df13c9c-1dc4-4392-bba6-7f22998da688", "address": "fa:16:3e:5c:8a:d4", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df13c9c-1d", "ovs_interfaceid": "1df13c9c-1dc4-4392-bba6-7f22998da688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:27:46.886348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Releasing lock "refresh_cache-0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:27:46.886625 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Instance network_info: |[{"id": "1df13c9c-1dc4-4392-bba6-7f22998da688", "address": "fa:16:3e:5c:8a:d4", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df13c9c-1d", "ovs_interfaceid": "1df13c9c-1dc4-4392-bba6-7f22998da688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:27:46.888262 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Start _get_guest_xml network_info=[{"id": "1df13c9c-1dc4-4392-bba6-7f22998da688", "address": "fa:16:3e:5c:8a:d4", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df13c9c-1d", "ovs_interfaceid": "1df13c9c-1dc4-4392-bba6-7f22998da688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:27:46.892134 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:27:46.893252 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1451538514', uuid='0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7'), owner=OwnerMeta(userid='c175a7231a7b496eacfc7a46ad2a379d', username='tempest-VolumeMultiattachTests-892484312-project-member', projectid='1ec606fe4c964d358de1d627ce948d87', projectname='tempest-VolumeMultiattachTests-892484312'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1df13c9c-1dc4-4392-bba6-7f22998da688", "address": "fa:16:3e:5c:8a:d4", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df13c9c-1d", "ovs_interfaceid": "1df13c9c-1dc4-4392-bba6-7f22998da688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779924466.8929334) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:27:46.894240 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:27:46.894573 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:27:46.895483 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:27:46.895633 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:27:46.896619 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:27:46.896900 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:27:46.897047 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:27:46.897127 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:27:46.897275 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:27:46.897385 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:27:46.897502 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:27:46.897644 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:27:46.897741 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:27:46.897841 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:27:46.897934 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:27:46.898059 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:27:46.907647 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:27:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1451538514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumemultiattachtests-server-1451538514',id=81,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVQnlvngnzpx8nZmIeojUodUInaOiAo394MWlnUAbFDRXt7nIzdnZu30tlYxOW13akWbDAd8NbmEzp08LI3YRQ7nDPPUghaFadIXon2DMM+8RrQt26DZlzF60DfmUP/OA==',key_name='tempest-keypair-1042981963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec606fe4c964d358de1d627ce948d87',ramdisk_id='',reservation_id='r-2lx89185',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-892484312',owner_user_name='tempest-VolumeMultiattachTests-892484312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:27:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c175a7231a7b496eacfc7a46ad2a379d',uuid=0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1df13c9c-1dc4-4392-bba6-7f22998da688", "address": "fa:16:3e:5c:8a:d4", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df13c9c-1d", "ovs_interfaceid": "1df13c9c-1dc4-4392-bba6-7f22998da688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:27:46.907801 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converting VIF {"id": "1df13c9c-1dc4-4392-bba6-7f22998da688", "address": "fa:16:3e:5c:8a:d4", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df13c9c-1d", "ovs_interfaceid": "1df13c9c-1dc4-4392-bba6-7f22998da688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:27:46.908356 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=1df13c9c-1dc4-4392-bba6-7f22998da688,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df13c9c-1d') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:27:46.909534 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'pci_devices' on Instance uuid 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:27:47.412207 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] End _get_guest_xml xml=<domain type="qemu">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <uuid>0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7</uuid>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <name>instance-00000051</name>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumeMultiattachTests-server-1451538514</nova:name>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:27:46</nova:creationTime>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:user uuid="c175a7231a7b496eacfc7a46ad2a379d">tempest-VolumeMultiattachTests-892484312-project-member</nova:user>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:project uuid="1ec606fe4c964d358de1d627ce948d87">tempest-VolumeMultiattachTests-892484312</nova:project>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         <nova:port uuid="1df13c9c-1dc4-4392-bba6-7f22998da688">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <system>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <entry name="serial">0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7</entry>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <entry name="uuid">0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7</entry>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     </system>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <os>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   </os>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <features>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   </features>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   <devices>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     </disk>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk.config"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     </disk>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:5c:8a:d4"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <target dev="tap1df13c9c-1d"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     </interface>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/console.log" append="off"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     </serial>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <video>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     </video>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     </rng>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:   </devices>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]: </domain>
May 27 23:27:47.412207 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:27:47.414475 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Preparing to wait for external event network-vif-plugged-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:27:47.414475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:47.414475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:47.414475 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:47.414475 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:27:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1451538514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumemultiattachtests-server-1451538514',id=81,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVQnlvngnzpx8nZmIeojUodUInaOiAo394MWlnUAbFDRXt7nIzdnZu30tlYxOW13akWbDAd8NbmEzp08LI3YRQ7nDPPUghaFadIXon2DMM+8RrQt26DZlzF60DfmUP/OA==',key_name='tempest-keypair-1042981963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec606fe4c964d358de1d627ce948d87',ramdisk_id='',reservation_id='r-2lx89185',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-892484312',owner_user_name='tempest-VolumeMultiattachTests-892484312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:27:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c175a7231a7b496eacfc7a46ad2a379d',uuid=0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1df13c9c-1dc4-4392-bba6-7f22998da688", "address": "fa:16:3e:5c:8a:d4", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df13c9c-1d", "ovs_interfaceid": "1df13c9c-1dc4-4392-bba6-7f22998da688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:27:47.414475 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converting VIF {"id": "1df13c9c-1dc4-4392-bba6-7f22998da688", "address": "fa:16:3e:5c:8a:d4", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df13c9c-1d", "ovs_interfaceid": "1df13c9c-1dc4-4392-bba6-7f22998da688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:27:47.414475 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=1df13c9c-1dc4-4392-bba6-7f22998da688,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df13c9c-1d') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:27:47.414475 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=1df13c9c-1dc4-4392-bba6-7f22998da688,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df13c9c-1d') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:27:47.414895 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:47.415198 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:27:47.415491 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:27:47.416519 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:47.416681 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9ee2369-2a5f-5500-a735-c4941eb845b6', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:27:47.417591 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:47.418312 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:27:47.418512 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:47.420149 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:47.420296 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1df13c9c-1d, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:27:47.420604 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1df13c9c-1d, col_values=(('qos', UUID('c4a42552-7894-4b8b-ab20-ddf649db4108')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:27:47.420750 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1df13c9c-1d, col_values=(('external_ids', {'iface-id': '1df13c9c-1dc4-4392-bba6-7f22998da688', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:8a:d4', 'vm-uuid': '0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:27:47.421631 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:47.423070 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:27:47.426545 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:47.427467 np0000001565 nova-compute[98289]: INFO os_vif [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=1df13c9c-1dc4-4392-bba6-7f22998da688,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df13c9c-1d')
May 27 23:27:48.941117 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:48.941591 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:27:48.941591 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No VIF found with MAC fa:16:3e:5c:8a:d4, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:27:48.941812 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Using config drive
May 27 23:27:49.446412 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:27:49.548402 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Creating config drive at /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk.config
May 27 23:27:49.551987 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcskmz2tr {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:27:49.603423 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcskmz2tr" returned: 0 in 0.051s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:27:49.970742 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:49.984743 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:49.987158 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:50.065593 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:50.121441 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:50.122708 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:50.142052 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a58f5563-f967-402f-bfa1-0e27497354aa req-20e10a7a-62d7-4aec-b945-ef091fbbd8c6 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Received event network-vif-plugged-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:27:50.142645 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a58f5563-f967-402f-bfa1-0e27497354aa req-20e10a7a-62d7-4aec-b945-ef091fbbd8c6 service nova] Acquiring lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:50.142884 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a58f5563-f967-402f-bfa1-0e27497354aa req-20e10a7a-62d7-4aec-b945-ef091fbbd8c6 service nova] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:50.143069 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-a58f5563-f967-402f-bfa1-0e27497354aa req-20e10a7a-62d7-4aec-b945-ef091fbbd8c6 service nova] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:50.143216 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a58f5563-f967-402f-bfa1-0e27497354aa req-20e10a7a-62d7-4aec-b945-ef091fbbd8c6 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Processing event network-vif-plugged-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:27:50.640490 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924470.640001, 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:27:50.640920 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:27:50.641354 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] VM Started (Lifecycle Event)
May 27 23:27:50.643324 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:27:50.646524 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Instance spawned successfully.
May 27 23:27:50.646779 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:27:51.145406 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:27:51.147406 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:27:51.153116 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:27:51.153237 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:27:51.153545 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:27:51.153765 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:27:51.154031 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:27:51.154288 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:27:51.651413 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:27:51.651691 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924471.651494, 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:27:51.651805 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] VM Paused (Lifecycle Event)
May 27 23:27:51.658867 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Took 6.28 seconds to spawn the instance on the hypervisor.
May 27 23:27:51.659097 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:27:52.154288 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:27:52.156570 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924472.1562557, 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:27:52.156762 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] VM Resumed (Lifecycle Event)
May 27 23:27:52.170386 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Took 11.49 seconds to build instance.
May 27 23:27:52.207994 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3a7a5321-28aa-42c7-8d09-80d873fbff1b req-48f63663-8e89-4839-a2a1-4b92befbed44 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Received event network-vif-plugged-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:27:52.208083 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3a7a5321-28aa-42c7-8d09-80d873fbff1b req-48f63663-8e89-4839-a2a1-4b92befbed44 service nova] Acquiring lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:27:52.208272 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3a7a5321-28aa-42c7-8d09-80d873fbff1b req-48f63663-8e89-4839-a2a1-4b92befbed44 service nova] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:27:52.208434 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3a7a5321-28aa-42c7-8d09-80d873fbff1b req-48f63663-8e89-4839-a2a1-4b92befbed44 service nova] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:52.208563 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3a7a5321-28aa-42c7-8d09-80d873fbff1b req-48f63663-8e89-4839-a2a1-4b92befbed44 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] No waiting events found dispatching network-vif-plugged-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:27:52.208697 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-3a7a5321-28aa-42c7-8d09-80d873fbff1b req-48f63663-8e89-4839-a2a1-4b92befbed44 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Received unexpected event network-vif-plugged-1df13c9c-1dc4-4392-bba6-7f22998da688 for instance with vm_state active and task_state None.
May 27 23:27:52.421977 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:52.659809 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:27:52.661653 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:27:52.671886 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-5303c1d5-58f7-4500-b99b-175db4bbd99d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.002s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:27:54.275753 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Received event network-changed-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:27:54.276088 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Refreshing instance network info cache due to event network-changed-f1642905-d742-47f6-82ab-cea550ba4748. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:27:54.276088 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] Acquiring lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:27:54.276178 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] Acquired lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:27:54.276292 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Refreshing network info cache for port f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:27:54.658747 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:54.778573 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:27:55.042954 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:27:55.169415 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Updated VIF entry in instance network info cache for port f1642905-d742-47f6-82ab-cea550ba4748. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:27:55.169707 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Updating instance_info_cache with network_info: [{"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:27:55.671746 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] Releasing lock "refresh_cache-eee054e7-0060-4f21-8573-91b8e0564192" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:27:55.672213 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Received event network-changed-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:27:55.672213 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Refreshing instance network info cache due to event network-changed-1df13c9c-1dc4-4392-bba6-7f22998da688. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:27:55.672213 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] Acquiring lock "refresh_cache-0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:27:55.672213 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] Acquired lock "refresh_cache-0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:27:55.672565 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Refreshing network info cache for port 1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:27:56.174646 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:27:56.437984 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:27:56.547898 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Updated VIF entry in instance network info cache for port 1df13c9c-1dc4-4392-bba6-7f22998da688. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:27:56.548170 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Updating instance_info_cache with network_info: [{"id": "1df13c9c-1dc4-4392-bba6-7f22998da688", "address": "fa:16:3e:5c:8a:d4", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df13c9c-1d", "ovs_interfaceid": "1df13c9c-1dc4-4392-bba6-7f22998da688", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:27:57.050054 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-3c345336-44d8-4b16-8ef9-63299b36add3 req-5e32d670-2603-4656-b75a-5aee026f3e5f service nova] Releasing lock "refresh_cache-0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:27:57.422830 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:27:59.669910 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:02.428559 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:03.123883 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:03.627578 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:03.628086 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:03.628086 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:03.628086 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:28:04.646511 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:28:04.680408 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:04.736233 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:28:04.736675 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:28:04.824977 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:28:04.825448 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:28:04.825595 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdc) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:28:04.825670 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] skipping disk /dev/dm-2 (vdd) as it is a volume {{(pid=98289) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 23:28:04.829450 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:28:04.914703 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:28:04.915137 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:28:05.001889 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:28:05.005741 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:28:05.006801 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:28:05.051136 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:28:05.051520 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13360MB free_disk=72.54709243774414GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:28:05.051696 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:05.051915 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:06.104146 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance eee054e7-0060-4f21-8573-91b8e0564192 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:28:06.104610 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:28:06.104610 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:28:06.104610 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:28:05 up 56 min,  2 users,  load average: 1.09, 1.86, 2.97\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_1ec606fe4c964d358de1d627ce948d87': '2', 'io_workload': '0'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:28:06.221207 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:28:06.221438 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:28:06.723783 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:28:07.230261 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:28:07.230714 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.178s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:07.230882 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:07.443019 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:08.773415 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:09.691131 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:11.230882 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:11.231309 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:11.231500 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.89 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:12.117988 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:12.118353 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:12.123495 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:12.123744 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:12.124027 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:12.445460 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:14.117885 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:14.118370 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.01 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:14.706396 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:16.123784 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:16.124234 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:28:16.124234 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:17.459119 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:19.124282 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:19.124737 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:19.716571 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:22.124714 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:22.477079 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:22.625979 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:26.626041 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:26.626589 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 27 23:28:27.128167 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] There are 0 instances to clean {{(pid=98289) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 27 23:28:27.128609 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:27.488188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:28:27.488188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:27.488188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5010 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:28:27.488188 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:28:27.488378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:28:27.488526 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:29.725986 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:30.427693 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:30.428402 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:30.931041 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:28:31.124398 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:31.124398 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98289) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 27 23:28:31.625995 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 26.24 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:31.935741 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:32.507961 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:32.997666 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:32.998122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:32.998122 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Attaching volume db227bf6-8e81-45a9-b1b0-de41ca4385a4 to /dev/vdb
May 27 23:28:33.032392 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:28:33.045537 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:28:33.066590 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:28:33.110402 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:28:33.110697 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:28:33.119186 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:28:33.120103 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fe39:fc03', 'fe80::464:47ff:fea6:3c4d', 'fe80::fc16:3eff:fe5c:8ad4'] 
May 27 23:28:33.120217 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:28:33.120359 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:28:33.120682 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:28:33.120907 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Updating existing volume attachment record: aaf0a878-44ad-48dd-9ef4-2f09d883bfe0 {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:28:33.666738 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:28:33.667054 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:28:33.667214 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:28:33.667625 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:28:33.667806 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:28:33.678350 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:28:33.679018 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:28:33.679513 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:28:33.679725 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:28:33.680111 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:28:33.680343 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:28:33.690472 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:28:33.690472 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.startup = automatic
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.scan = manual
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:28:33.695563 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:28:33.695563 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:33.704227 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:33.708377 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:33.721351 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:33.721351 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:33.721351 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:33.721351 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:33.721351 np0000001565 nova-compute[98289]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:33.721351 np0000001565 nova-compute[98289]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:33.721351 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:28:33.721669 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:33.721669 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:33.721669 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:33.721669 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:33.721669 np0000001565 nova-compute[98289]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:33.721669 np0000001565 nova-compute[98289]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:33.721669 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:28:33.722120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:33.722120 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:33.722120 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:33.722120 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:33.722120 np0000001565 nova-compute[98289]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:33.722120 np0000001565 nova-compute[98289]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:33.722120 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:28:33.722295 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:33.722295 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:33.722295 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:33.722295 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:33.722295 np0000001565 nova-compute[98289]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:33.722295 np0000001565 nova-compute[98289]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:33.722295 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:28:33.722584 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.043s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:28:33.722937 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.044s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:28:33.723105 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:28:33.723308 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:28:33.724392 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] HCTL ('12', '0', '0', 0) found on session 232 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:28:33.724506 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:28:33.724805 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] HCTL ('11', '0', '0', 0) found on session 231 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:28:33.724959 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:28:33.734026 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 232 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:28:33.734120 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:28:33.736174 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 231 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:28:33.736322 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:28:34.680712 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:28:34.726913 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:35.696810 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found WWN 3300000003c1c9852 for multipath device dm-2 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:28:35.697292 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.029s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:28:35.697374 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== connect_volume: return (2029ms) {'type': 'block', 'scsi_wwn': '3300000003c1c9852', 'path': '/dev/dm-2', 'multipath_id': '3300000003c1c9852'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:28:35.697543 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003c1c9852', 'path': '/dev/dm-2', 'multipath_id': '3300000003c1c9852'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:28:35.700456 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:28:36.204228 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Attempting to attach volume db227bf6-8e81-45a9-b1b0-de41ca4385a4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:28:36.205513 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:28:36.205513 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:28:36.205513 np0000001565 nova-compute[98289]:   <alias name="ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4"/>
May 27 23:28:36.205513 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:28:36.205513 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:28:36.205513 np0000001565 nova-compute[98289]:   <serial>db227bf6-8e81-45a9-b1b0-de41ca4385a4</serial>
May 27 23:28:36.205513 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:28:36.205513 np0000001565 nova-compute[98289]: </disk>
May 27 23:28:36.205513 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:28:37.522132 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:37.835522 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:28:37.835690 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:28:37.835820 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:28:37.835972 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No VIF found with MAC fa:16:3e:5c:8a:d4, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:28:39.377422 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-cfb75410-cf74-4121-9842-2df47a737ad0 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.379s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:39.728169 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:41.030557 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:41.030957 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:41.532771 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Detaching volume db227bf6-8e81-45a9-b1b0-de41ca4385a4
May 27 23:28:41.568801 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Attempting to driver detach volume db227bf6-8e81-45a9-b1b0-de41ca4385a4 from mountpoint /dev/vdb
May 27 23:28:41.572745 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found disk vdb by alias ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:28:41.573995 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found disk vdb by alias ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:28:41.574109 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Attempting to detach device vdb from instance 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:28:41.574319 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:28:41.574319 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:28:41.574319 np0000001565 nova-compute[98289]:   <alias name="ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4"/>
May 27 23:28:41.574319 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:28:41.574319 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:28:41.574319 np0000001565 nova-compute[98289]:   <serial>db227bf6-8e81-45a9-b1b0-de41ca4385a4</serial>
May 27 23:28:41.574319 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:28:41.574319 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:28:41.574319 np0000001565 nova-compute[98289]: </disk>
May 27 23:28:41.574319 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:28:41.579690 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully detached device vdb from instance 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 from the persistent domain config.
May 27 23:28:41.579957 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] (1/8): Attempting to detach device vdb with device alias ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4 from instance 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:28:41.580171 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:28:41.580171 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:28:41.580171 np0000001565 nova-compute[98289]:   <alias name="ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4"/>
May 27 23:28:41.580171 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:28:41.580171 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:28:41.580171 np0000001565 nova-compute[98289]:   <serial>db227bf6-8e81-45a9-b1b0-de41ca4385a4</serial>
May 27 23:28:41.580171 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:28:41.580171 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:28:41.580171 np0000001565 nova-compute[98289]: </disk>
May 27 23:28:41.580171 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:28:42.007800 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779924522.007439, 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 => ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:28:42.008783 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4 for instance 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:28:42.011639 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully detached device vdb from instance 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 from the live domain config.
May 27 23:28:42.543225 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Detected multiple connections on this host for volume: db227bf6-8e81-45a9-b1b0-de41ca4385a4, skipping target disconnect.
May 27 23:28:42.543564 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:43.093386 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:28:44.098258 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-fa8ad40d-cde7-4570-a3f2-8ca15aed6376 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.067s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:44.222219 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:44.222379 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:44.222524 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:44.222696 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:44.222819 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:44.224676 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Terminating instance
May 27 23:28:44.727398 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:28:44.728976 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:44.740379 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:44.741793 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:44.755425 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:44.859052 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b123ac95-5011-4192-b35b-df17076926b5 req-6d26f897-0292-4c58-a991-8098bc1a592d service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Received event network-vif-unplugged-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:28:44.859226 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b123ac95-5011-4192-b35b-df17076926b5 req-6d26f897-0292-4c58-a991-8098bc1a592d service nova] Acquiring lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:44.859521 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b123ac95-5011-4192-b35b-df17076926b5 req-6d26f897-0292-4c58-a991-8098bc1a592d service nova] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:44.859853 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-b123ac95-5011-4192-b35b-df17076926b5 req-6d26f897-0292-4c58-a991-8098bc1a592d service nova] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:44.859981 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b123ac95-5011-4192-b35b-df17076926b5 req-6d26f897-0292-4c58-a991-8098bc1a592d service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] No waiting events found dispatching network-vif-unplugged-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:28:44.860096 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-b123ac95-5011-4192-b35b-df17076926b5 req-6d26f897-0292-4c58-a991-8098bc1a592d service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Received event network-vif-unplugged-1df13c9c-1dc4-4392-bba6-7f22998da688 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:28:44.899950 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:44.905054 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:44.923691 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:45.041736 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999712003999775 future=<Future at 0x726e3857a3c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:28:45.042219 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999227539999993 future=<Future at 0x726e3857a3c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:28:45.042347 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999099450999893 future=<Future at 0x726e3857a3c0 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:28:45.043800 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Instance destroyed successfully.
May 27 23:28:45.044269 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'resources' on Instance uuid 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:28:45.546980 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:27:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1451538514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumemultiattachtests-server-1451538514',id=81,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVQnlvngnzpx8nZmIeojUodUInaOiAo394MWlnUAbFDRXt7nIzdnZu30tlYxOW13akWbDAd8NbmEzp08LI3YRQ7nDPPUghaFadIXon2DMM+8RrQt26DZlzF60DfmUP/OA==',key_name='tempest-keypair-1042981963',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:27:51Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ec606fe4c964d358de1d627ce948d87',ramdisk_id='',reservation_id='r-2lx89185',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-892484312',owner_user_name='tempest-VolumeMultiattachTests-892484312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:27:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c175a7231a7b496eacfc7a46ad2a379d',uuid=0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1df13c9c-1dc4-4392-bba6-7f22998da688", "address": "fa:16:3e:5c:8a:d4", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df13c9c-1d", "ovs_interfaceid": "1df13c9c-1dc4-4392-bba6-7f22998da688", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:28:45.547653 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converting VIF {"id": "1df13c9c-1dc4-4392-bba6-7f22998da688", "address": "fa:16:3e:5c:8a:d4", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df13c9c-1d", "ovs_interfaceid": "1df13c9c-1dc4-4392-bba6-7f22998da688", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:28:45.548065 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=1df13c9c-1dc4-4392-bba6-7f22998da688,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df13c9c-1d') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:28:45.548431 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=1df13c9c-1dc4-4392-bba6-7f22998da688,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df13c9c-1d') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:28:45.550378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:45.550378 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1df13c9c-1d, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:28:45.551451 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:45.552146 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:28:45.552301 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:45.552927 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:45.553060 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4a42552-7894-4b8b-ab20-ddf649db4108) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:28:45.553483 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:45.553889 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:28:45.554017 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:45.555489 np0000001565 nova-compute[98289]: INFO os_vif [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:8a:d4,bridge_name='br-int',has_traffic_filtering=True,id=1df13c9c-1dc4-4392-bba6-7f22998da688,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df13c9c-1d')
May 27 23:28:45.555961 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Deleting instance files /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7_del
May 27 23:28:45.556754 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Deletion of /opt/stack/data/nova/instances/0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7_del complete
May 27 23:28:46.062609 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Took 1.33 seconds to destroy the instance on the hypervisor.
May 27 23:28:46.063854 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:28:46.064147 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:28:46.064309 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:28:46.064659 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:28:46.179823 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:28:46.606789 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-44617b0c-64e5-4648-9194-50645358cbd2 req-2d8f6eac-6219-45b8-8be2-b34ac244a65b service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Received event network-vif-deleted-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:28:46.607220 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-44617b0c-64e5-4648-9194-50645358cbd2 req-2d8f6eac-6219-45b8-8be2-b34ac244a65b service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Neutron deleted interface 1df13c9c-1dc4-4392-bba6-7f22998da688; detaching it from the instance and deleting it from the info cache
May 27 23:28:46.608521 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-44617b0c-64e5-4648-9194-50645358cbd2 req-2d8f6eac-6219-45b8-8be2-b34ac244a65b service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Detach interface failed, port_id=1df13c9c-1dc4-4392-bba6-7f22998da688, reason: Instance 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:28:46.907186 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5bc0366e-b793-4dff-864c-e85e150d2967 req-93d0105c-8455-4f8c-9550-0778a677b6e9 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Received event network-vif-unplugged-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:28:46.907639 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5bc0366e-b793-4dff-864c-e85e150d2967 req-93d0105c-8455-4f8c-9550-0778a677b6e9 service nova] Acquiring lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:46.907793 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5bc0366e-b793-4dff-864c-e85e150d2967 req-93d0105c-8455-4f8c-9550-0778a677b6e9 service nova] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:46.907908 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-5bc0366e-b793-4dff-864c-e85e150d2967 req-93d0105c-8455-4f8c-9550-0778a677b6e9 service nova] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:46.908033 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5bc0366e-b793-4dff-864c-e85e150d2967 req-93d0105c-8455-4f8c-9550-0778a677b6e9 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] No waiting events found dispatching network-vif-unplugged-1df13c9c-1dc4-4392-bba6-7f22998da688 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:28:46.908186 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-5bc0366e-b793-4dff-864c-e85e150d2967 req-93d0105c-8455-4f8c-9550-0778a677b6e9 service nova] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Received event network-vif-unplugged-1df13c9c-1dc4-4392-bba6-7f22998da688 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:28:47.063468 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:28:47.565214 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Took 1.50 seconds to deallocate network for instance.
May 27 23:28:48.070246 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:48.070703 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:48.141606 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Refreshing inventories for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 27 23:28:48.181437 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Updating ProviderTree inventory for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 27 23:28:48.181620 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Updating inventory in ProviderTree for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 23:28:48.217364 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Refreshing aggregate associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, aggregates: None {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 27 23:28:48.264509 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Refreshing trait associations for resource provider 6afc4609-00ff-4946-93f6-3f759c4c1e43, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_PPC64LE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_AARCH64,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_STATELESS_FIRMWARE {{(pid=98289) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 27 23:28:48.377000 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:28:48.377173 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:28:48.879828 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:28:49.387187 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.317s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:49.439024 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Deleted allocations for instance 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7
May 27 23:28:50.447201 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-1262d9f7-81dd-441d-a863-5898cc5298cb tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.225s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:50.554300 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:51.247247 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:51.247453 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:51.749628 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Detaching volume db227bf6-8e81-45a9-b1b0-de41ca4385a4
May 27 23:28:51.783974 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attempting to driver detach volume db227bf6-8e81-45a9-b1b0-de41ca4385a4 from mountpoint /dev/vdd
May 27 23:28:51.788217 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found disk vdd by alias ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:28:51.789516 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found disk vdd by alias ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:28:51.789629 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Attempting to detach device vdd from instance eee054e7-0060-4f21-8573-91b8e0564192 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:28:51.789841 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:28:51.789841 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:28:51.789841 np0000001565 nova-compute[98289]:   <alias name="ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4"/>
May 27 23:28:51.789841 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:28:51.789841 np0000001565 nova-compute[98289]:   <target dev="vdd" bus="virtio"/>
May 27 23:28:51.789841 np0000001565 nova-compute[98289]:   <serial>db227bf6-8e81-45a9-b1b0-de41ca4385a4</serial>
May 27 23:28:51.789841 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:28:51.789841 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 27 23:28:51.789841 np0000001565 nova-compute[98289]: </disk>
May 27 23:28:51.789841 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:28:51.795190 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully detached device vdd from instance eee054e7-0060-4f21-8573-91b8e0564192 from the persistent domain config.
May 27 23:28:51.795308 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] (1/8): Attempting to detach device vdd with device alias ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4 from instance eee054e7-0060-4f21-8573-91b8e0564192 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:28:51.795582 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:28:51.795582 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:28:51.795582 np0000001565 nova-compute[98289]:   <alias name="ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4"/>
May 27 23:28:51.795582 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-2"/>
May 27 23:28:51.795582 np0000001565 nova-compute[98289]:   <target dev="vdd" bus="virtio"/>
May 27 23:28:51.795582 np0000001565 nova-compute[98289]:   <serial>db227bf6-8e81-45a9-b1b0-de41ca4385a4</serial>
May 27 23:28:51.795582 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:28:51.795582 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 27 23:28:51.795582 np0000001565 nova-compute[98289]: </disk>
May 27 23:28:51.795582 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:28:52.275087 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779924532.274738, eee054e7-0060-4f21-8573-91b8e0564192 => ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:28:52.276157 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-db227bf6-8e81-45a9-b1b0-de41ca4385a4 for instance eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:28:52.278513 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully detached device vdd from instance eee054e7-0060-4f21-8573-91b8e0564192 from the live domain config.
May 27 23:28:52.305502 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:28:52.305756 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:28:52.305872 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:28:52.306166 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:28:52.306457 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db227bf6-8e81-45a9-b1b0-de41ca4385a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:28:52.306565 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:28:52.330520 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:52.330520 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:52.330520 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:52.330520 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:52.330520 np0000001565 nova-compute[98289]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:52.330520 np0000001565 nova-compute[98289]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:52.330520 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:28:52.330792 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:52.330792 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:52.330792 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:52.330792 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:52.330792 np0000001565 nova-compute[98289]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:52.330792 np0000001565 nova-compute[98289]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4 (non-flash)
May 27 23:28:52.330792 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:28:52.330792 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', '228'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', '230'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', '231'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', '232')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:28:52.331041 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', '231')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:28:52.331762 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4', '232')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:28:52.332457 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e605ef880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4'): ({'sdg'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:28:52.332778 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Removing multipathed devices sdf, sdg {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:28:52.333009 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Flush multipath device 3300000003c1c9852 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:28:52.371658 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:28:52.412922 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:28:52.464836 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:28:52.465038 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:28:52.466057 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:28:52.478500 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:28:52.478709 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:28:52.490315 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:52.521299 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 231, target: iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4, portal: 192.168.40.100,3260]
May 27 23:28:52.521299 np0000001565 nova-compute[98289]: Logout of [sid: 231, target: iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4, portal: 192.168.40.100,3260] successful.
May 27 23:28:52.521299 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:52.535946 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:52.546733 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:52.589225 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 232, target: iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4, portal: 192.168.50.100,3260]
May 27 23:28:52.589225 np0000001565 nova-compute[98289]: Logout of [sid: 232, target: iqn.2023-03.storpool.com:os--volume-db227bf6-8e81-45a9-b1b0-de41ca4385a4, portal: 192.168.50.100,3260] successful.
May 27 23:28:52.589225 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:52.602475 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:52.602681 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:28:52.602803 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== disconnect_volume: return (297ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:28:52.602928 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:28:53.144114 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:28:54.150126 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-0d9f7e9e-629a-4005-ae12-bc6ebc8fad9d tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.902s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:54.492147 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:54.492296 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:54.994428 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Detaching volume 8d09ee6f-2bd4-472d-8189-fe8c92088966
May 27 23:28:55.035742 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attempting to driver detach volume 8d09ee6f-2bd4-472d-8189-fe8c92088966 from mountpoint /dev/vdc
May 27 23:28:55.065634 np0000001565 nova-compute[98289]: DEBUG os_brick.encryptors [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'eee054e7-0060-4f21-8573-91b8e0564192', 'attached_at': '', 'detached_at': '', 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'serial': '8d09ee6f-2bd4-472d-8189-fe8c92088966'} {{(pid=98289) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 23:28:55.069560 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found disk vdc by alias ua-8d09ee6f-2bd4-472d-8189-fe8c92088966 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:28:55.070905 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found disk vdc by alias ua-8d09ee6f-2bd4-472d-8189-fe8c92088966 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:28:55.071058 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Attempting to detach device vdc from instance eee054e7-0060-4f21-8573-91b8e0564192 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:28:55.071396 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:28:55.071396 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:28:55.071396 np0000001565 nova-compute[98289]:   <alias name="ua-8d09ee6f-2bd4-472d-8189-fe8c92088966"/>
May 27 23:28:55.071396 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 27 23:28:55.071396 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:28:55.071396 np0000001565 nova-compute[98289]:   <serial>8d09ee6f-2bd4-472d-8189-fe8c92088966</serial>
May 27 23:28:55.071396 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 23:28:55.071396 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:28:55.071396 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="572d7df8-6347-4251-98d4-e38ef361c35e"/>
May 27 23:28:55.071396 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:28:55.071396 np0000001565 nova-compute[98289]: </disk>
May 27 23:28:55.071396 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:28:55.077208 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully detached device vdc from instance eee054e7-0060-4f21-8573-91b8e0564192 from the persistent domain config.
May 27 23:28:55.077426 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] (1/8): Attempting to detach device vdc with device alias ua-8d09ee6f-2bd4-472d-8189-fe8c92088966 from instance eee054e7-0060-4f21-8573-91b8e0564192 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:28:55.077760 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:28:55.077760 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:28:55.077760 np0000001565 nova-compute[98289]:   <alias name="ua-8d09ee6f-2bd4-472d-8189-fe8c92088966"/>
May 27 23:28:55.077760 np0000001565 nova-compute[98289]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 27 23:28:55.077760 np0000001565 nova-compute[98289]:   <target dev="vdc" bus="virtio"/>
May 27 23:28:55.077760 np0000001565 nova-compute[98289]:   <serial>8d09ee6f-2bd4-472d-8189-fe8c92088966</serial>
May 27 23:28:55.077760 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 23:28:55.077760 np0000001565 nova-compute[98289]:   <encryption format="luks">
May 27 23:28:55.077760 np0000001565 nova-compute[98289]:     <secret type="passphrase" uuid="572d7df8-6347-4251-98d4-e38ef361c35e"/>
May 27 23:28:55.077760 np0000001565 nova-compute[98289]:   </encryption>
May 27 23:28:55.077760 np0000001565 nova-compute[98289]: </disk>
May 27 23:28:55.077760 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:28:55.541176 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779924535.5408704, eee054e7-0060-4f21-8573-91b8e0564192 => ua-8d09ee6f-2bd4-472d-8189-fe8c92088966> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:28:55.542215 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-8d09ee6f-2bd4-472d-8189-fe8c92088966 for instance eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:28:55.544288 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully detached device vdc from instance eee054e7-0060-4f21-8573-91b8e0564192 from the live domain config.
May 27 23:28:55.546256 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:28:55.546547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:28:55.546671 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:28:55.546942 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:28:55.547208 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d09ee6f-2bd4-472d-8189-fe8c92088966', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:28:55.547356 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:28:55.554857 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:28:55.570662 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:55.570662 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:55.570662 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:55.570662 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:55.570662 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:28:55.570906 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:55.570906 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:55.570906 np0000001565 nova-compute[98289]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:55.570906 np0000001565 nova-compute[98289]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966 (non-flash)
May 27 23:28:55.570906 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:28:55.570906 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', '228'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', '230')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:28:55.571073 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', '229')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:28:55.571739 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966', '230')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:28:55.572397 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e58136f20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966'): ({'sde'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:28:55.572573 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Removing multipathed devices sdd, sde {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:28:55.572777 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Flush multipath device 330000000003ffa2b {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:28:55.607931 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:28:55.648683 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:28:55.692707 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:28:55.692894 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:28:55.693561 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:28:55.704678 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:28:55.704821 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:28:55.715618 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:55.749182 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 229, target: iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966, portal: 192.168.40.100,3260]
May 27 23:28:55.749182 np0000001565 nova-compute[98289]: Logout of [sid: 229, target: iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966, portal: 192.168.40.100,3260] successful.
May 27 23:28:55.749182 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:55.761548 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:55.770743 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:55.803323 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 230, target: iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966, portal: 192.168.50.100,3260]
May 27 23:28:55.803323 np0000001565 nova-compute[98289]: Logout of [sid: 230, target: iqn.2023-03.storpool.com:os--volume-8d09ee6f-2bd4-472d-8189-fe8c92088966, portal: 192.168.50.100,3260] successful.
May 27 23:28:55.803323 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:55.815725 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:55.816744 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:28:55.816857 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== disconnect_volume: return (270ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:28:55.816972 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:28:56.363554 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:28:57.369740 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-8063e11f-f393-4e52-bd0b-84aec977d74a tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.877s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:28:57.728706 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:28:57.728848 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:28:57.869387 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:28:58.230979 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Detaching volume b730cab8-3400-4d29-ab2a-c6341eca5ac6
May 27 23:28:58.265742 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Attempting to driver detach volume b730cab8-3400-4d29-ab2a-c6341eca5ac6 from mountpoint /dev/vdb
May 27 23:28:58.270575 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found disk vdb by alias ua-b730cab8-3400-4d29-ab2a-c6341eca5ac6 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:28:58.271639 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found disk vdb by alias ua-b730cab8-3400-4d29-ab2a-c6341eca5ac6 {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:28:58.271740 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Attempting to detach device vdb from instance eee054e7-0060-4f21-8573-91b8e0564192 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:28:58.271938 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:28:58.271938 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:28:58.271938 np0000001565 nova-compute[98289]:   <alias name="ua-b730cab8-3400-4d29-ab2a-c6341eca5ac6"/>
May 27 23:28:58.271938 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:28:58.271938 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:28:58.271938 np0000001565 nova-compute[98289]:   <serial>b730cab8-3400-4d29-ab2a-c6341eca5ac6</serial>
May 27 23:28:58.271938 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:28:58.271938 np0000001565 nova-compute[98289]: </disk>
May 27 23:28:58.271938 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:28:58.277269 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully detached device vdb from instance eee054e7-0060-4f21-8573-91b8e0564192 from the persistent domain config.
May 27 23:28:58.277405 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] (1/8): Attempting to detach device vdb with device alias ua-b730cab8-3400-4d29-ab2a-c6341eca5ac6 from instance eee054e7-0060-4f21-8573-91b8e0564192 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:28:58.277588 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:28:58.277588 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:28:58.277588 np0000001565 nova-compute[98289]:   <alias name="ua-b730cab8-3400-4d29-ab2a-c6341eca5ac6"/>
May 27 23:28:58.277588 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:28:58.277588 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:28:58.277588 np0000001565 nova-compute[98289]:   <serial>b730cab8-3400-4d29-ab2a-c6341eca5ac6</serial>
May 27 23:28:58.277588 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:28:58.277588 np0000001565 nova-compute[98289]: </disk>
May 27 23:28:58.277588 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:28:58.372495 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.25 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:28:58.694050 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779924538.6937044, eee054e7-0060-4f21-8573-91b8e0564192 => ua-b730cab8-3400-4d29-ab2a-c6341eca5ac6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:28:58.695263 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b730cab8-3400-4d29-ab2a-c6341eca5ac6 for instance eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:28:58.697505 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully detached device vdb from instance eee054e7-0060-4f21-8573-91b8e0564192 from the live domain config.
May 27 23:28:58.698376 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:28:58.698673 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:28:58.698798 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:28:58.699087 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:28:58.699324 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b730cab8-3400-4d29-ab2a-c6341eca5ac6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:28:58.699464 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:28:58.720483 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:58.720483 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:58.720483 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:28:58.720725 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:58.720725 np0000001565 nova-compute[98289]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6 (non-flash)
May 27 23:28:58.720725 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:28:58.720725 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', '228')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:28:58.720863 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', '227')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:28:58.721404 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6', '228')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:28:58.721957 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e3879e660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6'): ({'sdc'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:28:58.722125 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:28:58.722322 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Flush multipath device 3300000004ffbbd33 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:28:58.758633 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:28:58.802662 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:28:58.843521 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:28:58.843694 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:28:58.844238 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:28:58.854661 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:28:58.854801 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:28:58.868823 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:58.895235 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 227, target: iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6, portal: 192.168.40.100,3260]
May 27 23:28:58.895235 np0000001565 nova-compute[98289]: Logout of [sid: 227, target: iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6, portal: 192.168.40.100,3260] successful.
May 27 23:28:58.895235 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:58.907820 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:58.919224 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:58.952193 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6, portal: 192.168.50.100,3260]
May 27 23:28:58.952193 np0000001565 nova-compute[98289]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-b730cab8-3400-4d29-ab2a-c6341eca5ac6, portal: 192.168.50.100,3260] successful.
May 27 23:28:58.952193 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:58.964548 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:28:58.964764 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:28:58.964874 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== disconnect_volume: return (266ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:28:58.964981 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:28:59.514484 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:29:00.041791 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.00031961600006980007 future=<Future at 0x726e3857a3c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:29:00.042408 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] Emitting event <LifecycleEvent: 1779924525.0413437, 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:29:00.042641 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:29:00.042819 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] VM Stopped (Lifecycle Event)
May 27 23:29:00.519662 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-4bebf559-28d2-4b7e-a9f1-6306c93a1657 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.791s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:00.545026 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-8965d3b8-3f36-4cf1-aa7b-5209df9fea16 tempest-TestMinimumBasicScenario-365514479 tempest-TestMinimumBasicScenario-365514479-project-member] [instance: 0da6eeaa-d9c7-4c86-8ddc-9af39c269dc7] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:29:00.555991 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:04.266748 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:04.267023 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:04.267084 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:04.267192 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:04.267295 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:04.269606 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Terminating instance
May 27 23:29:04.627266 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:29:04.772023 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:29:04.784490 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:04.786477 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:04.797678 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:04.800583 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:04.816585 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:04.906304 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-503108bc-be39-46a7-8818-330f4b4ff378 req-422f8479-8b74-4ea1-a656-e21941805253 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Received event network-vif-unplugged-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:29:04.906495 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-503108bc-be39-46a7-8818-330f4b4ff378 req-422f8479-8b74-4ea1-a656-e21941805253 service nova] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:04.906836 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-503108bc-be39-46a7-8818-330f4b4ff378 req-422f8479-8b74-4ea1-a656-e21941805253 service nova] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:04.906970 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-503108bc-be39-46a7-8818-330f4b4ff378 req-422f8479-8b74-4ea1-a656-e21941805253 service nova] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:04.907112 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-503108bc-be39-46a7-8818-330f4b4ff378 req-422f8479-8b74-4ea1-a656-e21941805253 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] No waiting events found dispatching network-vif-unplugged-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:29:04.907289 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-503108bc-be39-46a7-8818-330f4b4ff378 req-422f8479-8b74-4ea1-a656-e21941805253 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Received event network-vif-unplugged-f1642905-d742-47f6-82ab-cea550ba4748 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:29:05.065115 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:05.070751 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:05.114921 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999738191999768 future=<Future at 0x726e3866e870 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:29:05.115644 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999019323000084 future=<Future at 0x726e3866e870 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:29:05.115825 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99880481199989 future=<Future at 0x726e3866e870 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:29:05.116242 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Instance destroyed successfully.
May 27 23:29:05.116819 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'resources' on Instance uuid eee054e7-0060-4f21-8573-91b8e0564192 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:29:05.131490 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:05.131671 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:05.131854 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:05.132035 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:29:05.568004 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:05.618911 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1254711628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumemultiattachtests-server-1254711628',id=80,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVQnlvngnzpx8nZmIeojUodUInaOiAo394MWlnUAbFDRXt7nIzdnZu30tlYxOW13akWbDAd8NbmEzp08LI3YRQ7nDPPUghaFadIXon2DMM+8RrQt26DZlzF60DfmUP/OA==',key_name='tempest-keypair-1042981963',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:26:27Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ec606fe4c964d358de1d627ce948d87',ramdisk_id='',reservation_id='r-xwn3awo3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-892484312',owner_user_name='tempest-VolumeMultiattachTests-892484312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c175a7231a7b496eacfc7a46ad2a379d',uuid=eee054e7-0060-4f21-8573-91b8e0564192,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:29:05.619153 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converting VIF {"id": "f1642905-d742-47f6-82ab-cea550ba4748", "address": "fa:16:3e:39:fc:03", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1642905-d7", "ovs_interfaceid": "f1642905-d742-47f6-82ab-cea550ba4748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:29:05.619688 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=f1642905-d742-47f6-82ab-cea550ba4748,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1642905-d7') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:29:05.619918 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=f1642905-d742-47f6-82ab-cea550ba4748,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1642905-d7') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:29:05.620903 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:05.621146 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1642905-d7, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:29:05.622566 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:05.622872 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:29:05.623276 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:05.623913 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:05.624043 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21811e29-3ef3-4af9-a679-094278c36389) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:29:05.624550 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:05.625091 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:29:05.625156 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:05.626713 np0000001565 nova-compute[98289]: INFO os_vif [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:fc:03,bridge_name='br-int',has_traffic_filtering=True,id=f1642905-d742-47f6-82ab-cea550ba4748,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1642905-d7')
May 27 23:29:05.626953 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Deleting instance files /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192_del
May 27 23:29:05.627696 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Deletion of /opt/stack/data/nova/instances/eee054e7-0060-4f21-8573-91b8e0564192_del complete
May 27 23:29:06.133010 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 23:29:06.133552 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:29:06.133842 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:29:06.133909 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: eee054e7-0060-4f21-8573-91b8e0564192] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:29:06.134129 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:29:06.146001 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Error from libvirt while getting description of instance-00000050: [Error Code 42] Domain not found: no domain with matching uuid 'eee054e7-0060-4f21-8573-91b8e0564192' (instance-00000050): libvirt.libvirtError: Domain not found: no domain with matching uuid 'eee054e7-0060-4f21-8573-91b8e0564192' (instance-00000050)
May 27 23:29:06.147507 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:29:06.148186 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:29:06.197874 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:29:06.198206 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=14050MB free_disk=72.57318496704102GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:29:06.198348 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:06.198587 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:06.244320 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:29:06.462510 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-060db433-c250-4f74-be89-00a70bd5f8fc req-e0eac029-74b8-448b-adb4-81f8b4860749 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Received event network-vif-deleted-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:29:06.462811 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-060db433-c250-4f74-be89-00a70bd5f8fc req-e0eac029-74b8-448b-adb4-81f8b4860749 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Neutron deleted interface f1642905-d742-47f6-82ab-cea550ba4748; detaching it from the instance and deleting it from the info cache
May 27 23:29:06.464036 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-060db433-c250-4f74-be89-00a70bd5f8fc req-e0eac029-74b8-448b-adb4-81f8b4860749 service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Detach interface failed, port_id=f1642905-d742-47f6-82ab-cea550ba4748, reason: Instance eee054e7-0060-4f21-8573-91b8e0564192 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:29:06.920863 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:29:06.959785 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ca6c13c0-638f-4f0c-92ec-94e228623695 req-14bf2347-ec22-4b06-bd07-d277ae51aa9e service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Received event network-vif-unplugged-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:29:06.960221 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ca6c13c0-638f-4f0c-92ec-94e228623695 req-14bf2347-ec22-4b06-bd07-d277ae51aa9e service nova] Acquiring lock "eee054e7-0060-4f21-8573-91b8e0564192-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:06.960385 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ca6c13c0-638f-4f0c-92ec-94e228623695 req-14bf2347-ec22-4b06-bd07-d277ae51aa9e service nova] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:06.960560 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-ca6c13c0-638f-4f0c-92ec-94e228623695 req-14bf2347-ec22-4b06-bd07-d277ae51aa9e service nova] Lock "eee054e7-0060-4f21-8573-91b8e0564192-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:06.960707 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ca6c13c0-638f-4f0c-92ec-94e228623695 req-14bf2347-ec22-4b06-bd07-d277ae51aa9e service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] No waiting events found dispatching network-vif-unplugged-f1642905-d742-47f6-82ab-cea550ba4748 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:29:06.960828 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-ca6c13c0-638f-4f0c-92ec-94e228623695 req-14bf2347-ec22-4b06-bd07-d277ae51aa9e service nova] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Received event network-vif-unplugged-f1642905-d742-47f6-82ab-cea550ba4748 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:29:07.250396 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance eee054e7-0060-4f21-8573-91b8e0564192 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:29:07.250582 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:29:07.250636 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:29:06 up 57 min,  2 users,  load average: 0.77, 1.64, 2.82\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_deleting': '1', 'num_os_type_None': '1', 'num_proj_1ec606fe4c964d358de1d627ce948d87': '1', 'io_workload': '0'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:29:07.327977 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:29:07.328164 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:29:07.422840 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Took 1.29 seconds to deallocate network for instance.
May 27 23:29:07.830876 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:29:07.929014 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:08.337757 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:29:08.337980 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.139s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:08.338107 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.409s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:08.338385 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:29:08.421674 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:29:08.421881 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:29:08.924580 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:29:09.433545 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.095s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:09.478936 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Deleted allocations for instance eee054e7-0060-4f21-8573-91b8e0564192
May 27 23:29:10.488305 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-d1ac38bf-c416-445b-8b25-337716ad0089 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "eee054e7-0060-4f21-8573-91b8e0564192" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.221s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:10.624820 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:10.835120 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:29:10.835375 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:29:10.835635 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.40 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:29:11.231785 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:29:11.735028 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.89 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:29:12.620550 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:29:12.620834 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:29:12.621124 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:29:13.123900 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:29:13.124319 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:29:13.982531 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:13.982747 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:14.484514 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Starting instance... {{(pid=98289) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 23:29:15.027692 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:15.027863 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:15.030570 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98289) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 23:29:15.030719 np0000001565 nova-compute[98289]: INFO nova.compute.claims [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Claim successful on node np0000001565
May 27 23:29:15.625717 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:16.112791 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:29:16.113025 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:29:16.615318 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:29:17.121234 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.093s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:17.121746 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Start building networks asynchronously for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 23:29:17.631763 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Allocating IP information in the background. {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 23:29:17.632181 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] allocate_for_instance() {{(pid=98289) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 23:29:17.632538 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:29:17.632779 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:29:17.693868 np0000001565 nova-compute[98289]: DEBUG nova.policy [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c175a7231a7b496eacfc7a46ad2a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec606fe4c964d358de1d627ce948d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98289) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 23:29:18.112678 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Successfully created port: 45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 23:29:18.123715 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:29:18.124137 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:29:18.124137 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:29:18.134820 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 23:29:18.534740 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Successfully updated port: 45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 23:29:18.578021 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9ba61f3c-ab2b-459e-a336-0111e0d5779e req-bd221b7b-b38b-472e-afc6-f839878a690e service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Received event network-changed-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:29:18.578180 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-9ba61f3c-ab2b-459e-a336-0111e0d5779e req-bd221b7b-b38b-472e-afc6-f839878a690e service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Refreshing instance network info cache due to event network-changed-45e84c0e-bf81-4a87-b7a9-79fe55d96157. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:29:18.578341 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba61f3c-ab2b-459e-a336-0111e0d5779e req-bd221b7b-b38b-472e-afc6-f839878a690e service nova] Acquiring lock "refresh_cache-661ec4bb-0ed4-4910-b19a-db5072e49db0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:29:18.578440 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba61f3c-ab2b-459e-a336-0111e0d5779e req-bd221b7b-b38b-472e-afc6-f839878a690e service nova] Acquired lock "refresh_cache-661ec4bb-0ed4-4910-b19a-db5072e49db0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:29:18.578564 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-9ba61f3c-ab2b-459e-a336-0111e0d5779e req-bd221b7b-b38b-472e-afc6-f839878a690e service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Refreshing network info cache for port 45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:29:18.637985 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Start building block device mappings for instance. {{(pid=98289) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 23:29:19.036473 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "refresh_cache-661ec4bb-0ed4-4910-b19a-db5072e49db0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:29:19.080085 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-9ba61f3c-ab2b-459e-a336-0111e0d5779e req-bd221b7b-b38b-472e-afc6-f839878a690e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:29:19.132295 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-9ba61f3c-ab2b-459e-a336-0111e0d5779e req-bd221b7b-b38b-472e-afc6-f839878a690e service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:29:19.264824 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-9ba61f3c-ab2b-459e-a336-0111e0d5779e req-bd221b7b-b38b-472e-afc6-f839878a690e service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:29:19.644993 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Start spawning the instance on the hypervisor. {{(pid=98289) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 23:29:19.645953 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Creating instance directory {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 23:29:19.646198 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Creating image(s)
May 27 23:29:19.646691 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "/opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:19.646843 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "/opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:19.647338 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "/opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:19.647847 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:29:19.650125 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:29:19.651145 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:29:19.741862 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.090s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:29:19.742389 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:19.742901 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:19.743366 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:29:19.745824 np0000001565 nova-compute[98289]: DEBUG oslo_utils.imageutils.format_inspector [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98289) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 23:29:19.746121 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:29:19.768820 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-9ba61f3c-ab2b-459e-a336-0111e0d5779e req-bd221b7b-b38b-472e-afc6-f839878a690e service nova] Releasing lock "refresh_cache-661ec4bb-0ed4-4910-b19a-db5072e49db0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:29:19.770058 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquired lock "refresh_cache-661ec4bb-0ed4-4910-b19a-db5072e49db0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:29:19.770563 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Building network info cache for instance {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 23:29:19.833915 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:29:19.834483 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk 1073741824 {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:29:19.888183 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d,backing_fmt=raw /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk 1073741824" returned: 0 in 0.053s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:29:19.888755 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "e252c2fe5fef54d1555f4ed0804e8ee07586c38d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:19.889122 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:29:19.977322 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e252c2fe5fef54d1555f4ed0804e8ee07586c38d --force-share --output=json" returned: 0 in 0.088s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:29:19.977737 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk. size=1073741824 {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 23:29:19.978002 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:29:20.064298 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:29:20.064750 np0000001565 nova-compute[98289]: DEBUG nova.virt.disk.api [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Cannot resize image /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk to a smaller size. {{(pid=98289) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 23:29:20.065159 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Created local disks {{(pid=98289) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 23:29:20.065419 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Ensure instance console log exists: /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/console.log {{(pid=98289) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 23:29:20.065756 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:20.066044 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:20.066195 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:20.115141 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0004497250001804787 future=<Future at 0x726e3866e870 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:29:20.115642 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] Emitting event <LifecycleEvent: 1779924545.1145723, eee054e7-0060-4f21-8573-91b8e0564192 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:29:20.115816 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:29:20.115968 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] VM Stopped (Lifecycle Event)
May 27 23:29:20.329699 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Instance cache missing network info. {{(pid=98289) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 23:29:20.463400 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:29:20.583792 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Updating instance_info_cache with network_info: [{"id": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "address": "fa:16:3e:fc:6b:99", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e84c0e-bf", "ovs_interfaceid": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:29:20.619035 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ab8d155-b640-46ff-9dca-65d9cd3e17e7 tempest-ImageDependencyTests-932348261 tempest-ImageDependencyTests-932348261-project-member] [instance: eee054e7-0060-4f21-8573-91b8e0564192] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:29:20.627158 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:21.085942 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Releasing lock "refresh_cache-661ec4bb-0ed4-4910-b19a-db5072e49db0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:29:21.086276 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Instance network_info: |[{"id": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "address": "fa:16:3e:fc:6b:99", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e84c0e-bf", "ovs_interfaceid": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98289) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 23:29:21.087861 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Start _get_guest_xml network_info=[{"id": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "address": "fa:16:3e:fc:6b:99", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e84c0e-bf", "ovs_interfaceid": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '6300a9f9-2b54-4283-b976-5a0c9409f522'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 23:29:21.090196 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:29:21.091529 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='6300a9f9-2b54-4283-b976-5a0c9409f522', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-2129222963', uuid='661ec4bb-0ed4-4910-b19a-db5072e49db0'), owner=OwnerMeta(userid='c175a7231a7b496eacfc7a46ad2a379d', username='tempest-VolumeMultiattachTests-892484312-project-member', projectid='1ec606fe4c964d358de1d627ce948d87', projectname='tempest-VolumeMultiattachTests-892484312'), image=ImageMeta(id='6300a9f9-2b54-4283-b976-5a0c9409f522', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "address": "fa:16:3e:fc:6b:99", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e84c0e-bf", "ovs_interfaceid": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779924561.0911276) {{(pid=98289) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 23:29:21.092520 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V1... {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 23:29:21.092805 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CPU controller missing on host. {{(pid=98289) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 23:29:21.093579 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching host: 'np0000001565' for CPU controller through CGroups V2... {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 23:29:21.093749 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.host [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CPU controller found on host. {{(pid=98289) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 23:29:21.094612 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98289) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 23:29:21.094916 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T22:58:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=6300a9f9-2b54-4283-b976-5a0c9409f522,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='88ec7bd845e849dc889a362ec929a548',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T22:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 23:29:21.095059 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Flavor limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 23:29:21.095197 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Image limits 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 23:29:21.095377 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Flavor pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 23:29:21.095520 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Image pref 0:0:0 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 23:29:21.095653 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 23:29:21.095852 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 23:29:21.095983 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 23:29:21.096137 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Got 1 possible topologies {{(pid=98289) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 23:29:21.096274 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 23:29:21.096448 np0000001565 nova-compute[98289]: DEBUG nova.virt.hardware [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98289) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 23:29:21.106206 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2129222963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumemultiattachtests-server-2129222963',id=82,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDX5c1wetviFQ7GdbvnBgyoq7wzGIc+4c5KlBcZ/sKw0az21Sr4lyT8Re7IYlJp2Q0LX/zqXsXeYKn8nJ/vHHLXUPVJfOgOQh8MSUe4T99oJdAl8pwPbEvZELNIgWmAhw==',key_name='tempest-keypair-1413516494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec606fe4c964d358de1d627ce948d87',ramdisk_id='',reservation_id='r-xcu4cjum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-892484312',owner_user_name='tempest-VolumeMultiattachTests-892484312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:29:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c175a7231a7b496eacfc7a46ad2a379d',uuid=661ec4bb-0ed4-4910-b19a-db5072e49db0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "address": "fa:16:3e:fc:6b:99", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e84c0e-bf", "ovs_interfaceid": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98289) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 23:29:21.106418 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converting VIF {"id": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "address": "fa:16:3e:fc:6b:99", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e84c0e-bf", "ovs_interfaceid": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:29:21.106996 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6b:99,bridge_name='br-int',has_traffic_filtering=True,id=45e84c0e-bf81-4a87-b7a9-79fe55d96157,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e84c0e-bf') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:29:21.107550 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'pci_devices' on Instance uuid 661ec4bb-0ed4-4910-b19a-db5072e49db0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:29:21.124368 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:29:21.124910 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:29:21.610550 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] End _get_guest_xml xml=<domain type="qemu">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <uuid>661ec4bb-0ed4-4910-b19a-db5072e49db0</uuid>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <name>instance-00000052</name>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <memory>196608</memory>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <vcpu>1</vcpu>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <metadata>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <nova:package version="33.1.0"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <nova:name>tempest-VolumeMultiattachTests-server-2129222963</nova:name>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <nova:creationTime>2026-05-27 23:29:21</nova:creationTime>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <nova:flavor name="m1.nano" id="42">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:memory>192</nova:memory>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:disk>1</nova:disk>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:swap>0</nova:swap>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:ephemeral>0</nova:ephemeral>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:vcpus>1</nova:vcpus>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:extraSpecs>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         </nova:extraSpecs>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       </nova:flavor>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <nova:image uuid="6300a9f9-2b54-4283-b976-5a0c9409f522">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:minDisk>1</nova:minDisk>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:minRam>0</nova:minRam>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:properties>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         </nova:properties>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       </nova:image>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <nova:owner>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:user uuid="c175a7231a7b496eacfc7a46ad2a379d">tempest-VolumeMultiattachTests-892484312-project-member</nova:user>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:project uuid="1ec606fe4c964d358de1d627ce948d87">tempest-VolumeMultiattachTests-892484312</nova:project>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       </nova:owner>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <nova:root type="image" uuid="6300a9f9-2b54-4283-b976-5a0c9409f522"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <nova:ports>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         <nova:port uuid="45e84c0e-bf81-4a87-b7a9-79fe55d96157">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:         </nova:port>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       </nova:ports>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     </nova:instance>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   </metadata>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <sysinfo type="smbios">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <system>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <entry name="product">OpenStack Nova</entry>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <entry name="version">33.1.0</entry>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <entry name="serial">661ec4bb-0ed4-4910-b19a-db5072e49db0</entry>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <entry name="uuid">661ec4bb-0ed4-4910-b19a-db5072e49db0</entry>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <entry name="family">Virtual Machine</entry>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     </system>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   </sysinfo>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <os>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <boot dev="hd"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <smbios mode="sysinfo"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   </os>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <features>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <acpi/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <tcg>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <tb-cache unit="MiB">128</tb-cache>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     </tcg>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <vmcoreinfo/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   </features>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <iothreads>1</iothreads>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <clock offset="utc"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <cpu mode="custom" match="exact">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <model>Nehalem</model>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <topology sockets="1" cores="1" threads="1"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   </cpu>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   <devices>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <disk type="file" device="disk">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <target dev="vda" bus="virtio"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     </disk>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <disk type="file" device="cdrom">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <driver name="qemu" type="raw" cache="none"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <source file="/opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk.config"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <target dev="hda" bus="ide"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     </disk>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <interface type="ethernet">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <mac address="fa:16:3e:fc:6b:99"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <driver name="qemu"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <mtu size="1372"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <target dev="tap45e84c0e-bf"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     </interface>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <serial type="pty">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <log file="/opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/console.log" append="off"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     </serial>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <video>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <model type="virtio"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     </video>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <rng model="virtio">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <backend model="random">/dev/urandom</backend>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     </rng>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <controller type="usb" index="0" model="none"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:       <stats period="10"/>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:     </memballoon>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:   </devices>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]: </domain>
May 27 23:29:21.610550 np0000001565 nova-compute[98289]:  {{(pid=98289) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 23:29:21.612678 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Preparing to wait for external event network-vif-plugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 23:29:21.612678 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:21.612678 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:21.612678 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:21.612678 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T23:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2129222963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumemultiattachtests-server-2129222963',id=82,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDX5c1wetviFQ7GdbvnBgyoq7wzGIc+4c5KlBcZ/sKw0az21Sr4lyT8Re7IYlJp2Q0LX/zqXsXeYKn8nJ/vHHLXUPVJfOgOQh8MSUe4T99oJdAl8pwPbEvZELNIgWmAhw==',key_name='tempest-keypair-1413516494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec606fe4c964d358de1d627ce948d87',ramdisk_id='',reservation_id='r-xcu4cjum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-892484312',owner_user_name='tempest-VolumeMultiattachTests-892484312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T23:29:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c175a7231a7b496eacfc7a46ad2a379d',uuid=661ec4bb-0ed4-4910-b19a-db5072e49db0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "address": "fa:16:3e:fc:6b:99", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e84c0e-bf", "ovs_interfaceid": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 23:29:21.612678 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converting VIF {"id": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "address": "fa:16:3e:fc:6b:99", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e84c0e-bf", "ovs_interfaceid": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:29:21.612678 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6b:99,bridge_name='br-int',has_traffic_filtering=True,id=45e84c0e-bf81-4a87-b7a9-79fe55d96157,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e84c0e-bf') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:29:21.612943 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6b:99,bridge_name='br-int',has_traffic_filtering=True,id=45e84c0e-bf81-4a87-b7a9-79fe55d96157,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e84c0e-bf') {{(pid=98289) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 23:29:21.613553 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:21.613553 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:29:21.613645 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 23:29:21.614099 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:21.614239 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56e5d9c2-ef3b-58c5-9e83-ee2260e4ac07', '_type': 'linux-noop'}}, row=False) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:29:21.615010 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:21.615728 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:29:21.615932 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:21.617814 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:21.617941 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45e84c0e-bf, may_exist=True, interface_attrs={}) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:29:21.618225 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45e84c0e-bf, col_values=(('qos', UUID('d91b3dab-fa28-467e-8485-495108cb7708')),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:29:21.618404 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45e84c0e-bf, col_values=(('external_ids', {'iface-id': '45e84c0e-bf81-4a87-b7a9-79fe55d96157', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:6b:99', 'vm-uuid': '661ec4bb-0ed4-4910-b19a-db5072e49db0'}),), if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:29:21.619067 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:21.620077 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:29:21.623676 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:21.624386 np0000001565 nova-compute[98289]: INFO os_vif [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6b:99,bridge_name='br-int',has_traffic_filtering=True,id=45e84c0e-bf81-4a87-b7a9-79fe55d96157,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e84c0e-bf')
May 27 23:29:23.141974 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:29:23.142504 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:29:23.142504 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No VIF found with MAC fa:16:3e:fc:6b:99, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:29:23.142672 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Using config drive
May 27 23:29:23.648986 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:29:23.758571 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Creating config drive at /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk.config
May 27 23:29:23.762137 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcvw8_0wa {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:29:23.816543 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcvw8_0wa" returned: 0 in 0.054s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:29:24.203036 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:24.216308 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:24.221030 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:24.314356 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:24.315973 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:24.363557 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-62d290b6-c0af-4e83-bca4-968eeec8df86 req-74df4cac-9ceb-46f4-b2e4-d27193d885ec service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Received event network-vif-plugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:29:24.363837 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-62d290b6-c0af-4e83-bca4-968eeec8df86 req-74df4cac-9ceb-46f4-b2e4-d27193d885ec service nova] Acquiring lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:24.364062 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-62d290b6-c0af-4e83-bca4-968eeec8df86 req-74df4cac-9ceb-46f4-b2e4-d27193d885ec service nova] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:24.364210 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-62d290b6-c0af-4e83-bca4-968eeec8df86 req-74df4cac-9ceb-46f4-b2e4-d27193d885ec service nova] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:24.364679 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-62d290b6-c0af-4e83-bca4-968eeec8df86 req-74df4cac-9ceb-46f4-b2e4-d27193d885ec service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Processing event network-vif-plugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 23:29:24.518182 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:24.522515 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:24.534876 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:24.735736 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:24.881167 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924564.8807807, 661ec4bb-0ed4-4910-b19a-db5072e49db0 => Started> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:29:24.881563 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98289) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 23:29:24.881701 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] VM Started (Lifecycle Event)
May 27 23:29:24.884003 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Guest created on hypervisor {{(pid=98289) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 23:29:24.886063 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Instance spawned successfully.
May 27 23:29:24.886430 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 23:29:25.384508 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:29:25.386975 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:29:25.397389 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Found default for hw_cdrom_bus of ide {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:29:25.397521 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Found default for hw_disk_bus of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:29:25.397841 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Found default for hw_input_bus of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:29:25.398066 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Found default for hw_pointer_model of None {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:29:25.398308 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Found default for hw_video_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:29:25.398588 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Found default for hw_vif_model of virtio {{(pid=98289) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 23:29:25.889097 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 23:29:25.889324 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924565.8891404, 661ec4bb-0ed4-4910-b19a-db5072e49db0 => Paused> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:29:25.889454 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] VM Paused (Lifecycle Event)
May 27 23:29:25.905745 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Took 6.26 seconds to spawn the instance on the hypervisor.
May 27 23:29:25.905930 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:29:26.392070 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:29:26.394757 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Emitting event <LifecycleEvent: 1779924566.3945134, 661ec4bb-0ed4-4910-b19a-db5072e49db0 => Resumed> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:29:26.394879 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] VM Resumed (Lifecycle Event)
May 27 23:29:26.415941 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Took 11.43 seconds to build instance.
May 27 23:29:26.433989 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-68b2571e-b4fa-4f23-a806-ddf88616ff24 req-02c3fce2-659e-41f1-9712-4aec0c4340d2 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Received event network-vif-plugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:29:26.434421 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-68b2571e-b4fa-4f23-a806-ddf88616ff24 req-02c3fce2-659e-41f1-9712-4aec0c4340d2 service nova] Acquiring lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:29:26.434787 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-68b2571e-b4fa-4f23-a806-ddf88616ff24 req-02c3fce2-659e-41f1-9712-4aec0c4340d2 service nova] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:29:26.435070 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-68b2571e-b4fa-4f23-a806-ddf88616ff24 req-02c3fce2-659e-41f1-9712-4aec0c4340d2 service nova] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:26.435934 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-68b2571e-b4fa-4f23-a806-ddf88616ff24 req-02c3fce2-659e-41f1-9712-4aec0c4340d2 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] No waiting events found dispatching network-vif-plugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:29:26.435934 np0000001565 nova-compute[98289]: WARNING nova.compute.manager [req-68b2571e-b4fa-4f23-a806-ddf88616ff24 req-02c3fce2-659e-41f1-9712-4aec0c4340d2 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Received unexpected event network-vif-plugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 for instance with vm_state active and task_state None.
May 27 23:29:26.619640 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:26.797084 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f5768bac-c461-4a3b-ac72-84ab343b0bd1 req-4e86bfaa-99ae-497d-96cf-2fe42abd1224 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Received event network-changed-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:29:26.797615 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-f5768bac-c461-4a3b-ac72-84ab343b0bd1 req-4e86bfaa-99ae-497d-96cf-2fe42abd1224 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Refreshing instance network info cache due to event network-changed-45e84c0e-bf81-4a87-b7a9-79fe55d96157. {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 27 23:29:26.797774 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f5768bac-c461-4a3b-ac72-84ab343b0bd1 req-4e86bfaa-99ae-497d-96cf-2fe42abd1224 service nova] Acquiring lock "refresh_cache-661ec4bb-0ed4-4910-b19a-db5072e49db0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 23:29:26.797873 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f5768bac-c461-4a3b-ac72-84ab343b0bd1 req-4e86bfaa-99ae-497d-96cf-2fe42abd1224 service nova] Acquired lock "refresh_cache-661ec4bb-0ed4-4910-b19a-db5072e49db0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 23:29:26.797981 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f5768bac-c461-4a3b-ac72-84ab343b0bd1 req-4e86bfaa-99ae-497d-96cf-2fe42abd1224 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Refreshing network info cache for port 45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 23:29:26.897754 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:29:26.899289 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98289) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 23:29:26.917996 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.935s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:29:27.300497 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f5768bac-c461-4a3b-ac72-84ab343b0bd1 req-4e86bfaa-99ae-497d-96cf-2fe42abd1224 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:29:27.589271 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [req-f5768bac-c461-4a3b-ac72-84ab343b0bd1 req-4e86bfaa-99ae-497d-96cf-2fe42abd1224 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:29:27.701769 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f5768bac-c461-4a3b-ac72-84ab343b0bd1 req-4e86bfaa-99ae-497d-96cf-2fe42abd1224 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Updated VIF entry in instance network info cache for port 45e84c0e-bf81-4a87-b7a9-79fe55d96157. {{(pid=98289) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 23:29:27.702030 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [req-f5768bac-c461-4a3b-ac72-84ab343b0bd1 req-4e86bfaa-99ae-497d-96cf-2fe42abd1224 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Updating instance_info_cache with network_info: [{"id": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "address": "fa:16:3e:fc:6b:99", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e84c0e-bf", "ovs_interfaceid": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:29:28.203917 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-f5768bac-c461-4a3b-ac72-84ab343b0bd1 req-4e86bfaa-99ae-497d-96cf-2fe42abd1224 service nova] Releasing lock "refresh_cache-661ec4bb-0ed4-4910-b19a-db5072e49db0" {{(pid=98289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 23:29:29.736623 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:31.621988 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:34.738582 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:36.623447 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:39.739000 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:41.625015 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:44.740209 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:46.627142 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:49.742169 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:51.629506 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:54.743285 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:56.631059 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:29:59.744439 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:01.632067 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:04.342548 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:30:04.344013 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:30:04.745846 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:04.845966 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid 661ec4bb-0ed4-4910-b19a-db5072e49db0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:30:05.123966 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:30:05.628686 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:30:05.629077 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:30:05.629077 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:30:05.629276 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:30:05.850803 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:30:06.634089 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:06.647822 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:30:06.736675 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:30:06.737101 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk --force-share --output=json {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:30:06.823616 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:30:06.827343 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:30:06.828472 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:30:06.881214 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:30:06.881701 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=13689MB free_disk=72.57028198242188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:30:06.881877 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:30:06.882144 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:30:06.911053 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:30:06.911828 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:30:06.911828 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Attaching volume 0388a8d0-4cad-480f-bd62-b3612e80196d to /dev/vdb
May 27 23:30:06.948708 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.11', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001565', 'execute': None}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:30:06.958449 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.scaleio [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98289) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 23:30:06.975774 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Running cmd (subprocess): nvme version {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:30:07.018747 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] 'nvme version' failed. Not Retrying. {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 23:30:07.019022 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] nvme not present on system {{(pid=98289) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 23:30:07.026831 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98289) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 23:30:07.027764 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.lightos [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Current host hostNQN  and IP(s) are ['10.4.3.11', 'fe80::f816:3eff:fed8:a508', '192.168.40.6', 'fe80::f816:3eff:fea5:dd63', '192.168.50.6', 'fe80::f816:3eff:fecb:65dd', '192.168.10.6', 'fe80::f816:3eff:fe04:54c', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::dc20:96ff:fe3a:9f43', 'fe80::fc16:3eff:fefc:6b99', 'fe80::464:47ff:fea6:3c4d'] 
May 27 23:30:07.027877 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 23:30:07.028006 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.lightos [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] LIGHTOS: no hostnqn found. {{(pid=98289) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 23:30:07.028223 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.11', 'host': 'np0000001565', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:bc7493dfa969', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'cd4be76f-9bad-49c5-829d-97d4598e8023', 'nvme_native_multipath': False} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:30:07.028466 np0000001565 nova-compute[98289]: DEBUG nova.virt.block_device [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Updating existing volume attachment record: 94e3c618-901f-47f4-952a-7131be09293d {{(pid=98289) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 23:30:07.572346 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Calling os-brick to attach iSCSI Volume {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 23:30:07.572738 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0388a8d0-4cad-480f-bd62-b3612e80196d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:30:07.572884 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:30:07.573285 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:30:07.573492 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0388a8d0-4cad-480f-bd62-b3612e80196d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 23:30:07.584666 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:30:07.585341 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:30:07.585804 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:30:07.585972 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:30:07.586342 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:30:07.586557 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:30:07.598190 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:30:07.598190 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:07.598842 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 23:30:07.598842 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:07.610308 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d] added
May 27 23:30:07.610308 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:30:07.610308 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:30:07.610308 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:30:07.610308 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:30:07.610308 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:30:07.610308 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:07.611176 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:30:07.611176 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:30:07.611176 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:30:07.611514 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d] added
May 27 23:30:07.611514 np0000001565 nova-compute[98289]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 23:30:07.611514 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:30:07.611514 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:30:07.611514 np0000001565 nova-compute[98289]: iscsiadm: Config file line 363 does not have value
May 27 23:30:07.611514 np0000001565 nova-compute[98289]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 23:30:07.611514 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:07.611750 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98289) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 23:30:07.611946 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 23:30:07.612098 np0000001565 nova-compute[98289]: DEBUG os_brick.utils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98289) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 23:30:07.952035 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Instance 661ec4bb-0ed4-4910-b19a-db5072e49db0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98289) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 23:30:07.952475 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:30:07.952545 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:30:06 up 58 min,  2 users,  load average: 1.23, 1.64, 2.75\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_1ec606fe4c964d358de1d627ce948d87': '1', 'io_workload': '0'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:30:08.047143 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:30:08.047424 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:30:08.550227 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:30:08.611606 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 23:30:08.612604 np0000001565 nova-compute[98289]: INFO os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.50.100
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:30:08.623729 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:30:08.623729 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.name = iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.tpgt = -1
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.startup = manual
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.leading_login = No
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.iscsi_ifacename = default
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.net_ifacename = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.ipaddress = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.prefix_len = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.hwaddress = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.transport_name = tcp
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.initiatorname = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.state = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.vlan_id = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.vlan_priority = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.vlan_state = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.iface_num = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.mtu = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.port = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.bootproto = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.subnet_mask = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.gateway = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id_state = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.dhcp_alt_client_id = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.dhcp_dns = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.dhcp_learn_iqn = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.dhcp_req_vendor_id_state = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id_state = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.dhcp_vendor_id = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.dhcp_slp_da = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.fragmentation = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.gratuitous_arp = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.incoming_forwarding = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.tos_state = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.tos = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.ttl = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.delayed_ack = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.tcp_nagle = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.tcp_wsf_state = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.tcp_wsf = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.tcp_timer_scale = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.tcp_timestamp = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.redirect = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.def_task_mgmt_timeout = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.header_digest = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.data_digest = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.immediate_data = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.initial_r2t = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.data_seq_inorder = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.data_pdu_inorder = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.erl = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.max_receive_data_len = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.first_burst_len = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.max_outstanding_r2t = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.max_burst_len = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.chap_auth = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.bidi_chap = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.strict_login_compliance = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.discovery_auth = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: iface.discovery_logout = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.discovery_address = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.discovery_port = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.discovery_type = fw
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.initial_cmdsn = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.initial_login_retry_max = 8
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.xmit_thread_priority = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.cmds_max = 128
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.queue_depth = 32
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.nr_sessions = 1
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.auth.authmethod = None
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.auth.username = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.auth.password = ***
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.auth.username_in = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.auth.password_in = <empty>
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.auth.chap_algs = SHA256
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.timeo.replacement_timeout = 120
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.err_timeo.abort_timeout = 15
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.err_timeo.lu_reset_timeout = 30
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.err_timeo.host_reset_timeout = 60
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.iscsi.FastAbort = Yes
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.iscsi.InitialR2T = No
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.iscsi.ImmediateData = Yes
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.iscsi.FirstBurstLength = 262144
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.iscsi.MaxBurstLength = 16776192
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Retain = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.iscsi.DefaultTime2Wait = 2
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.iscsi.MaxConnections = 1
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.iscsi.ERL = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.scan = auto
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.session.reopen_max = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].address = 192.168.40.100
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].port = 3260
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].startup = manual
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].tcp.window_size = 524288
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].tcp.type_of_service = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].timeo.logout_timeout = 15
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].timeo.login_timeout = 15
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].timeo.auth_timeout = 45
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_interval = 5
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].timeo.noop_out_timeout = 5
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].iscsi.HeaderDigest = None
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].iscsi.DataDigest = None
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].iscsi.IFMarker = No
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: node.conn[0].iscsi.OFMarker = No
May 27 23:30:08.628855 np0000001565 nova-compute[98289]: # END RECORD
May 27 23:30:08.628855 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:08.634533 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:08.640547 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:08.645703 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:30:08.645703 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:30:08.645826 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:30:08.645826 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:30:08.645952 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:30:08.645952 np0000001565 nova-compute[98289]: 
May 27 23:30:08.652318 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 23:30:08.652318 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:30:08.652511 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 23:30:08.652511 np0000001565 nova-compute[98289]:  {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:30:08.652635 np0000001565 nova-compute[98289]: WARNING os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 23:30:08.652635 np0000001565 nova-compute[98289]: 
May 27 23:30:08.775669 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:30:09.056292 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:30:09.056776 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.174s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:30:09.056776 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:30:09.677320 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d, portal: 192.168.50.100,3260]
May 27 23:30:09.677320 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d, portal: 192.168.50.100,3260] successful.
May 27 23:30:09.677320 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:09.681881 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d, portal: 192.168.40.100,3260]
May 27 23:30:09.681881 np0000001565 nova-compute[98289]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d, portal: 192.168.40.100,3260] successful.
May 27 23:30:09.681881 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:09.687682 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:09.694487 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:09.699899 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:09.699899 np0000001565 nova-compute[98289]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:09.699899 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:30:09.700045 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:09.700045 np0000001565 nova-compute[98289]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:09.700045 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:30:09.700251 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.114s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:30:09.700426 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to 192.168.50.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:30:09.700904 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] HCTL ('7', '-', '-', 0) found on session 233 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:30:09.701019 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:30:09.708257 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:09.708257 np0000001565 nova-compute[98289]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:09.708257 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:30:09.708369 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:09.708369 np0000001565 nova-compute[98289]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:09.708369 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:30:09.708601 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.123s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:30:09.708693 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to 192.168.40.100:3260 {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 23:30:09.709080 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] HCTL ('8', '-', '-', 0) found on session 234 with lun 0 {{(pid=98289) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 23:30:09.709282 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98289) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 23:30:09.713409 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 233 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:30:09.713409 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0388a8d0-4cad-480f-bd62-b3612e80196d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:30:09.721142 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Searching for a device in session 234 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98289) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 23:30:09.721142 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0388a8d0-4cad-480f-bd62-b3612e80196d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98289) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 23:30:10.586511 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 23:30:11.056578 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:30:11.056877 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.07 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:30:11.124066 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:30:11.124273 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:30:11.600644 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found WWN 33000000069f1bfb4 for multipath device dm-0 {{(pid=98289) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 23:30:11.601027 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:30:11.601027 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== connect_volume: return (4028ms) {'type': 'block', 'scsi_wwn': '33000000069f1bfb4', 'path': '/dev/dm-0', 'multipath_id': '33000000069f1bfb4'} {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:30:11.601100 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000069f1bfb4', 'path': '/dev/dm-0', 'multipath_id': '33000000069f1bfb4'} {{(pid=98289) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 23:30:11.603534 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid 661ec4bb-0ed4-4910-b19a-db5072e49db0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:30:11.636236 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:12.106237 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Attempting to attach volume 0388a8d0-4cad-480f-bd62-b3612e80196d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98289) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 23:30:12.107467 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] attach device xml: <disk type="block" device="disk">
May 27 23:30:12.107467 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:30:12.107467 np0000001565 nova-compute[98289]:   <alias name="ua-0388a8d0-4cad-480f-bd62-b3612e80196d"/>
May 27 23:30:12.107467 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:30:12.107467 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:30:12.107467 np0000001565 nova-compute[98289]:   <serial>0388a8d0-4cad-480f-bd62-b3612e80196d</serial>
May 27 23:30:12.107467 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:30:12.107467 np0000001565 nova-compute[98289]: </disk>
May 27 23:30:12.107467 np0000001565 nova-compute[98289]:  {{(pid=98289) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 23:30:13.737280 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:30:13.737750 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:30:13.737750 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No BDM found with device name hda, not building metadata. {{(pid=98289) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 23:30:13.737750 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] No VIF found with MAC fa:16:3e:fc:6b:99, not building metadata {{(pid=98289) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 23:30:14.117588 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:30:14.117865 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.01 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:30:14.123505 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:30:14.123707 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:30:15.123818 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:30:15.124124 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:30:15.288500 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-2db94522-ed14-45e9-b684-fd94f10155dc tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.377s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:30:15.829754 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:30:15.829929 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:30:16.332368 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Detaching volume 0388a8d0-4cad-480f-bd62-b3612e80196d
May 27 23:30:16.364610 np0000001565 nova-compute[98289]: INFO nova.virt.block_device [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Attempting to driver detach volume 0388a8d0-4cad-480f-bd62-b3612e80196d from mountpoint /dev/vdb
May 27 23:30:16.368006 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found disk vdb by alias ua-0388a8d0-4cad-480f-bd62-b3612e80196d {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:30:16.369363 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Found disk vdb by alias ua-0388a8d0-4cad-480f-bd62-b3612e80196d {{(pid=98289) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 23:30:16.369363 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Attempting to detach device vdb from instance 661ec4bb-0ed4-4910-b19a-db5072e49db0 from the persistent domain config. {{(pid=98289) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 23:30:16.369363 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:30:16.369363 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:30:16.369363 np0000001565 nova-compute[98289]:   <alias name="ua-0388a8d0-4cad-480f-bd62-b3612e80196d"/>
May 27 23:30:16.369363 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:30:16.369363 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:30:16.369363 np0000001565 nova-compute[98289]:   <serial>0388a8d0-4cad-480f-bd62-b3612e80196d</serial>
May 27 23:30:16.369363 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:30:16.369363 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:30:16.369363 np0000001565 nova-compute[98289]: </disk>
May 27 23:30:16.369363 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:30:16.375921 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully detached device vdb from instance 661ec4bb-0ed4-4910-b19a-db5072e49db0 from the persistent domain config.
May 27 23:30:16.376019 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] (1/8): Attempting to detach device vdb with device alias ua-0388a8d0-4cad-480f-bd62-b3612e80196d from instance 661ec4bb-0ed4-4910-b19a-db5072e49db0 from the live domain config. {{(pid=98289) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 23:30:16.376238 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.guest [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] detach device xml: <disk type="block" device="disk">
May 27 23:30:16.376238 np0000001565 nova-compute[98289]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 23:30:16.376238 np0000001565 nova-compute[98289]:   <alias name="ua-0388a8d0-4cad-480f-bd62-b3612e80196d"/>
May 27 23:30:16.376238 np0000001565 nova-compute[98289]:   <source dev="/dev/dm-0"/>
May 27 23:30:16.376238 np0000001565 nova-compute[98289]:   <target dev="vdb" bus="virtio"/>
May 27 23:30:16.376238 np0000001565 nova-compute[98289]:   <serial>0388a8d0-4cad-480f-bd62-b3612e80196d</serial>
May 27 23:30:16.376238 np0000001565 nova-compute[98289]:   <shareable/>
May 27 23:30:16.376238 np0000001565 nova-compute[98289]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 23:30:16.376238 np0000001565 nova-compute[98289]: </disk>
May 27 23:30:16.376238 np0000001565 nova-compute[98289]:  {{(pid=98289) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 23:30:16.638375 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:16.849179 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Received event <DeviceRemovedEvent: 1779924616.8488157, 661ec4bb-0ed4-4910-b19a-db5072e49db0 => ua-0388a8d0-4cad-480f-bd62-b3612e80196d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98289) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 23:30:16.850047 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0388a8d0-4cad-480f-bd62-b3612e80196d for instance 661ec4bb-0ed4-4910-b19a-db5072e49db0 {{(pid=98289) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 23:30:16.852316 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully detached device vdb from instance 661ec4bb-0ed4-4910-b19a-db5072e49db0 from the live domain config.
May 27 23:30:16.880775 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] calling os-brick to detach iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 23:30:16.881030 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x726e5875a0c0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0388a8d0-4cad-480f-bd62-b3612e80196d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 23:30:16.881136 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 23:30:16.881445 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 23:30:16.881715 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0388a8d0-4cad-480f-bd62-b3612e80196d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 23:30:16.881817 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', 0)] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 23:30:16.904659 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:16.904659 np0000001565 nova-compute[98289]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:16.904659 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 23:30:16.904912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsi session list stdout=tcp: [233] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:16.904912 np0000001565 nova-compute[98289]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d (non-flash)
May 27 23:30:16.904912 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 23:30:16.904912 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', '233'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', '234')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 23:30:16.905104 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', '234')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:30:16.905810 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d', '233')] {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 23:30:16.906420 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x726e387edda0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d'): ({'sdb'}, set())}) {{(pid=98289) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 23:30:16.906659 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Removing multipathed devices sdb, sdc {{(pid=98289) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 23:30:16.906961 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Flush multipath device 33000000069f1bfb4 {{(pid=98289) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 23:30:16.939693 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:30:16.983879 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98289) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 23:30:17.033664 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 23:30:17.033858 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98289) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 23:30:17.034444 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 23:30:17.045346 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.linuxscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98289) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 23:30:17.045516 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d')] {{(pid=98289) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 23:30:17.055887 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:17.085433 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 234, target: iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d, portal: 192.168.40.100,3260]
May 27 23:30:17.085433 np0000001565 nova-compute[98289]: Logout of [sid: 234, target: iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d, portal: 192.168.40.100,3260] successful.
May 27 23:30:17.085433 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:17.097556 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:17.108549 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:17.132207 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 233, target: iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d, portal: 192.168.50.100,3260]
May 27 23:30:17.132207 np0000001565 nova-compute[98289]: Logout of [sid: 233, target: iqn.2023-03.storpool.com:os--volume-0388a8d0-4cad-480f-bd62-b3612e80196d, portal: 192.168.50.100,3260] successful.
May 27 23:30:17.132207 np0000001565 nova-compute[98289]:  stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:17.143310 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98289) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 23:30:17.143594 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.base [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 23:30:17.143747 np0000001565 nova-compute[98289]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] <== disconnect_volume: return (262ms) None {{(pid=98289) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 23:30:17.143902 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Disconnected iSCSI Volume {{(pid=98289) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 23:30:17.685606 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'flavor' on Instance uuid 661ec4bb-0ed4-4910-b19a-db5072e49db0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:30:18.117841 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:30:18.118199 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.01 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:30:18.690913 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-b9d6258a-25d0-44df-addf-abf4716682db tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.861s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:30:20.123928 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:30:20.124473 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:30:20.124473 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:30:20.150949 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:30:20.151144 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:30:20.151341 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:30:20.151513 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:30:20.151684 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:30:20.154185 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Terminating instance
May 27 23:30:20.657434 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Start destroying the instance on the hypervisor. {{(pid=98289) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 23:30:20.672368 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:20.674197 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:20.685238 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:20.691999 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:20.711737 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:20.816862 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-70e3a506-fb38-412c-bddd-6cc8f674372e req-8d763507-941b-4ec6-a63d-577aad814208 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Received event network-vif-unplugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:30:20.817073 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-70e3a506-fb38-412c-bddd-6cc8f674372e req-8d763507-941b-4ec6-a63d-577aad814208 service nova] Acquiring lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:30:20.817222 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-70e3a506-fb38-412c-bddd-6cc8f674372e req-8d763507-941b-4ec6-a63d-577aad814208 service nova] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:30:20.817579 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-70e3a506-fb38-412c-bddd-6cc8f674372e req-8d763507-941b-4ec6-a63d-577aad814208 service nova] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:30:20.817687 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-70e3a506-fb38-412c-bddd-6cc8f674372e req-8d763507-941b-4ec6-a63d-577aad814208 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] No waiting events found dispatching network-vif-unplugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:30:20.817790 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-70e3a506-fb38-412c-bddd-6cc8f674372e req-8d763507-941b-4ec6-a63d-577aad814208 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Received event network-vif-unplugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:30:20.896751 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:20.952612 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:20.992971 np0000001565 nova-compute[98289]: DEBUG nova.utils [None req-7ccf7d04-109c-4896-9991-f62ebb7623a6 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999623880999934 future=<Future at 0x726e387e3260 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:30:20.993289 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.99926058500023 future=<Future at 0x726e387e3260 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:30:20.993385 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=14.999137306000193 future=<Future at 0x726e387e3260 state=pending>) {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:30:20.995391 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [-] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Instance destroyed successfully.
May 27 23:30:20.995916 np0000001565 nova-compute[98289]: DEBUG nova.objects.instance [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lazy-loading 'resources' on Instance uuid 661ec4bb-0ed4-4910-b19a-db5072e49db0 {{(pid=98289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 23:30:21.498637 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.vif [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T23:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2129222963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001565',hostname='tempest-volumemultiattachtests-server-2129222963',id=82,image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDX5c1wetviFQ7GdbvnBgyoq7wzGIc+4c5KlBcZ/sKw0az21Sr4lyT8Re7IYlJp2Q0LX/zqXsXeYKn8nJ/vHHLXUPVJfOgOQh8MSUe4T99oJdAl8pwPbEvZELNIgWmAhw==',key_name='tempest-keypair-1413516494',keypairs=<?>,launch_index=0,launched_at=2026-05-27T23:29:25Z,launched_on='np0000001565',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001565',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ec606fe4c964d358de1d627ce948d87',ramdisk_id='',reservation_id='r-xcu4cjum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6300a9f9-2b54-4283-b976-5a0c9409f522',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-892484312',owner_user_name='tempest-VolumeMultiattachTests-892484312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T23:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c175a7231a7b496eacfc7a46ad2a379d',uuid=661ec4bb-0ed4-4910-b19a-db5072e49db0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "address": "fa:16:3e:fc:6b:99", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e84c0e-bf", "ovs_interfaceid": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 23:30:21.499361 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converting VIF {"id": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "address": "fa:16:3e:fc:6b:99", "network": {"id": "d5a9754d-c3fd-443e-bfab-be069165d889", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1518363852-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1ec606fe4c964d358de1d627ce948d87", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e84c0e-bf", "ovs_interfaceid": "45e84c0e-bf81-4a87-b7a9-79fe55d96157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 23:30:21.499716 np0000001565 nova-compute[98289]: DEBUG nova.network.os_vif_util [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:6b:99,bridge_name='br-int',has_traffic_filtering=True,id=45e84c0e-bf81-4a87-b7a9-79fe55d96157,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e84c0e-bf') {{(pid=98289) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 23:30:21.500006 np0000001565 nova-compute[98289]: DEBUG os_vif [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:6b:99,bridge_name='br-int',has_traffic_filtering=True,id=45e84c0e-bf81-4a87-b7a9-79fe55d96157,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e84c0e-bf') {{(pid=98289) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 23:30:21.502092 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:21.502413 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45e84c0e-bf, bridge=br-int, if_exists=True) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:30:21.504076 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:21.505720 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:30:21.506221 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:21.506414 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d91b3dab-fa28-467e-8485-495108cb7708) {{(pid=98289) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 23:30:21.508157 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:30:21.509926 np0000001565 nova-compute[98289]: INFO os_vif [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:6b:99,bridge_name='br-int',has_traffic_filtering=True,id=45e84c0e-bf81-4a87-b7a9-79fe55d96157,network=Network(d5a9754d-c3fd-443e-bfab-be069165d889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e84c0e-bf')
May 27 23:30:21.510199 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Deleting instance files /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0_del
May 27 23:30:21.511006 np0000001565 nova-compute[98289]: INFO nova.virt.libvirt.driver [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Deletion of /opt/stack/data/nova/instances/661ec4bb-0ed4-4910-b19a-db5072e49db0_del complete
May 27 23:30:22.018009 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 23:30:22.018712 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._common.loopingcall [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98289) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 23:30:22.019104 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [-] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Deallocating network for instance {{(pid=98289) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 23:30:22.019287 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] deallocate_for_instance() {{(pid=98289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 23:30:22.019686 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:30:22.124366 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:30:22.124812 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:30:22.130838 np0000001565 nova-compute[98289]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 23:30:22.529344 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a483f847-cc37-412c-b9f5-c54a03846d12 req-d80abb94-3394-405e-b60e-d31fa6ba2894 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Received event network-vif-deleted-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:30:22.529674 np0000001565 nova-compute[98289]: INFO nova.compute.manager [req-a483f847-cc37-412c-b9f5-c54a03846d12 req-d80abb94-3394-405e-b60e-d31fa6ba2894 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Neutron deleted interface 45e84c0e-bf81-4a87-b7a9-79fe55d96157; detaching it from the instance and deleting it from the info cache
May 27 23:30:22.531074 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-a483f847-cc37-412c-b9f5-c54a03846d12 req-d80abb94-3394-405e-b60e-d31fa6ba2894 service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Detach interface failed, port_id=45e84c0e-bf81-4a87-b7a9-79fe55d96157, reason: Instance 661ec4bb-0ed4-4910-b19a-db5072e49db0 could not be found. {{(pid=98289) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 27 23:30:22.869895 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d9756aec-6484-4e65-8406-1d30eade3305 req-88a1da5a-92ab-4a4c-8ce2-8100fbead8ee service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Received event network-vif-unplugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 27 23:30:22.870350 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d9756aec-6484-4e65-8406-1d30eade3305 req-88a1da5a-92ab-4a4c-8ce2-8100fbead8ee service nova] Acquiring lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:30:22.870537 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d9756aec-6484-4e65-8406-1d30eade3305 req-88a1da5a-92ab-4a4c-8ce2-8100fbead8ee service nova] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:30:22.870655 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [req-d9756aec-6484-4e65-8406-1d30eade3305 req-88a1da5a-92ab-4a4c-8ce2-8100fbead8ee service nova] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:30:22.870773 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d9756aec-6484-4e65-8406-1d30eade3305 req-88a1da5a-92ab-4a4c-8ce2-8100fbead8ee service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] No waiting events found dispatching network-vif-unplugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 {{(pid=98289) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 23:30:22.870883 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [req-d9756aec-6484-4e65-8406-1d30eade3305 req-88a1da5a-92ab-4a4c-8ce2-8100fbead8ee service nova] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Received event network-vif-unplugged-45e84c0e-bf81-4a87-b7a9-79fe55d96157 for instance with task_state deleting. {{(pid=98289) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 23:30:22.986085 np0000001565 nova-compute[98289]: DEBUG nova.network.neutron [-] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Updating instance_info_cache with network_info: [] {{(pid=98289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 23:30:23.488042 np0000001565 nova-compute[98289]: INFO nova.compute.manager [-] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Took 1.47 seconds to deallocate network for instance.
May 27 23:30:23.993264 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:30:23.993826 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:30:24.085313 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:30:24.085557 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:30:24.588012 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:30:25.094597 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.101s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:30:25.159596 np0000001565 nova-compute[98289]: INFO nova.scheduler.client.report [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Deleted allocations for instance 661ec4bb-0ed4-4910-b19a-db5072e49db0
May 27 23:30:26.167826 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-78e28ccc-be1a-4c13-ad12-aca83a41062f tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Lock "661ec4bb-0ed4-4910-b19a-db5072e49db0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.016s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:30:26.508448 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:28.418013 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:30.418730 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:31.510950 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:35.992923 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x726e697a8350>>, remaining_delay=-0.0003467349997663405 future=<Future at 0x726e387e3260 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x726e68136ff0> {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:30:35.993611 np0000001565 nova-compute[98289]: DEBUG nova.virt.driver [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] Emitting event <LifecycleEvent: 1779924620.992461, 661ec4bb-0ed4-4910-b19a-db5072e49db0 => Stopped> {{(pid=98289) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 23:30:35.993860 np0000001565 nova-compute[98289]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98289) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 23:30:35.994017 np0000001565 nova-compute[98289]: INFO nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] VM Stopped (Lifecycle Event)
May 27 23:30:36.496563 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-af449ad4-fcb7-47e0-a74c-a32195ebd0b7 tempest-VolumeMultiattachTests-892484312 tempest-VolumeMultiattachTests-892484312-project-member] [instance: 661ec4bb-0ed4-4910-b19a-db5072e49db0] Checking state {{(pid=98289) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 23:30:36.511890 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:41.513671 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:46.514639 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:51.516446 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:30:56.518075 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:30:56.518532 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:30:56.518532 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:30:56.518532 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:30:56.518714 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:30:56.518886 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:31:01.520413 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:31:05.123937 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:31:05.628134 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:31:05.628306 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:31:05.628456 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:31:05.628578 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Auditing locally available compute resources for np0000001565 (node: np0000001565) {{(pid=98289) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 23:31:05.641462 np0000001565 nova-compute[98289]: WARNING nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 23:31:05.642550 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 23:31:05.692924 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.processutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 23:31:05.693301 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Hypervisor/Node resource view: name=np0000001565 free_ram=14232MB free_disk=72.59840393066406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98289) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 23:31:05.693514 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 23:31:05.693760 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 23:31:06.522815 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:31:06.745105 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 23:31:06.745105 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Final resource view: name=np0000001565 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 23:31:05 up 59 min,  1 user,  load average: 0.84, 1.47, 2.62\n'} {{(pid=98289) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 23:31:06.786001 np0000001565 nova-compute[98289]: DEBUG nova.virt.libvirt.driver [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98289) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 23:31:06.786205 np0000001565 nova-compute[98289]: DEBUG nova.compute.provider_tree [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed in ProviderTree for provider: 6afc4609-00ff-4946-93f6-3f759c4c1e43 {{(pid=98289) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 23:31:07.288726 np0000001565 nova-compute[98289]: DEBUG nova.scheduler.client.report [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Inventory has not changed for provider 6afc4609-00ff-4946-93f6-3f759c4c1e43 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98289) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 23:31:07.795842 np0000001565 nova-compute[98289]: DEBUG nova.compute.resource_tracker [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Compute_service record updated for np0000001565:np0000001565 {{(pid=98289) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 23:31:07.796308 np0000001565 nova-compute[98289]: DEBUG oslo_concurrency.lockutils [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.102s {{(pid=98289) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 23:31:07.796492 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:31:10.796502 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:31:10.797026 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.33 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:31:11.523585 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:31:11.523734 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 23:31:11.523824 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98289) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 23:31:11.523885 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:31:11.524155 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98289) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 23:31:11.524363 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:31:13.124275 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:31:13.124746 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:31:14.123810 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:31:14.124115 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:31:15.124113 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:31:15.124881 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:31:16.118143 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:31:16.118668 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:31:16.525167 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:31:21.123827 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:31:21.124396 np0000001565 nova-compute[98289]: DEBUG nova.compute.manager [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98289) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 23:31:21.124396 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:31:21.527365 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:31:22.124361 np0000001565 nova-compute[98289]: DEBUG oslo_service.periodic_task [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98289) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 23:31:22.124971 np0000001565 nova-compute[98289]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d795d20-6ece-4a49-9e7c-6404e0881cc3 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98289) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 23:31:26.528907 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:31:31.529783 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:31:36.531140 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:31:41.533289 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:31:46.534823 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 23:31:51.535795 np0000001565 nova-compute[98289]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98289) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}